-- Logs begin at Thu 2022-09-01 16:45:40 UTC, end at Thu 2022-09-01 17:42:26 UTC. -- Sep 01 17:12:20.231008 dv-cinder-852211-8-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 01 17:12:20.240742 dv-cinder-852211-8-smb devstack@keystone.service[81442]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 01 17:12:20.242156 dv-cinder-852211-8-smb devstack@keystone.service[81442]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 17:12:20 2022] *** Sep 01 17:12:20.242156 dv-cinder-852211-8-smb devstack@keystone.service[81442]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 17:12:20.242156 dv-cinder-852211-8-smb devstack@keystone.service[81442]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 17:12:20.242156 dv-cinder-852211-8-smb devstack@keystone.service[81442]: nodename: dv-cinder-852211-8-smb Sep 01 17:12:20.242156 dv-cinder-852211-8-smb devstack@keystone.service[81442]: machine: x86_64 Sep 01 17:12:20.242156 dv-cinder-852211-8-smb devstack@keystone.service[81442]: clock source: unix Sep 01 17:12:20.242156 dv-cinder-852211-8-smb devstack@keystone.service[81442]: pcre jit disabled Sep 01 17:12:20.242156 dv-cinder-852211-8-smb devstack@keystone.service[81442]: detected number of CPU cores: 4 Sep 01 17:12:20.242156 dv-cinder-852211-8-smb devstack@keystone.service[81442]: current working directory: / Sep 01 17:12:20.242156 dv-cinder-852211-8-smb devstack@keystone.service[81442]: detected binary path: /usr/bin/uwsgi-core Sep 01 17:12:20.242156 dv-cinder-852211-8-smb devstack@keystone.service[81442]: your processes number limit is 47680 Sep 01 17:12:20.242732 dv-cinder-852211-8-smb devstack@keystone.service[81442]: your memory page size is 4096 bytes Sep 01 17:12:20.242732 dv-cinder-852211-8-smb devstack@keystone.service[81442]: detected max file descriptor number: 2048 Sep 01 17:12:20.242732 dv-cinder-852211-8-smb devstack@keystone.service[81442]: lock engine: pthread robust mutexes Sep 01 17:12:20.242732 dv-cinder-852211-8-smb devstack@keystone.service[81442]: thunder lock: enabled Sep 01 17:12:20.242732 dv-cinder-852211-8-smb devstack@keystone.service[81442]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 01 17:12:20.242969 dv-cinder-852211-8-smb devstack@keystone.service[81442]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 17:12:20.283336 dv-cinder-852211-8-smb devstack@keystone.service[81442]: Python main interpreter initialized at 0x55be1757d9c0 Sep 01 17:12:20.283336 dv-cinder-852211-8-smb devstack@keystone.service[81442]: python threads support enabled Sep 01 17:12:20.283336 dv-cinder-852211-8-smb devstack@keystone.service[81442]: your server socket listen backlog is limited to 100 connections Sep 01 17:12:20.283336 dv-cinder-852211-8-smb devstack@keystone.service[81442]: your mercy for graceful operations on workers is 90 seconds Sep 01 17:12:20.283705 dv-cinder-852211-8-smb devstack@keystone.service[81442]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 17:12:20.283774 dv-cinder-852211-8-smb devstack@keystone.service[81442]: *** Operational MODE: preforking *** Sep 01 17:12:20.284022 dv-cinder-852211-8-smb devstack@keystone.service[81442]: *** uWSGI is running in multiple interpreter mode *** Sep 01 17:12:20.284022 dv-cinder-852211-8-smb devstack@keystone.service[81442]: spawned uWSGI master process (pid: 81442) Sep 01 17:12:20.284224 dv-cinder-852211-8-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 01 17:12:20.285443 dv-cinder-852211-8-smb devstack@keystone.service[81442]: spawned uWSGI worker 1 (pid: 81458, cores: 1) Sep 01 17:12:20.285443 dv-cinder-852211-8-smb devstack@keystone.service[81442]: spawned uWSGI worker 2 (pid: 81459, cores: 1) Sep 01 17:12:20.285443 dv-cinder-852211-8-smb devstack@keystone.service[81442]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 17:12:24.549583 dv-cinder-852211-8-smb devstack@keystone.service[81458]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 17:12:24.549583 dv-cinder-852211-8-smb devstack@keystone.service[81458]: from cryptography.utils import int_from_bytes Sep 01 17:12:24.550283 dv-cinder-852211-8-smb devstack@keystone.service[81458]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 17:12:24.550283 dv-cinder-852211-8-smb devstack@keystone.service[81458]: from cryptography.utils import int_from_bytes Sep 01 17:12:24.551879 dv-cinder-852211-8-smb devstack@keystone.service[81459]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 17:12:24.551879 dv-cinder-852211-8-smb devstack@keystone.service[81459]: from cryptography.utils import int_from_bytes Sep 01 17:12:24.552317 dv-cinder-852211-8-smb devstack@keystone.service[81459]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 17:12:24.552317 dv-cinder-852211-8-smb devstack@keystone.service[81459]: from cryptography.utils import int_from_bytes Sep 01 17:12:24.599876 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 17:12:24.600069 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 17:12:24.600299 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] command line args: [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 17:12:24.600596 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 17:12:24.600775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ================================================================================ {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 17:12:24.601027 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] admin_token = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.601271 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] config_dir = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.601478 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.601659 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] config_source = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.601838 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] debug = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.602033 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.602286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 17:12:24.602286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 17:12:24.602409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.602473 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] command line args: [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 17:12:24.602604 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.602693 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 17:12:24.602806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.602887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ================================================================================ {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 17:12:24.603049 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.603226 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] admin_token = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.603305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] list_limit = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.603970 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] log_config_append = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.604092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] config_dir = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.604195 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.604296 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.604396 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] log_dir = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.604538 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] config_source = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.604708 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] log_file = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.604874 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] debug = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.604969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.605092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.605198 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.605282 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.605282 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.605484 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.605611 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.605694 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.605694 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.605885 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.605999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.606074 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] list_limit = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.606188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.606262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] log_config_append = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.606262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.606450 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.606523 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] log_dir = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.606636 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.606710 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] log_file = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.606828 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.606910 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.606982 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.607104 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.607185 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.607257 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.607334 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.607405 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.607485 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.607607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.607743 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.607828 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.607990 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.608224 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.94/identity {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.608355 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.608438 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] publish_errors = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.608524 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.608604 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.608747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.608868 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.608988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.609064 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.609134 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.609213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.609350 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.609505 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.609644 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.609775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] standard_threads = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.609902 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.610037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.610180 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.610297 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.610438 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.94/identity {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.610569 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] use_journal = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.610697 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] publish_errors = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.610829 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] use_json = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.610955 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.611087 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] use_stderr = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.611087 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] use_syslog = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.611332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.611332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.611570 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.611693 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.611874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.612003 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.612137 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.612267 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] standard_threads = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.612391 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.612516 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.612649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.612774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.612905 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.613028 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.613152 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.613276 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] use_journal = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.613276 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] use_json = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.613538 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.613683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] use_stderr = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.613813 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.613939 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] use_syslog = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.614062 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.614195 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:12:24.614319 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.614444 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.614576 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.614698 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.614822 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.614970 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.615094 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.615224 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.615352 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.615486 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.615610 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.615741 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.615864 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.615989 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.616111 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.616238 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.616370 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.616501 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.616636 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.616759 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.616882 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.617006 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.617144 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.617277 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.617415 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.617548 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.617675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.617799 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.617921 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.618121 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.618252 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.618381 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.618507 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.618630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.618761 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.618897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.619021 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.619704 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.619843 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.619970 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.620103 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.620228 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.620352 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.620476 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.620604 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.620604 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.620846 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.620969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.621099 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.621235 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.621360 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.621510 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.621649 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.621774 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.621774 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.622011 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.622132 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.622252 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.622385 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.622385 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.622624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.622748 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.622748 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.622992 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.623123 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.623123 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.623355 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.623479 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.623479 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.623711 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.623848 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.623848 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.624074 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.624200 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.624200 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.624420 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.624626 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.624759 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.624886 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.625012 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.625134 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.625254 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.625387 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.625526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.625645 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.625768 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.625897 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.625897 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.626131 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.626263 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.626389 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.626508 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.626630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.626748 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.626878 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.627000 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.627124 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.627249 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.627383 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.627507 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.627507 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.627766 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.627897 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.628164 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.628249 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.628311 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.628377 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.628443 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.628503 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.628503 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.628606 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.628663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.628663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.628774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.628840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.628840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.628959 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.629027 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.629027 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.629150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.629211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.629383 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.629560 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.629746 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.629953 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.630145 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.630227 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.630346 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.630473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.630596 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.630725 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.630860 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.630982 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.631110 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.631239 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.631367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.631488 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.631617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.631738 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.631860 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.631996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.632119 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.632241 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.632388 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.632517 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.632640 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.632760 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.632882 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.633010 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.633140 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.633263 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.633391 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.633568 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.633568 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.633797 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.633929 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.634051 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.634196 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.634331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.634458 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.634585 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.634723 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.634846 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.634972 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.635098 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.635219 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.635345 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.635483 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.635607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.635731 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.635865 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.635989 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.635989 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.636297 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.636424 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.636555 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.636682 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.636682 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.636924 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.637056 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] auth.external = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.637056 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.637302 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.637441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.637566 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.637701 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.637701 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] auth.password = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.637945 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.638070 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] auth.token = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.638194 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.638194 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.638194 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.638549 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.638681 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.638805 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.638929 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.639094 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.639346 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.639597 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.639915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.640172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.640453 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.640580 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.640760 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.640886 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.641040 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.641288 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.641472 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.641603 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.641732 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.641856 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] credential.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.642144 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.642397 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.642652 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.642859 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.643000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.643146 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.643274 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.643399 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.643531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.643656 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.643803 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.643926 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.644052 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.644177 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.644308 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.644441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.644569 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] auth.external = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.644694 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.644855 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.644979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.645115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.645243 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.645377 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.645522 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.645646 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] auth.password = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.645769 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.645903 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] auth.token = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.646027 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.646161 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.646285 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.646408 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.646530 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.646665 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.646789 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.646913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.647037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.647161 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.647290 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.647421 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.647544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.647667 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.647790 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.647920 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] credential.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.648048 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.648181 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.648304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.648428 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.648551 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.648675 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.648797 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.648933 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.649057 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.649181 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.649304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.649471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.649607 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.649745 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.649871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.649994 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.650121 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.650250 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.650373 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.650507 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.650632 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.650632 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.650869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.650993 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.651126 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.651253 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.651387 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.651511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.651638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.651762 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.651893 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.652018 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.652142 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.652269 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.652393 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.652516 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.652712 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.652845 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.652974 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.653098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.653234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.653362 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.653509 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.653639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.653766 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.653893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.654027 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.654153 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.654288 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.654415 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.654541 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.654667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.654799 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.654927 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.655059 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.655192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.655316 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.655444 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.655444 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.655673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.655803 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.655927 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.656051 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.656173 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.656296 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.656420 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.656560 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.656685 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.656808 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.656930 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.657053 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.657176 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.657306 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.657474 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.657609 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.657737 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.657862 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.657988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.658122 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.658249 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.658382 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.658511 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.658636 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.658762 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.658894 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.659019 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.659144 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.659270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.659393 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.659519 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.659653 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.659778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.659903 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.660027 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.660161 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.660285 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.660418 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.660549 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.660675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.660799 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.660923 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.661047 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.661179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.661305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.661446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.661570 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.661698 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.661832 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.661968 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.662093 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.662217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.662343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.662468 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.662601 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.662727 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.662854 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.662978 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.663103 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.663227 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.663359 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.663485 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.663625 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.663751 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.663875 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.664005 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.664138 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.664263 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.664389 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.664515 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.664643 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.664775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.664908 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.665033 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.665156 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.665279 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.665464 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.665589 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.665589 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.665838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.666450 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.666578 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.666705 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.666831 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.666966 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.667122 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.667252 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.667378 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.667505 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.667644 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.667777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.667904 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.668029 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.668154 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.668279 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.668404 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.668536 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.668662 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.668786 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.668910 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.669037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.669161 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.669295 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.669447 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.669571 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.669695 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.669818 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.669940 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.670074 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.670198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.670326 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.670449 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.670572 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.670700 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.670831 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.671272 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.671410 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.671549 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.671678 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.671802 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.671802 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.672052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.672181 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.672308 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.672436 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.672563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.672695 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.672818 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.672941 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.673064 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.673198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.673363 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.673544 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.673670 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.673670 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.673905 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.673905 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.674139 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.674272 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.674397 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.674397 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.674633 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.674633 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.674867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.674867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.675118 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.675246 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.675371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.675499 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] role.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.675625 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.675759 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] role.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.675884 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.676008 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.676134 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.676258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.676386 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.676519 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.676646 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.676783 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.676783 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.676783 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.676783 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.676783 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.676783 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.676783 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.676783 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.676783 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.678171 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.678171 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.678171 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.678171 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.678171 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.678171 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.678171 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.678171 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.678171 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.679264 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.679455 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.679455 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.679764 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.679890 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.680015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.680205 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.680327 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.680465 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.680465 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.680707 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.680831 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.680956 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.681080 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.681207 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.681340 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.681340 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.681607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.682278 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.682436 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.682633 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.682633 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.682953 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.683080 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.683204 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.683332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.683459 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.683593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.683722 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.683849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.683976 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.684100 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.684227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.684361 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.684361 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.684361 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.684723 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.684849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.684975 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.685120 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.685246 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.685369 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.685537 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] role.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.685657 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.685784 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] role.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.685919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.686044 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.686172 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.686297 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.686431 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.686431 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.686682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.686682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.686927 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.686927 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.connection = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.687161 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.687287 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.687414 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.687547 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.687673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.687799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.687926 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.688051 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.688187 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.688322 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.688448 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.688572 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.688696 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.688821 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.688948 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.689082 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.689208 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.689334 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.689471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.689594 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.689594 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.689851 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.689975 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.690098 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.690221 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.690350 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.690477 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.690608 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.690736 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.690859 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.690982 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.691105 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.691234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.691371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.691499 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.691499 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 17:12:24.691746 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.691746 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.691746 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.691746 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.691746 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.691746 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.691746 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.691746 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.691746 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.692746 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.692746 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.692746 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.692746 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.692746 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.692746 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.692746 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.693586 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.693586 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.693586 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.693936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.693936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.694181 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.694351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.694593 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.694832 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.695080 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.695361 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.695595 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.695841 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.696740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.696740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.connection = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.696986 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.697132 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.697874 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.698123 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.698363 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.698603 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.698843 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.699084 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.699333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.699572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.699821 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.700059 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.700309 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.700547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.700794 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.701029 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.701270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.701541 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:12:24.701715 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 17:12:24.719573 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:24.719802 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:24.720024 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:24.727057 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:24.727293 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:24.727522 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:24.728385 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:24.736200 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:24.756346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:24.756572 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:24.762990 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:24.763227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:24.810310 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:24.810742 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:24.859008 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:24.859239 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:24.860763 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:24.861003 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.015682 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.015947 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.016100 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.016313 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.016530 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.016744 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.016874 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.017004 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.017214 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.017466 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.017690 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.017910 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.039917 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.040147 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.040375 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.040601 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.040739 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.040874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.041041 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.041173 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.041316 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.041472 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.041602 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.041602 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.041852 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.041995 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.052353 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.052969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.065569 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.065754 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.065886 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.066031 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.066166 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.066298 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.066431 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.066561 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.066708 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.066860 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.066993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.067123 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.067254 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.067254 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 17:12:25.083841 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.084052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 17:12:25.084279 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.084410 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.084540 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 17:12:25.084683 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 17:12:25.084827 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.085066 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.085195 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.085326 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 17:12:25.085491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.085620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.085750 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.085881 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.086078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.086343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.095084 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.095362 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.095630 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.095761 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.095912 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.096053 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.096267 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.096555 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.102839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.104057 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.106259 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.106542 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.106823 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.106988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.107117 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.107274 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.107414 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.107547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.107678 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.107830 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.107958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.108127 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.108259 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.108402 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.108534 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.108657 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.108867 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.108960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.109153 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.109464 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.109733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.110007 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.131417 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.132635 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.132859 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.133141 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.134140 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.134429 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.138174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.138456 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.138735 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.139636 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.139925 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.140212 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.145168 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.145466 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.146597 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.146887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.149439 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.149789 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.150094 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.150440 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.150714 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.151065 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.151362 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.151653 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.151942 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.152220 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.152497 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.152579 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.152768 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.152850 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.153045 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.153127 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.169217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.169537 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.170587 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.170871 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.173353 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.174891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.176462 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.176755 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.178051 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.178351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.181057 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.182716 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.184370 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.186032 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.187461 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.187760 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.188041 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.188320 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.188594 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.188975 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.189142 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.189468 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.189755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.190038 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.190326 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.190604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.205488 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.205772 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.206036 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.206315 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.207312 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.207602 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.207872 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.208147 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.213041 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.214715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.215211 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.216249 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.216522 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.216752 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.218331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.218612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.219168 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.219450 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.219746 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.220028 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.220312 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.221427 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.221719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.222008 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.222295 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.222600 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.232019 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.232302 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.232579 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.232854 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.233140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.233422 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.233729 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.234561 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.234847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.235130 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.235414 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.235695 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.235985 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.236274 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.249001 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.251794 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.252022 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.254756 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.254891 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.256320 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.257663 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.257798 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.258081 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.258377 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.259239 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.261257 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.261634 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.261931 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.265362 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.266847 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.268409 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.269719 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.270016 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.270151 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.270305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.270572 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.272909 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.273203 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.273538 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.273819 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.278510 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.278802 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.279081 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.281861 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.282154 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.282437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.285957 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.286242 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.286524 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.286797 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.287065 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.287349 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.287623 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.287897 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.288172 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.288446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.288716 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.288975 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.289236 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.289328 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 17:12:25.289544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.289646 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.289840 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.290119 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.290394 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.290670 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.291477 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.291754 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.292289 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.292593 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.292874 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.293144 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.293436 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.293715 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 17:12:25.324599 dv-cinder-852211-8-smb devstack@keystone.service[81458]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55be1757d9c0 pid: 81458 (default app) Sep 01 17:12:25.327937 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1584821-1837-4b44-b700-ac9ffa79c416 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:25.328223 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1584821-1837-4b44-b700-ac9ffa79c416 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:25.328493 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1584821-1837-4b44-b700-ac9ffa79c416 None None] PATH_INFO: `/v3` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:25.328591 dv-cinder-852211-8-smb devstack@keystone.service[81459]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55be1757d9c0 pid: 81459 (default app) Sep 01 17:12:25.332651 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1/1] 10.222.0.94 () {50 vars in 791 bytes} [Thu Sep 1 17:12:25 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:31.875652 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8d277-9061-4d51-9a1c-d44c7f562e96 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:31.876129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8d277-9061-4d51-9a1c-d44c7f562e96 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:31.876129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8d277-9061-4d51-9a1c-d44c7f562e96 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:31.881220 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1/2] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:12:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:12:31.887097 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af969a5-c320-4106-9d61-8715f55256ae None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:31.887529 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af969a5-c320-4106-9d61-8715f55256ae None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:31.887667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af969a5-c320-4106-9d61-8715f55256ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:31.959128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: INFO dbcounter [None req-1af969a5-c320-4106-9d61-8715f55256ae None None] Registered counter for database keystone Sep 01 17:12:31.983211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG oslo_db.sqlalchemy.engines [None req-1af969a5-c320-4106-9d61-8715f55256ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:12:31.989343 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writer thread running {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:12:32.166605 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG passlib.handlers.bcrypt [None req-1af969a5-c320-4106-9d61-8715f55256ae None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81458) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 17:12:32.166995 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG passlib.handlers.bcrypt [None req-1af969a5-c320-4106-9d61-8715f55256ae None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81458) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 17:12:32.224644 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1af969a5-c320-4106-9d61-8715f55256ae None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:12:32.226265 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1af969a5-c320-4106-9d61-8715f55256ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:12:32.352617 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 2/3] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:12:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 01 17:12:32.834276 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8d277-9061-4d51-9a1c-d44c7f562e96 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:32.906548 dv-cinder-852211-8-smb devstack@keystone.service[81459]: INFO dbcounter [None req-38f8d277-9061-4d51-9a1c-d44c7f562e96 None None] Registered counter for database keystone Sep 01 17:12:32.927318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG oslo_db.sqlalchemy.engines [None req-38f8d277-9061-4d51-9a1c-d44c7f562e96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81459) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:12:32.933323 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writer thread running {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:12:33.051462 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8d277-9061-4d51-9a1c-d44c7f562e96 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:33.055777 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72650ab7-ffab-41a1-9c2d-8ae2e3d9819a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:33.056404 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72650ab7-ffab-41a1-9c2d-8ae2e3d9819a admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:33.056681 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72650ab7-ffab-41a1-9c2d-8ae2e3d9819a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:33.056948 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72650ab7-ffab-41a1-9c2d-8ae2e3d9819a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:33.065499 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72650ab7-ffab-41a1-9c2d-8ae2e3d9819a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:33.116740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: WARNING keystone.common.rbac_enforcer.enforcer [None req-72650ab7-ffab-41a1-9c2d-8ae2e3d9819a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 17:12:33.117026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72650ab7-ffab-41a1-9c2d-8ae2e3d9819a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:33.126861 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 2/4] 10.222.0.94 () {58 vars in 1324 bytes} [Thu Sep 1 17:12:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 17:12:33.132865 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af969a5-c320-4106-9d61-8715f55256ae None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:33.147569 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af969a5-c320-4106-9d61-8715f55256ae None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:33.151930 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9bfc0-256e-4857-b461-3e9a3ee952ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:33.153003 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9bfc0-256e-4857-b461-3e9a3ee952ab admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:33.153281 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9bfc0-256e-4857-b461-3e9a3ee952ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:33.153588 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9bfc0-256e-4857-b461-3e9a3ee952ab admin admin] PATH_INFO: `/v3/projects/cf6314541ceb40a5aa90aa5d595b2262` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:33.155137 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9bfc0-256e-4857-b461-3e9a3ee952ab admin admin] RBAC: Authorizing `identity:get_project(project_id=cf6314541ceb40a5aa90aa5d595b2262)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:33.207976 dv-cinder-852211-8-smb devstack@keystone.service[81458]: WARNING keystone.common.rbac_enforcer.enforcer [None req-61f9bfc0-256e-4857-b461-3e9a3ee952ab admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 17:12:33.208311 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9bfc0-256e-4857-b461-3e9a3ee952ab admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:33.216879 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 3/5] 10.222.0.94 () {56 vars in 1207 bytes} [Thu Sep 1 17:12:33 2022] GET /identity/v3/projects/cf6314541ceb40a5aa90aa5d595b2262 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:35.076814 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88646d58-a904-4e45-a197-4e2c74db3f61 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:35.077429 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88646d58-a904-4e45-a197-4e2c74db3f61 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:35.077429 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88646d58-a904-4e45-a197-4e2c74db3f61 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:35.081499 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 3/6] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:12:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:12:35.086672 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba033f-4138-4561-b6de-cc2e76668a4e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:35.087090 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba033f-4138-4561-b6de-cc2e76668a4e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:35.087223 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba033f-4138-4561-b6de-cc2e76668a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:35.107464 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-bbba033f-4138-4561-b6de-cc2e76668a4e None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:12:35.108969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bbba033f-4138-4561-b6de-cc2e76668a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:12:35.116767 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 4/7] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:12:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 01 17:12:35.399146 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88646d58-a904-4e45-a197-4e2c74db3f61 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:35.411669 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88646d58-a904-4e45-a197-4e2c74db3f61 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:35.415851 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf5b90-ad53-4b48-95c9-2e6e4cdacc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:35.416439 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf5b90-ad53-4b48-95c9-2e6e4cdacc51 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:35.416717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf5b90-ad53-4b48-95c9-2e6e4cdacc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:35.417580 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf5b90-ad53-4b48-95c9-2e6e4cdacc51 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:35.425176 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf5b90-ad53-4b48-95c9-2e6e4cdacc51 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:35.426980 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf5b90-ad53-4b48-95c9-2e6e4cdacc51 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:35.436097 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 4/8] 10.222.0.94 () {58 vars in 1324 bytes} [Thu Sep 1 17:12:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 17:12:35.441211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba033f-4138-4561-b6de-cc2e76668a4e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:35.450475 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba033f-4138-4561-b6de-cc2e76668a4e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:35.454757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f60024-7443-41f5-94e3-9cada0dcd5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:35.455378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f60024-7443-41f5-94e3-9cada0dcd5cc admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:35.455657 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f60024-7443-41f5-94e3-9cada0dcd5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:35.455938 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f60024-7443-41f5-94e3-9cada0dcd5cc admin admin] PATH_INFO: `/v3/users/50b675acba8e48388c8e8252cc16a021` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:35.457241 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f60024-7443-41f5-94e3-9cada0dcd5cc admin admin] RBAC: Authorizing `identity:get_user(user_id=50b675acba8e48388c8e8252cc16a021)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:35.459088 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f60024-7443-41f5-94e3-9cada0dcd5cc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:35.460594 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 5/9] 10.222.0.94 () {56 vars in 1198 bytes} [Thu Sep 1 17:12:35 2022] GET /identity/v3/users/50b675acba8e48388c8e8252cc16a021 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:37.428898 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f13222-1e50-4d4c-a93d-430f7fd6ba19 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:37.429461 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f13222-1e50-4d4c-a93d-430f7fd6ba19 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:37.429461 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f13222-1e50-4d4c-a93d-430f7fd6ba19 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:37.430790 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 5/10] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:12:37.435839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a07aff-d177-4238-b26d-ca7b7a9f6bc4 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:37.436225 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a07aff-d177-4238-b26d-ca7b7a9f6bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:37.436467 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a07aff-d177-4238-b26d-ca7b7a9f6bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:37.454586 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720516b-f094-4f0d-8718-a8d12e617310 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:37.454880 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720516b-f094-4f0d-8718-a8d12e617310 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:37.454980 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-61a07aff-d177-4238-b26d-ca7b7a9f6bc4 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:12:37.455158 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720516b-f094-4f0d-8718-a8d12e617310 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:37.456155 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-61a07aff-d177-4238-b26d-ca7b7a9f6bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:12:37.456447 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 6/11] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:12:37.461430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d2879-8208-4879-9d78-45dac5dccb9e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:37.461741 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d2879-8208-4879-9d78-45dac5dccb9e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:37.462018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d2879-8208-4879-9d78-45dac5dccb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:37.503921 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG passlib.handlers.bcrypt [None req-a72d2879-8208-4879-9d78-45dac5dccb9e None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81459) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 17:12:37.504394 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG passlib.handlers.bcrypt [None req-a72d2879-8208-4879-9d78-45dac5dccb9e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81459) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 17:12:37.541395 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 6/12] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:12:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:12:37.554335 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a72d2879-8208-4879-9d78-45dac5dccb9e None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:12:37.555958 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a72d2879-8208-4879-9d78-45dac5dccb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:12:37.654276 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 7/13] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:12:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:12:37.810869 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a07aff-d177-4238-b26d-ca7b7a9f6bc4 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:37.834487 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:37.914107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a07aff-d177-4238-b26d-ca7b7a9f6bc4 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:37.924931 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d2879-8208-4879-9d78-45dac5dccb9e None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:37.948113 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0dfcf0-2a24-4380-870c-790bf9ce9b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:37.948746 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0dfcf0-2a24-4380-870c-790bf9ce9b5e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:37.949026 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0dfcf0-2a24-4380-870c-790bf9ce9b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:37.949295 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0dfcf0-2a24-4380-870c-790bf9ce9b5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:37.960253 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0dfcf0-2a24-4380-870c-790bf9ce9b5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:12:37.969073 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-dc0dfcf0-2a24-4380-870c-790bf9ce9b5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:12:37.969073 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:12:37.969073 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:12:37.969073 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:12:37.969073 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:12:37.969073 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:12:37.969073 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:12:37.969073 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:12:37.969073 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:12:37.969073 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:12:37.969073 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:12:37.969073 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:12:37.969073 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:12:37.969073 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:12:37.969073 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:12:37.969073 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:12:37.970085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:12:37.970085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:12:37.970085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:12:37.970085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:12:37.970085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:12:37.970085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:12:37.970085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:12:37.970085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:12:37.970085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:12:37.970085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:12:37.970085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:12:37.970085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:12:37.970085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:12:37.970085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:12:37.970085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:12:37.970085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:12:37.970910 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:12:37.970910 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:12:37.970910 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:12:37.970910 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:12:37.970910 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:12:37.970910 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:12:37.970910 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:12:37.970910 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:12:37.970910 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:12:37.970910 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:12:37.970910 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:12:37.970910 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:12:37.970910 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 7/14] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:12:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:12:37.975887 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0dfcf0-2a24-4380-870c-790bf9ce9b5e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:38.024443 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d2879-8208-4879-9d78-45dac5dccb9e None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:38.026788 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:38.056729 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:38.062235 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c61c1a-d7fe-4ff5-b232-dbd040b9c017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:38.063026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c61c1a-d7fe-4ff5-b232-dbd040b9c017 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:38.063305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c61c1a-d7fe-4ff5-b232-dbd040b9c017 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:38.063573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c61c1a-d7fe-4ff5-b232-dbd040b9c017 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:38.075556 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0dfcf0-2a24-4380-870c-790bf9ce9b5e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:38.109285 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb33934-f813-4234-ac17-52b6b78df618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:38.109919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb33934-f813-4234-ac17-52b6b78df618 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:38.110202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb33934-f813-4234-ac17-52b6b78df618 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:38.110474 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb33934-f813-4234-ac17-52b6b78df618 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:38.111143 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb33934-f813-4234-ac17-52b6b78df618 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:12:38.111447 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb33934-f813-4234-ac17-52b6b78df618 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:38.112840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb33934-f813-4234-ac17-52b6b78df618 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:38.124742 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 8/15] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:12:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:12:38.130240 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb33934-f813-4234-ac17-52b6b78df618 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:38.130935 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c61c1a-d7fe-4ff5-b232-dbd040b9c017 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:38.132444 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c61c1a-d7fe-4ff5-b232-dbd040b9c017 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:38.227505 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb33934-f813-4234-ac17-52b6b78df618 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:38.231363 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 8/16] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:12:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 17:12:38.236928 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c61c1a-d7fe-4ff5-b232-dbd040b9c017 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:38.240210 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:38.263691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb188b-69af-4aaf-8eb4-b7789b5c3bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:38.264327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb188b-69af-4aaf-8eb4-b7789b5c3bee None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:38.264604 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb188b-69af-4aaf-8eb4-b7789b5c3bee None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:38.264877 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb188b-69af-4aaf-8eb4-b7789b5c3bee None admin] PATH_INFO: `/v3/users/50b675acba8e48388c8e8252cc16a021` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:38.266036 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb188b-69af-4aaf-8eb4-b7789b5c3bee None admin] RBAC: Authorizing `identity:get_user(user_id=50b675acba8e48388c8e8252cc16a021)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:38.267487 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb188b-69af-4aaf-8eb4-b7789b5c3bee None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:38.269050 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 9/17] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:12:38 2022] GET /identity/v3/users/50b675acba8e48388c8e8252cc16a021 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:12:38.274632 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb188b-69af-4aaf-8eb4-b7789b5c3bee None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:38.288525 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:38.335052 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c61c1a-d7fe-4ff5-b232-dbd040b9c017 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:38.368388 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0222d57-016b-42dd-a295-d879db138619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:38.369239 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0222d57-016b-42dd-a295-d879db138619 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:38.369551 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0222d57-016b-42dd-a295-d879db138619 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:38.369821 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0222d57-016b-42dd-a295-d879db138619 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:38.372557 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb188b-69af-4aaf-8eb4-b7789b5c3bee None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:38.388381 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0222d57-016b-42dd-a295-d879db138619 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:38.390019 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0222d57-016b-42dd-a295-d879db138619 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:38.406734 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4403b4-5390-43c5-aa11-547060ba0f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:38.407357 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4403b4-5390-43c5-aa11-547060ba0f26 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:38.407635 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4403b4-5390-43c5-aa11-547060ba0f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:38.407906 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4403b4-5390-43c5-aa11-547060ba0f26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:38.409018 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4403b4-5390-43c5-aa11-547060ba0f26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:38.409372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-d0222d57-016b-42dd-a295-d879db138619 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:12:38.409372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:12:38.409372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:12:38.409372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:12:38.409372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:12:38.409372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:12:38.409372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:12:38.409372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:12:38.409372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:12:38.409372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:12:38.409372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:12:38.409372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:12:38.409372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:12:38.409372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:12:38.409372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:12:38.409372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:12:38.410215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:12:38.410215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:12:38.410215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:12:38.410215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:12:38.410215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:12:38.410215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:12:38.410215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:12:38.410215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:12:38.410215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:12:38.410215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:12:38.410215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:12:38.410215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:12:38.410215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:12:38.410215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:12:38.410215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:12:38.410215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:12:38.410215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:12:38.411006 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:12:38.411006 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:12:38.411006 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:12:38.411160 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4403b4-5390-43c5-aa11-547060ba0f26 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:38.411222 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 9/18] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:12:38.416744 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 10/19] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:12:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:12:38.416926 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0222d57-016b-42dd-a295-d879db138619 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:38.417648 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4403b4-5390-43c5-aa11-547060ba0f26 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:38.471557 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:38.496348 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:38.515345 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4403b4-5390-43c5-aa11-547060ba0f26 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:38.516407 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0222d57-016b-42dd-a295-d879db138619 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:38.549687 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e7605-2f3a-4a5b-be17-355fec54d953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:38.550301 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e7605-2f3a-4a5b-be17-355fec54d953 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:38.550580 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e7605-2f3a-4a5b-be17-355fec54d953 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:38.550852 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e7605-2f3a-4a5b-be17-355fec54d953 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:38.551492 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e7605-2f3a-4a5b-be17-355fec54d953 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:12:38.551793 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e7605-2f3a-4a5b-be17-355fec54d953 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:38.552811 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a0f4a-0e47-4ad2-8e6d-b41ab6c7cd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:38.553195 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e7605-2f3a-4a5b-be17-355fec54d953 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:38.553430 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a0f4a-0e47-4ad2-8e6d-b41ab6c7cd7d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:38.553715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a0f4a-0e47-4ad2-8e6d-b41ab6c7cd7d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:38.553985 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a0f4a-0e47-4ad2-8e6d-b41ab6c7cd7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:38.554786 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a0f4a-0e47-4ad2-8e6d-b41ab6c7cd7d None admin] RBAC: Adding query filter params (role.id=70f911a75b7b40a19f65857b9d19cfad, scope.domain.id=default, user.id=50b675acba8e48388c8e8252cc16a021) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:12:38.554995 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a0f4a-0e47-4ad2-8e6d-b41ab6c7cd7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:38.556397 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a0f4a-0e47-4ad2-8e6d-b41ab6c7cd7d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:38.563582 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 11/20] 10.222.0.94 () {56 vars in 1322 bytes} [Thu Sep 1 17:12:38 2022] GET /identity/v3/role_assignments?user.id=50b675acba8e48388c8e8252cc16a021&scope.domain.id=default&role.id=70f911a75b7b40a19f65857b9d19cfad => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:12:38.570963 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 10/21] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:12:40.663579 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f81c9-f0d8-4f0d-b3bd-d2fbf4dec99e None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:40.664583 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f81c9-f0d8-4f0d-b3bd-d2fbf4dec99e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:40.665085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f81c9-f0d8-4f0d-b3bd-d2fbf4dec99e None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:40.666691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 12/22] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:12:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:12:40.672342 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a18d94-1678-4dbf-88bb-837e6e49fcba None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:40.673150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a18d94-1678-4dbf-88bb-837e6e49fcba None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:40.673680 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a18d94-1678-4dbf-88bb-837e6e49fcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:40.702096 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d2a18d94-1678-4dbf-88bb-837e6e49fcba None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:12:40.703650 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d2a18d94-1678-4dbf-88bb-837e6e49fcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:12:40.794796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 11/23] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:12:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:12:40.896395 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71432a5-7a53-4b5a-8e6a-7bd4e256bc3c None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:40.897114 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71432a5-7a53-4b5a-8e6a-7bd4e256bc3c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:40.897626 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71432a5-7a53-4b5a-8e6a-7bd4e256bc3c None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:40.899163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 13/24] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:12:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:12:40.904329 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c99d6-7bf9-4e8f-821d-336905db921d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:40.904864 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c99d6-7bf9-4e8f-821d-336905db921d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:40.905354 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c99d6-7bf9-4e8f-821d-336905db921d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:40.934423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-0b3c99d6-7bf9-4e8f-821d-336905db921d None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:12:40.935958 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0b3c99d6-7bf9-4e8f-821d-336905db921d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:12:40.989770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:41.021752 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 12/25] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:12:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:12:41.096787 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4785440-f35f-4c05-84cb-7cff192ba449 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:41.097420 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4785440-f35f-4c05-84cb-7cff192ba449 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:41.097966 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4785440-f35f-4c05-84cb-7cff192ba449 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:41.099525 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 14/26] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:12:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:12:41.105523 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51223999-568f-4c22-b3d3-918a5a407a8d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:41.106060 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51223999-568f-4c22-b3d3-918a5a407a8d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:41.106546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51223999-568f-4c22-b3d3-918a5a407a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:41.134388 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-51223999-568f-4c22-b3d3-918a5a407a8d None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:12:41.136425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-51223999-568f-4c22-b3d3-918a5a407a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:12:41.226990 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 13/27] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:12:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:12:41.319123 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4785440-f35f-4c05-84cb-7cff192ba449 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:41.447120 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4785440-f35f-4c05-84cb-7cff192ba449 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:41.502380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f46c1-6304-4790-93f5-a5b9f26c74d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:41.503028 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f46c1-6304-4790-93f5-a5b9f26c74d0 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:41.503306 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f46c1-6304-4790-93f5-a5b9f26c74d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:41.503577 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f46c1-6304-4790-93f5-a5b9f26c74d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:41.519784 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f46c1-6304-4790-93f5-a5b9f26c74d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:12:41.525107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-391f46c1-6304-4790-93f5-a5b9f26c74d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:12:41.525107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:12:41.525107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:12:41.525107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:12:41.525107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:12:41.525107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:12:41.525107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:12:41.525107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:12:41.525107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:12:41.525107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:12:41.525107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:12:41.525107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:12:41.525107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:12:41.525107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:12:41.525107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:12:41.525107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:12:41.525955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:12:41.525955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:12:41.525955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:12:41.525955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:12:41.525955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:12:41.525955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:12:41.525955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:12:41.525955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:12:41.525955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:12:41.525955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:12:41.525955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:12:41.525955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:12:41.525955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:12:41.525955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:12:41.525955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:12:41.525955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:12:41.527295 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:12:41.527295 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:12:41.527295 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:12:41.527295 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:12:41.527295 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:12:41.527295 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:12:41.527295 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:12:41.527295 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:12:41.527295 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:12:41.527295 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:12:41.527295 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:12:41.527295 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:12:41.527295 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 15/28] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:12:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:12:41.547993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51223999-568f-4c22-b3d3-918a5a407a8d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:41.566333 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f46c1-6304-4790-93f5-a5b9f26c74d0 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:41.575637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:41.689425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51223999-568f-4c22-b3d3-918a5a407a8d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:41.694537 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:41.733089 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f46c1-6304-4790-93f5-a5b9f26c74d0 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:41.737148 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05cabc2-54f1-4528-9eff-c0e5ceb15a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:41.738067 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cabc2-54f1-4528-9eff-c0e5ceb15a79 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:41.738521 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cabc2-54f1-4528-9eff-c0e5ceb15a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:41.738965 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cabc2-54f1-4528-9eff-c0e5ceb15a79 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:41.739826 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05cabc2-54f1-4528-9eff-c0e5ceb15a79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:12:41.740300 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05cabc2-54f1-4528-9eff-c0e5ceb15a79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:41.741969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05cabc2-54f1-4528-9eff-c0e5ceb15a79 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:41.755255 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 14/29] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:12:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:41.756802 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bb83c-5dbe-4200-884a-bf88346cdfb2 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:41.757322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bb83c-5dbe-4200-884a-bf88346cdfb2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:41.757846 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bb83c-5dbe-4200-884a-bf88346cdfb2 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:41.759233 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 15/30] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:12:41.760117 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bb83c-5dbe-4200-884a-bf88346cdfb2 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:41.773192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a7cbb-4787-4a54-a0c2-93fa8fda3f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:41.773875 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a7cbb-4787-4a54-a0c2-93fa8fda3f68 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:41.774155 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a7cbb-4787-4a54-a0c2-93fa8fda3f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:41.774428 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a7cbb-4787-4a54-a0c2-93fa8fda3f68 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:41.775219 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a7cbb-4787-4a54-a0c2-93fa8fda3f68 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:41.776771 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a7cbb-4787-4a54-a0c2-93fa8fda3f68 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:41.871163 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bb83c-5dbe-4200-884a-bf88346cdfb2 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:41.905914 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c9cf3-d1b3-4a6f-b6b1-c1a916a6bfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:41.906716 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c9cf3-d1b3-4a6f-b6b1-c1a916a6bfbf None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:41.907095 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c9cf3-d1b3-4a6f-b6b1-c1a916a6bfbf None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:41.907467 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c9cf3-d1b3-4a6f-b6b1-c1a916a6bfbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:41.911712 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 16/31] 10.222.0.94 () {60 vars in 1131 bytes} [Thu Sep 1 17:12:41 2022] POST /identity/v3/roles => generated 219 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:12:41.912588 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a7cbb-4787-4a54-a0c2-93fa8fda3f68 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:41.930749 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c9cf3-d1b3-4a6f-b6b1-c1a916a6bfbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:41.932402 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c9cf3-d1b3-4a6f-b6b1-c1a916a6bfbf None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:41.960524 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-a99c9cf3-d1b3-4a6f-b6b1-c1a916a6bfbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:12:41.960524 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:12:41.960524 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:12:41.960524 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:12:41.960524 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:12:41.960524 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:12:41.960524 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:12:41.960524 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:12:41.960524 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:12:41.960524 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:12:41.960524 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:12:41.960524 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:12:41.960524 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:12:41.960524 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:12:41.960524 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:12:41.960524 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:12:41.961546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:12:41.961546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:12:41.961546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:12:41.961546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:12:41.961546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:12:41.961546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:12:41.961546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:12:41.961546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:12:41.961546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:12:41.961546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:12:41.961546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:12:41.961546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:12:41.961546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:12:41.961546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:12:41.961546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:12:41.961546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:12:41.961546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:12:41.962342 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:12:41.962342 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:12:41.962342 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:12:41.962497 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 16/32] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:12:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:12:41.964082 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7812c2f-4d80-4ec7-8126-21d125ec1f36 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:41.964431 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7812c2f-4d80-4ec7-8126-21d125ec1f36 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:41.964773 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7812c2f-4d80-4ec7-8126-21d125ec1f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:41.997391 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:41.999582 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f7812c2f-4d80-4ec7-8126-21d125ec1f36 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:12:42.001034 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f7812c2f-4d80-4ec7-8126-21d125ec1f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:12:42.030934 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:42.031955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a7cbb-4787-4a54-a0c2-93fa8fda3f68 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:42.071487 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a283d08-3133-4c4e-86e1-c2eae0331caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:42.072276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a283d08-3133-4c4e-86e1-c2eae0331caf None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:42.072631 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a283d08-3133-4c4e-86e1-c2eae0331caf None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:42.073235 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a283d08-3133-4c4e-86e1-c2eae0331caf None admin] PATH_INFO: `/v3/users/50b675acba8e48388c8e8252cc16a021` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:42.074811 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a283d08-3133-4c4e-86e1-c2eae0331caf None admin] RBAC: Authorizing `identity:get_user(user_id=50b675acba8e48388c8e8252cc16a021)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:42.076654 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a283d08-3133-4c4e-86e1-c2eae0331caf None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:42.078685 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 17/33] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:12:41 2022] GET /identity/v3/users/50b675acba8e48388c8e8252cc16a021 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:42.079711 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a283d08-3133-4c4e-86e1-c2eae0331caf None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:42.166900 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 17/34] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:12:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:12:42.167883 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7812c2f-4d80-4ec7-8126-21d125ec1f36 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:42.190006 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a283d08-3133-4c4e-86e1-c2eae0331caf None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:42.245786 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:42.259601 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc41ed5-80d9-43af-98a5-98516c378520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:42.260519 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc41ed5-80d9-43af-98a5-98516c378520 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:42.260519 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc41ed5-80d9-43af-98a5-98516c378520 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:42.260723 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc41ed5-80d9-43af-98a5-98516c378520 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:42.261940 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc41ed5-80d9-43af-98a5-98516c378520 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:12:42.262245 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc41ed5-80d9-43af-98a5-98516c378520 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:42.263639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc41ed5-80d9-43af-98a5-98516c378520 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:42.295581 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 18/35] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:42.301141 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc41ed5-80d9-43af-98a5-98516c378520 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:42.315155 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7812c2f-4d80-4ec7-8126-21d125ec1f36 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:42.359443 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb9034-85d5-493c-a783-c60035d27167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:42.361555 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb9034-85d5-493c-a783-c60035d27167 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:42.362001 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb9034-85d5-493c-a783-c60035d27167 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:42.363277 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb9034-85d5-493c-a783-c60035d27167 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:42.366076 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb9034-85d5-493c-a783-c60035d27167 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:42.368966 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb9034-85d5-493c-a783-c60035d27167 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:42.372758 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 18/36] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:12:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:42.381738 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb9034-85d5-493c-a783-c60035d27167 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:42.419046 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:42.488277 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc41ed5-80d9-43af-98a5-98516c378520 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:42.524434 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82f8ae-f190-4523-81ba-b3c3ba07a58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:42.524984 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82f8ae-f190-4523-81ba-b3c3ba07a58e None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:42.525322 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82f8ae-f190-4523-81ba-b3c3ba07a58e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:42.525574 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82f8ae-f190-4523-81ba-b3c3ba07a58e None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:42.526266 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82f8ae-f190-4523-81ba-b3c3ba07a58e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:42.529849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82f8ae-f190-4523-81ba-b3c3ba07a58e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:42.541372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb9034-85d5-493c-a783-c60035d27167 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:42.561093 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 19/37] 10.222.0.94 () {60 vars in 1141 bytes} [Thu Sep 1 17:12:42 2022] POST /identity/v3/projects => generated 301 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:12:42.562542 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea56ffb-71db-4d38-ac65-80c14451f1d5 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:42.562835 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea56ffb-71db-4d38-ac65-80c14451f1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:42.563117 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea56ffb-71db-4d38-ac65-80c14451f1d5 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:42.564524 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 20/38] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:12:42.569303 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea56ffb-71db-4d38-ac65-80c14451f1d5 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:42.591051 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf710441-69e7-462e-9741-376227fde151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:42.591780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf710441-69e7-462e-9741-376227fde151 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:42.592057 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf710441-69e7-462e-9741-376227fde151 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:42.592332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf710441-69e7-462e-9741-376227fde151 None admin] PATH_INFO: `/v3/domains/default/users/50b675acba8e48388c8e8252cc16a021/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:42.595318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf710441-69e7-462e-9741-376227fde151 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=50b675acba8e48388c8e8252cc16a021, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:42.597464 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf710441-69e7-462e-9741-376227fde151 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:42.627144 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:42.693454 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea56ffb-71db-4d38-ac65-80c14451f1d5 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:42.734028 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82983a3d-1b4b-4f46-a722-34bafd92f833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:42.734684 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82983a3d-1b4b-4f46-a722-34bafd92f833 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:42.734918 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82983a3d-1b4b-4f46-a722-34bafd92f833 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:42.735168 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82983a3d-1b4b-4f46-a722-34bafd92f833 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:42.736637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82983a3d-1b4b-4f46-a722-34bafd92f833 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:42.737865 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82983a3d-1b4b-4f46-a722-34bafd92f833 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:42.739448 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 19/39] 10.222.0.94 () {58 vars in 1361 bytes} [Thu Sep 1 17:12:42 2022] PUT /identity/v3/domains/default/users/50b675acba8e48388c8e8252cc16a021/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:12:42.740914 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae957d9-8bd6-46a3-98d6-b1c4a2a55933 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:42.741428 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae957d9-8bd6-46a3-98d6-b1c4a2a55933 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:42.741533 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae957d9-8bd6-46a3-98d6-b1c4a2a55933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:42.760462 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 21/40] 10.222.0.94 () {60 vars in 1131 bytes} [Thu Sep 1 17:12:42 2022] POST /identity/v3/roles => generated 225 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:12:42.762253 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f256a-4468-49e3-be92-e95d67fc825c None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:42.762862 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f256a-4468-49e3-be92-e95d67fc825c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:42.763145 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f256a-4468-49e3-be92-e95d67fc825c None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:42.764814 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 22/41] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:12:42.770791 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e677479-99bc-4019-98fb-3b1d655e355e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:42.771132 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e677479-99bc-4019-98fb-3b1d655e355e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:42.771365 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e677479-99bc-4019-98fb-3b1d655e355e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:42.776119 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-fae957d9-8bd6-46a3-98d6-b1c4a2a55933 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:12:42.779348 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fae957d9-8bd6-46a3-98d6-b1c4a2a55933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:12:42.793989 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4e677479-99bc-4019-98fb-3b1d655e355e None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:12:42.795734 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4e677479-99bc-4019-98fb-3b1d655e355e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:12:42.894637 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 20/42] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:12:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:12:42.899739 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 23/43] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:12:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:12:43.162095 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae957d9-8bd6-46a3-98d6-b1c4a2a55933 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:43.172607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:43.174003 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e677479-99bc-4019-98fb-3b1d655e355e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:43.210431 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:43.275459 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae957d9-8bd6-46a3-98d6-b1c4a2a55933 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:43.312830 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1a907-62dc-4204-9057-d944076bd5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:43.313485 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1a907-62dc-4204-9057-d944076bd5f4 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:43.313770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1a907-62dc-4204-9057-d944076bd5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:43.314046 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1a907-62dc-4204-9057-d944076bd5f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:43.314735 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb1a907-62dc-4204-9057-d944076bd5f4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:43.316353 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb1a907-62dc-4204-9057-d944076bd5f4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:43.336258 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 21/44] 10.222.0.94 () {60 vars in 1131 bytes} [Thu Sep 1 17:12:43 2022] POST /identity/v3/roles => generated 223 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:12:43.393755 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e677479-99bc-4019-98fb-3b1d655e355e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:43.432699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef5040-79d5-4001-a608-f20f6eb67081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:43.433840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef5040-79d5-4001-a608-f20f6eb67081 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:43.434121 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef5040-79d5-4001-a608-f20f6eb67081 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:43.434444 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef5040-79d5-4001-a608-f20f6eb67081 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:43.435625 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef5040-79d5-4001-a608-f20f6eb67081 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:43.437114 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef5040-79d5-4001-a608-f20f6eb67081 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:43.439024 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 24/45] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:12:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:43.444803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1a907-62dc-4204-9057-d944076bd5f4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:43.520805 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:43.561891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1a907-62dc-4204-9057-d944076bd5f4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:43.699177 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af56e94-4818-4615-80a2-d2bb561e8d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:43.699713 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af56e94-4818-4615-80a2-d2bb561e8d1b None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:43.699991 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af56e94-4818-4615-80a2-d2bb561e8d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:43.700260 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af56e94-4818-4615-80a2-d2bb561e8d1b None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:43.700913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af56e94-4818-4615-80a2-d2bb561e8d1b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:43.702364 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af56e94-4818-4615-80a2-d2bb561e8d1b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:43.730492 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 22/46] 10.222.0.94 () {60 vars in 1141 bytes} [Thu Sep 1 17:12:43 2022] POST /identity/v3/projects => generated 312 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:12:44.738436 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de2970-76c9-4f42-9ad5-014114d53e4c None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:44.738944 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de2970-76c9-4f42-9ad5-014114d53e4c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:44.739057 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de2970-76c9-4f42-9ad5-014114d53e4c None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:44.740333 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 25/47] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:12:44.745431 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69e96b-847e-4102-be41-fbfee482afb6 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:44.745864 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69e96b-847e-4102-be41-fbfee482afb6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:44.746035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69e96b-847e-4102-be41-fbfee482afb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:44.764148 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-0b69e96b-847e-4102-be41-fbfee482afb6 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:12:44.765346 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0b69e96b-847e-4102-be41-fbfee482afb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:12:44.834385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 23/48] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:12:45.105263 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de2970-76c9-4f42-9ad5-014114d53e4c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:45.204014 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de2970-76c9-4f42-9ad5-014114d53e4c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:45.205551 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:45.239240 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c553a81-fbe0-46a9-97e7-777f697b6b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:45.239874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c553a81-fbe0-46a9-97e7-777f697b6b30 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:45.240159 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c553a81-fbe0-46a9-97e7-777f697b6b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:45.240435 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c553a81-fbe0-46a9-97e7-777f697b6b30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:45.250917 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c553a81-fbe0-46a9-97e7-777f697b6b30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:12:45.255794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-0c553a81-fbe0-46a9-97e7-777f697b6b30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:12:45.255794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:12:45.255794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:12:45.255794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:12:45.255794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:12:45.255794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:12:45.255794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:12:45.255794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:12:45.255794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:12:45.255794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:12:45.255794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:12:45.255794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:12:45.255794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:12:45.255794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:12:45.255794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:12:45.255794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:12:45.256644 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:12:45.256644 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:12:45.256644 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:12:45.256644 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:12:45.256644 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:12:45.256644 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:12:45.256644 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:12:45.256644 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:12:45.256644 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:12:45.256644 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:12:45.256644 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:12:45.256644 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:12:45.256644 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:12:45.256644 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:12:45.256644 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:12:45.256644 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:12:45.257451 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:12:45.257451 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:12:45.257451 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:12:45.257451 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:12:45.257451 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:12:45.257451 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:12:45.257451 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:12:45.257451 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:12:45.257451 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:12:45.257451 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:12:45.257451 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:12:45.257451 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:12:45.257451 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 26/49] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:12:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:12:45.263319 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69e96b-847e-4102-be41-fbfee482afb6 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:45.313163 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:45.363872 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69e96b-847e-4102-be41-fbfee482afb6 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:45.396702 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50db1a-f858-4d17-b0af-6d817b4be8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:45.397319 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50db1a-f858-4d17-b0af-6d817b4be8c1 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:45.397630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50db1a-f858-4d17-b0af-6d817b4be8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:45.397908 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50db1a-f858-4d17-b0af-6d817b4be8c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:45.398574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50db1a-f858-4d17-b0af-6d817b4be8c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:12:45.398879 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50db1a-f858-4d17-b0af-6d817b4be8c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:45.400282 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50db1a-f858-4d17-b0af-6d817b4be8c1 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:45.408371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 24/50] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:12:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:45.414596 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c553a81-fbe0-46a9-97e7-777f697b6b30 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:45.512366 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c553a81-fbe0-46a9-97e7-777f697b6b30 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:45.553094 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912b3a4-e593-4838-9d69-d07ebc6981b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:45.553817 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912b3a4-e593-4838-9d69-d07ebc6981b3 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:45.554095 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912b3a4-e593-4838-9d69-d07ebc6981b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:45.554363 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912b3a4-e593-4838-9d69-d07ebc6981b3 None admin] PATH_INFO: `/v3/users/50b675acba8e48388c8e8252cc16a021` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:45.555466 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912b3a4-e593-4838-9d69-d07ebc6981b3 None admin] RBAC: Authorizing `identity:get_user(user_id=50b675acba8e48388c8e8252cc16a021)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:45.556909 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912b3a4-e593-4838-9d69-d07ebc6981b3 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:45.558507 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 27/51] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:12:45 2022] GET /identity/v3/users/50b675acba8e48388c8e8252cc16a021 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:45.564013 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50db1a-f858-4d17-b0af-6d817b4be8c1 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:45.629085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e8a2b-246f-4d17-8f89-92de3bf0c601 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:45.629294 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e8a2b-246f-4d17-8f89-92de3bf0c601 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:45.629634 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e8a2b-246f-4d17-8f89-92de3bf0c601 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:45.630971 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 28/52] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:12:45.635868 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f63cbc-f103-4396-8bed-2fdcebd00045 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:45.636646 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f63cbc-f103-4396-8bed-2fdcebd00045 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:45.636918 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f63cbc-f103-4396-8bed-2fdcebd00045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:45.655261 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-28f63cbc-f103-4396-8bed-2fdcebd00045 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:12:45.656453 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-28f63cbc-f103-4396-8bed-2fdcebd00045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:12:45.664563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50db1a-f858-4d17-b0af-6d817b4be8c1 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:45.678016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:45.682441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:45.700606 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0df4f5-0e2d-4260-a4f3-bdea9addf112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:45.701243 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0df4f5-0e2d-4260-a4f3-bdea9addf112 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:45.701571 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0df4f5-0e2d-4260-a4f3-bdea9addf112 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:45.701842 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0df4f5-0e2d-4260-a4f3-bdea9addf112 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:45.702946 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0df4f5-0e2d-4260-a4f3-bdea9addf112 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:45.704398 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0df4f5-0e2d-4260-a4f3-bdea9addf112 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:45.706002 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 25/53] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:12:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:45.711739 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0df4f5-0e2d-4260-a4f3-bdea9addf112 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:45.727460 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 29/54] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:12:45.808630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0df4f5-0e2d-4260-a4f3-bdea9addf112 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:45.841375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d55b9a-bf7f-4ae1-9b21-d411481b5dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:45.842005 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d55b9a-bf7f-4ae1-9b21-d411481b5dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:45.842288 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d55b9a-bf7f-4ae1-9b21-d411481b5dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:45.842562 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d55b9a-bf7f-4ae1-9b21-d411481b5dc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:45.843286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d55b9a-bf7f-4ae1-9b21-d411481b5dc3 None admin] RBAC: Adding query filter params (role.id=70f911a75b7b40a19f65857b9d19cfad, scope.domain.id=default, user.id=50b675acba8e48388c8e8252cc16a021) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:12:45.843595 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d55b9a-bf7f-4ae1-9b21-d411481b5dc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:45.845026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d55b9a-bf7f-4ae1-9b21-d411481b5dc3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:45.852705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 26/55] 10.222.0.94 () {56 vars in 1322 bytes} [Thu Sep 1 17:12:45 2022] GET /identity/v3/role_assignments?user.id=50b675acba8e48388c8e8252cc16a021&scope.domain.id=default&role.id=70f911a75b7b40a19f65857b9d19cfad => generated 530 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:12:45.991977 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f63cbc-f103-4396-8bed-2fdcebd00045 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:46.091048 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f63cbc-f103-4396-8bed-2fdcebd00045 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:46.124006 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7a93e-0213-4914-9226-cca5264b4f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:46.124631 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7a93e-0213-4914-9226-cca5264b4f5e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:46.124914 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7a93e-0213-4914-9226-cca5264b4f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:46.125192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7a93e-0213-4914-9226-cca5264b4f5e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:46.126337 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7a93e-0213-4914-9226-cca5264b4f5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:46.127790 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7a93e-0213-4914-9226-cca5264b4f5e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:46.129381 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 30/56] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:12:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:46.135140 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d55b9a-bf7f-4ae1-9b21-d411481b5dc3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:46.178788 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:46.231239 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d55b9a-bf7f-4ae1-9b21-d411481b5dc3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:46.262819 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b9747-2b7f-4dc4-aa5f-22e9c36f202e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:46.263352 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b9747-2b7f-4dc4-aa5f-22e9c36f202e None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:46.263627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b9747-2b7f-4dc4-aa5f-22e9c36f202e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:46.263895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b9747-2b7f-4dc4-aa5f-22e9c36f202e None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:46.264537 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b9747-2b7f-4dc4-aa5f-22e9c36f202e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:46.265992 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b9747-2b7f-4dc4-aa5f-22e9c36f202e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:46.290548 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 27/57] 10.222.0.94 () {60 vars in 1140 bytes} [Thu Sep 1 17:12:46 2022] POST /identity/v3/projects => generated 298 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:12:48.188292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2d286-e2b4-4642-9c33-44ee734da783 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:48.188835 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2d286-e2b4-4642-9c33-44ee734da783 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:48.188835 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2d286-e2b4-4642-9c33-44ee734da783 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:48.190222 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 31/58] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:12:48.195247 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7367287-f1ae-46c4-974c-c65a0a6af568 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:48.195630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7367287-f1ae-46c4-974c-c65a0a6af568 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:48.195810 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7367287-f1ae-46c4-974c-c65a0a6af568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:48.214241 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a7367287-f1ae-46c4-974c-c65a0a6af568 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:12:48.215484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a7367287-f1ae-46c4-974c-c65a0a6af568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:12:48.279673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 28/59] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:12:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:12:48.552984 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2d286-e2b4-4642-9c33-44ee734da783 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:48.581072 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:48.652354 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2d286-e2b4-4642-9c33-44ee734da783 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:48.685172 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443bd41-e848-4621-8e2a-0b4dece277da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:48.686129 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443bd41-e848-4621-8e2a-0b4dece277da None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:48.686418 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443bd41-e848-4621-8e2a-0b4dece277da None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:48.686796 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443bd41-e848-4621-8e2a-0b4dece277da None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:48.688166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443bd41-e848-4621-8e2a-0b4dece277da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:48.690140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443bd41-e848-4621-8e2a-0b4dece277da None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:48.691699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 32/60] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:12:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:48.697160 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7367287-f1ae-46c4-974c-c65a0a6af568 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:48.729973 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:48.801744 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7367287-f1ae-46c4-974c-c65a0a6af568 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:48.835062 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470029fd-e532-4e31-9993-e5a9bc30a1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:48.835674 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470029fd-e532-4e31-9993-e5a9bc30a1f2 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:48.835957 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470029fd-e532-4e31-9993-e5a9bc30a1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:48.836235 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470029fd-e532-4e31-9993-e5a9bc30a1f2 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:48.836878 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470029fd-e532-4e31-9993-e5a9bc30a1f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:48.838379 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470029fd-e532-4e31-9993-e5a9bc30a1f2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:48.863990 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 29/61] 10.222.0.94 () {60 vars in 1132 bytes} [Thu Sep 1 17:12:48 2022] POST /identity/v3/users => generated 275 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:12:51.806289 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd7bf4-126d-4509-a783-324bd34a05d4 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:51.807280 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd7bf4-126d-4509-a783-324bd34a05d4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:51.807760 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd7bf4-126d-4509-a783-324bd34a05d4 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:51.810203 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 33/62] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:12:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:12:51.815840 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f743a-9c6a-42b7-badb-b582eddad6b5 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:51.816667 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f743a-9c6a-42b7-badb-b582eddad6b5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:51.817155 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f743a-9c6a-42b7-badb-b582eddad6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:51.846440 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-1c4f743a-9c6a-42b7-badb-b582eddad6b5 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:12:51.847962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1c4f743a-9c6a-42b7-badb-b582eddad6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:12:51.936311 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 30/63] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:12:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:12:52.027670 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf1444-5493-44b4-9df5-f94407180f30 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:52.028288 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf1444-5493-44b4-9df5-f94407180f30 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:52.028758 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf1444-5493-44b4-9df5-f94407180f30 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:52.030309 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 34/64] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:12:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:12:52.037477 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bee9e-e751-4d8b-8b7e-5782b0321f55 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:52.038003 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bee9e-e751-4d8b-8b7e-5782b0321f55 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:52.038476 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bee9e-e751-4d8b-8b7e-5782b0321f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:52.066558 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f14bee9e-e751-4d8b-8b7e-5782b0321f55 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:12:52.067702 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f14bee9e-e751-4d8b-8b7e-5782b0321f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:12:52.075910 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:52.188564 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 31/65] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:12:52.272324 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc55fab-6f1c-4f64-ba13-8c2a63b29119 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:52.272957 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc55fab-6f1c-4f64-ba13-8c2a63b29119 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:52.273471 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc55fab-6f1c-4f64-ba13-8c2a63b29119 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:52.275027 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 35/66] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:12:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:12:52.281683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6445e-45b5-418c-8de4-1296f7694092 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:52.282139 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6445e-45b5-418c-8de4-1296f7694092 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:52.282551 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6445e-45b5-418c-8de4-1296f7694092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:52.317578 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2eb6445e-45b5-418c-8de4-1296f7694092 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:12:52.319459 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2eb6445e-45b5-418c-8de4-1296f7694092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:12:52.428307 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 32/67] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:12:52.472908 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc55fab-6f1c-4f64-ba13-8c2a63b29119 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:52.598462 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6445e-45b5-418c-8de4-1296f7694092 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:52.603002 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:52.618194 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc55fab-6f1c-4f64-ba13-8c2a63b29119 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:52.680320 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b338c28-8af7-4b62-aca7-0249a70e519e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:52.681635 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b338c28-8af7-4b62-aca7-0249a70e519e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:52.681635 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b338c28-8af7-4b62-aca7-0249a70e519e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:52.681635 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b338c28-8af7-4b62-aca7-0249a70e519e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:52.706257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b338c28-8af7-4b62-aca7-0249a70e519e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:12:52.714089 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-3b338c28-8af7-4b62-aca7-0249a70e519e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:12:52.714089 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:12:52.714089 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:12:52.714089 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:12:52.714089 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:12:52.714089 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:12:52.714089 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:12:52.714089 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:12:52.714089 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:12:52.714089 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:12:52.714089 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:12:52.714089 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:12:52.714089 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:12:52.714089 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:12:52.714089 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:12:52.714089 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:12:52.715479 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:12:52.715479 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:12:52.715479 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:12:52.715479 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:12:52.715479 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:12:52.715479 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:12:52.715479 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:12:52.715479 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:12:52.715479 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:12:52.715479 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:12:52.715479 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:12:52.715479 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:12:52.715479 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:12:52.715479 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:12:52.715479 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:12:52.715479 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:12:52.716223 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:12:52.716223 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:12:52.716223 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:12:52.716223 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:12:52.716223 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:12:52.716223 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:12:52.716223 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:12:52.716223 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:12:52.716223 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:12:52.716223 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:12:52.716223 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:12:52.716223 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:12:52.721128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 36/68] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:12:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:12:52.722668 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267c731-1635-4948-84d6-7bc905a72547 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:52.723468 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267c731-1635-4948-84d6-7bc905a72547 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:52.724222 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267c731-1635-4948-84d6-7bc905a72547 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:52.725950 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 37/69] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:12:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:12:52.726813 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267c731-1635-4948-84d6-7bc905a72547 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:52.736381 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:52.774557 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6445e-45b5-418c-8de4-1296f7694092 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:52.811458 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102c595-d81a-479e-b829-5a4f65ee80e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:52.812102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102c595-d81a-479e-b829-5a4f65ee80e4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:52.812384 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102c595-d81a-479e-b829-5a4f65ee80e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:52.812656 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102c595-d81a-479e-b829-5a4f65ee80e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:52.825127 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c102c595-d81a-479e-b829-5a4f65ee80e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:12:52.831607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-c102c595-d81a-479e-b829-5a4f65ee80e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:12:52.831607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:12:52.831607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:12:52.831607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:12:52.831607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:12:52.831607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:12:52.831607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:12:52.831607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:12:52.831607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:12:52.831607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:12:52.831607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:12:52.831607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:12:52.831607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:12:52.831607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:12:52.831607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:12:52.831607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:12:52.832452 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:12:52.832452 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:12:52.832452 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:12:52.832452 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:12:52.832452 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:12:52.832452 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:12:52.832452 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:12:52.832452 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:12:52.832452 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:12:52.832452 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:12:52.832452 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:12:52.832452 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:12:52.832452 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:12:52.832452 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:12:52.832452 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:12:52.832452 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:12:52.834237 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:12:52.834237 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:12:52.834237 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:12:52.834237 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:12:52.834237 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:12:52.834237 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:12:52.834237 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:12:52.834237 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:12:52.834237 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:12:52.834237 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:12:52.834237 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:12:52.834237 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:12:52.834237 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 33/70] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:12:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:12:52.834237 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800790b9-beec-4893-8d27-e72bbfe486b3 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:52.834938 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800790b9-beec-4893-8d27-e72bbfe486b3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:52.834938 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800790b9-beec-4893-8d27-e72bbfe486b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:52.842574 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267c731-1635-4948-84d6-7bc905a72547 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:52.852639 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-800790b9-beec-4893-8d27-e72bbfe486b3 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:12:52.853864 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-800790b9-beec-4893-8d27-e72bbfe486b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:12:52.883811 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a7d04-a3fc-47c5-a886-5680492be348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:52.884418 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a7d04-a3fc-47c5-a886-5680492be348 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:52.884698 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a7d04-a3fc-47c5-a886-5680492be348 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:52.884966 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a7d04-a3fc-47c5-a886-5680492be348 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:52.885712 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a7d04-a3fc-47c5-a886-5680492be348 None admin] RBAC: Adding query filter params (name=member) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:12:52.886013 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a7d04-a3fc-47c5-a886-5680492be348 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:52.887435 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a7d04-a3fc-47c5-a886-5680492be348 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:52.895275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 38/71] 10.222.0.94 () {56 vars in 1101 bytes} [Thu Sep 1 17:12:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:52.896052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a7d04-a3fc-47c5-a886-5680492be348 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:52.915813 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:52.926919 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 34/72] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:12:52.928169 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84011e-cf1f-4037-b8ce-6c272a179b82 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:52.928456 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84011e-cf1f-4037-b8ce-6c272a179b82 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:52.928731 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84011e-cf1f-4037-b8ce-6c272a179b82 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:52.929999 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 35/73] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:12:52.934042 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84011e-cf1f-4037-b8ce-6c272a179b82 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:53.008849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a7d04-a3fc-47c5-a886-5680492be348 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:53.009751 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:53.044347 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ece5ae-da59-476d-9def-fffeb072e19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:53.045234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ece5ae-da59-476d-9def-fffeb072e19a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:53.045543 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ece5ae-da59-476d-9def-fffeb072e19a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:53.045973 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ece5ae-da59-476d-9def-fffeb072e19a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:53.052978 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84011e-cf1f-4037-b8ce-6c272a179b82 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:53.056336 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ece5ae-da59-476d-9def-fffeb072e19a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:12:53.061656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-f4ece5ae-da59-476d-9def-fffeb072e19a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:12:53.061656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:12:53.061656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:12:53.061656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:12:53.061656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:12:53.061656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:12:53.061656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:12:53.061656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:12:53.061656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:12:53.061656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:12:53.061656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:12:53.061656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:12:53.061656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:12:53.061656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:12:53.061656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:12:53.061656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:12:53.062511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:12:53.062511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:12:53.062511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:12:53.062511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:12:53.062511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:12:53.062511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:12:53.062511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:12:53.062511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:12:53.062511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:12:53.062511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:12:53.062511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:12:53.062511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:12:53.062511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:12:53.062511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:12:53.062511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:12:53.062511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:12:53.063275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:12:53.063275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:12:53.063275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:12:53.063275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:12:53.063275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:12:53.063275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:12:53.063275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:12:53.063275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:12:53.063275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:12:53.063275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:12:53.063275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:12:53.063275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:12:53.063275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 39/74] 10.222.0.94 () {56 vars in 1114 bytes} [Thu Sep 1 17:12:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:12:53.063895 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ece5ae-da59-476d-9def-fffeb072e19a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:53.091944 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84860808-5ba6-4da5-9f2f-692b9440c75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:53.092554 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84860808-5ba6-4da5-9f2f-692b9440c75d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:53.092834 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84860808-5ba6-4da5-9f2f-692b9440c75d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:53.093107 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84860808-5ba6-4da5-9f2f-692b9440c75d None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:53.093799 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84860808-5ba6-4da5-9f2f-692b9440c75d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:12:53.094096 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84860808-5ba6-4da5-9f2f-692b9440c75d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:53.095496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84860808-5ba6-4da5-9f2f-692b9440c75d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:53.103795 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 36/75] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:12:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:53.109884 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996a073-4ad9-44af-9f7f-8e07568d4963 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:53.110171 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996a073-4ad9-44af-9f7f-8e07568d4963 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:53.110448 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996a073-4ad9-44af-9f7f-8e07568d4963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:53.128095 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6996a073-4ad9-44af-9f7f-8e07568d4963 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:12:53.129356 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6996a073-4ad9-44af-9f7f-8e07568d4963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:12:53.152119 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:53.175951 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ece5ae-da59-476d-9def-fffeb072e19a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:53.200956 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 37/76] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:12:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:12:53.206317 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996a073-4ad9-44af-9f7f-8e07568d4963 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:53.211126 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0eb416-0143-48e5-9fa7-1d85554b3a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:53.211767 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0eb416-0143-48e5-9fa7-1d85554b3a63 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:53.212050 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0eb416-0143-48e5-9fa7-1d85554b3a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:53.212327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0eb416-0143-48e5-9fa7-1d85554b3a63 None admin] PATH_INFO: `/v3/users/317a95cd3128411790c45fac9bb511fb` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:53.229381 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0eb416-0143-48e5-9fa7-1d85554b3a63 None admin] RBAC: Authorizing `identity:get_user(user_id=317a95cd3128411790c45fac9bb511fb)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:53.231054 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0eb416-0143-48e5-9fa7-1d85554b3a63 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:53.237517 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 40/77] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:12:53 2022] GET /identity/v3/users/317a95cd3128411790c45fac9bb511fb => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:53.237517 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0eb416-0143-48e5-9fa7-1d85554b3a63 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:53.264381 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:53.311758 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996a073-4ad9-44af-9f7f-8e07568d4963 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:53.343500 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0eb416-0143-48e5-9fa7-1d85554b3a63 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:53.349174 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d6d23-7049-4f6f-a9bf-9c2d330037ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:53.349877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d6d23-7049-4f6f-a9bf-9c2d330037ce None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:53.350160 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d6d23-7049-4f6f-a9bf-9c2d330037ce None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:53.350590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d6d23-7049-4f6f-a9bf-9c2d330037ce None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:53.351250 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d6d23-7049-4f6f-a9bf-9c2d330037ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:12:53.351552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d6d23-7049-4f6f-a9bf-9c2d330037ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:53.353108 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d6d23-7049-4f6f-a9bf-9c2d330037ce None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:53.361708 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 38/78] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:12:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:53.366817 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d6d23-7049-4f6f-a9bf-9c2d330037ce None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:53.378038 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f0418-bc19-4070-b0ef-7947e2f6c33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:53.378676 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f0418-bc19-4070-b0ef-7947e2f6c33d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:53.378961 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f0418-bc19-4070-b0ef-7947e2f6c33d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:53.379235 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f0418-bc19-4070-b0ef-7947e2f6c33d None admin] PATH_INFO: `/v3/users/50b675acba8e48388c8e8252cc16a021` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:53.380374 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f0418-bc19-4070-b0ef-7947e2f6c33d None admin] RBAC: Authorizing `identity:get_user(user_id=50b675acba8e48388c8e8252cc16a021)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:53.381857 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f0418-bc19-4070-b0ef-7947e2f6c33d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:53.383434 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 41/79] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:12:53 2022] GET /identity/v3/users/50b675acba8e48388c8e8252cc16a021 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:53.384198 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f0418-bc19-4070-b0ef-7947e2f6c33d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:53.389576 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:53.477368 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d6d23-7049-4f6f-a9bf-9c2d330037ce None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:53.486850 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f0418-bc19-4070-b0ef-7947e2f6c33d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:53.493115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:53.511565 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020be872-90d8-46be-8052-cf50856f1dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:53.512712 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020be872-90d8-46be-8052-cf50856f1dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:53.512993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020be872-90d8-46be-8052-cf50856f1dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:53.513267 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020be872-90d8-46be-8052-cf50856f1dd5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:53.521358 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50819bd-e0d8-47e9-819a-fdc7a4865453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:53.521982 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50819bd-e0d8-47e9-819a-fdc7a4865453 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:53.522264 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50819bd-e0d8-47e9-819a-fdc7a4865453 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:53.522539 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50819bd-e0d8-47e9-819a-fdc7a4865453 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:53.523420 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020be872-90d8-46be-8052-cf50856f1dd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:12:53.529838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-020be872-90d8-46be-8052-cf50856f1dd5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:12:53.529838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:12:53.529838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:12:53.529838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:12:53.529838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:12:53.529838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:12:53.529838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:12:53.529838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:12:53.529838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:12:53.529838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:12:53.529838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:12:53.529838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:12:53.529838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:12:53.529838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:12:53.529838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:12:53.529838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:12:53.530719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:12:53.530719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:12:53.530719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:12:53.530719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:12:53.530719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:12:53.530719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:12:53.530719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:12:53.530719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:12:53.530719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:12:53.530719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:12:53.530719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:12:53.530719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:12:53.530719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:12:53.530719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:12:53.530719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:12:53.530719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:12:53.531481 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:12:53.531481 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:12:53.531481 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:12:53.531481 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:12:53.531481 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:12:53.531481 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:12:53.531481 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:12:53.531481 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:12:53.531481 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:12:53.531481 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:12:53.531481 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:12:53.531481 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:12:53.531481 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 39/80] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:12:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:12:53.531481 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020be872-90d8-46be-8052-cf50856f1dd5 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:53.594497 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50819bd-e0d8-47e9-819a-fdc7a4865453 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:53.595970 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50819bd-e0d8-47e9-819a-fdc7a4865453 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:53.598574 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:53.628109 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020be872-90d8-46be-8052-cf50856f1dd5 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:53.660591 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc1fbe-2daa-47ae-8fe6-24c2bbca9377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:53.661219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc1fbe-2daa-47ae-8fe6-24c2bbca9377 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:53.661528 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc1fbe-2daa-47ae-8fe6-24c2bbca9377 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:53.661805 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc1fbe-2daa-47ae-8fe6-24c2bbca9377 None admin] PATH_INFO: `/v3/users/317a95cd3128411790c45fac9bb511fb` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:53.662941 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc1fbe-2daa-47ae-8fe6-24c2bbca9377 None admin] RBAC: Authorizing `identity:get_user(user_id=317a95cd3128411790c45fac9bb511fb)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:53.664393 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc1fbe-2daa-47ae-8fe6-24c2bbca9377 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:53.666021 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 40/81] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:12:53 2022] GET /identity/v3/users/317a95cd3128411790c45fac9bb511fb => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:53.670037 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc1fbe-2daa-47ae-8fe6-24c2bbca9377 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:53.693896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 42/82] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:12:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:12:53.694736 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50819bd-e0d8-47e9-819a-fdc7a4865453 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:53.715155 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:53.770459 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc1fbe-2daa-47ae-8fe6-24c2bbca9377 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:53.792571 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50819bd-e0d8-47e9-819a-fdc7a4865453 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:53.795418 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:53.804529 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930ec8d-ba81-434c-9557-a9387513b16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:53.805165 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930ec8d-ba81-434c-9557-a9387513b16b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:53.805484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930ec8d-ba81-434c-9557-a9387513b16b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:53.805764 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930ec8d-ba81-434c-9557-a9387513b16b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:53.827365 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82966f-18b3-4030-b7ac-b2b81e36af04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:53.828002 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82966f-18b3-4030-b7ac-b2b81e36af04 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:53.828287 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82966f-18b3-4030-b7ac-b2b81e36af04 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:53.828561 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82966f-18b3-4030-b7ac-b2b81e36af04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:53.829698 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82966f-18b3-4030-b7ac-b2b81e36af04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:53.831159 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82966f-18b3-4030-b7ac-b2b81e36af04 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:53.832927 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 43/83] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:12:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:53.833511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82966f-18b3-4030-b7ac-b2b81e36af04 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:53.874890 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930ec8d-ba81-434c-9557-a9387513b16b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:53.876382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930ec8d-ba81-434c-9557-a9387513b16b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:53.919657 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:53.937156 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82966f-18b3-4030-b7ac-b2b81e36af04 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:53.970230 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56205288-09a9-4462-87b4-e8bda439ce88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:53.970832 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56205288-09a9-4462-87b4-e8bda439ce88 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:53.971114 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56205288-09a9-4462-87b4-e8bda439ce88 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:53.971387 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56205288-09a9-4462-87b4-e8bda439ce88 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:53.972048 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56205288-09a9-4462-87b4-e8bda439ce88 None admin] RBAC: Adding query filter params (name=member) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:12:53.972353 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56205288-09a9-4462-87b4-e8bda439ce88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:53.973768 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56205288-09a9-4462-87b4-e8bda439ce88 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:53.979325 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 41/84] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:12:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:12:53.979325 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930ec8d-ba81-434c-9557-a9387513b16b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:53.986687 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 44/85] 10.222.0.94 () {56 vars in 1101 bytes} [Thu Sep 1 17:12:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:53.987508 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56205288-09a9-4462-87b4-e8bda439ce88 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:54.021312 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:54.076442 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930ec8d-ba81-434c-9557-a9387513b16b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:54.085860 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56205288-09a9-4462-87b4-e8bda439ce88 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:54.109514 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861ce95-c8a8-4377-b437-f31e4361ecde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:54.110127 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861ce95-c8a8-4377-b437-f31e4361ecde None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:54.110411 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861ce95-c8a8-4377-b437-f31e4361ecde None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:54.110683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861ce95-c8a8-4377-b437-f31e4361ecde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:54.118329 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb546d-9284-4872-8c43-eb35ba3897a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:54.118947 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb546d-9284-4872-8c43-eb35ba3897a8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:54.119221 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb546d-9284-4872-8c43-eb35ba3897a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:54.119495 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb546d-9284-4872-8c43-eb35ba3897a8 None admin] PATH_INFO: `/v3/projects/09e5899a135840f3a8cdeb96945d5623` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:54.120615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb546d-9284-4872-8c43-eb35ba3897a8 None admin] RBAC: Authorizing `identity:get_project(project_id=09e5899a135840f3a8cdeb96945d5623)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:54.122666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb546d-9284-4872-8c43-eb35ba3897a8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:54.124309 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 45/86] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:12:53 2022] GET /identity/v3/projects/09e5899a135840f3a8cdeb96945d5623 => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:54.125071 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb546d-9284-4872-8c43-eb35ba3897a8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:54.125569 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:54.184241 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6861ce95-c8a8-4377-b437-f31e4361ecde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:54.185668 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6861ce95-c8a8-4377-b437-f31e4361ecde None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:54.226582 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb546d-9284-4872-8c43-eb35ba3897a8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:54.228204 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:54.261392 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee2c1e-3eb3-4577-a3c8-12fd38046693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:54.262859 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee2c1e-3eb3-4577-a3c8-12fd38046693 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:54.263151 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee2c1e-3eb3-4577-a3c8-12fd38046693 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:54.263431 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee2c1e-3eb3-4577-a3c8-12fd38046693 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:54.264081 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee2c1e-3eb3-4577-a3c8-12fd38046693 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:54.265561 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee2c1e-3eb3-4577-a3c8-12fd38046693 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:54.281765 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 42/87] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:12:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:12:54.282687 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861ce95-c8a8-4377-b437-f31e4361ecde None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:54.309433 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 46/88] 10.222.0.94 () {60 vars in 1132 bytes} [Thu Sep 1 17:12:54 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:12:54.309433 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee2c1e-3eb3-4577-a3c8-12fd38046693 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:54.335646 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:54.398066 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861ce95-c8a8-4377-b437-f31e4361ecde None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:54.411654 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee2c1e-3eb3-4577-a3c8-12fd38046693 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:54.435813 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787e45f-e054-49a5-9071-6b236c073737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:54.436383 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787e45f-e054-49a5-9071-6b236c073737 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:54.436668 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787e45f-e054-49a5-9071-6b236c073737 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:54.436952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787e45f-e054-49a5-9071-6b236c073737 None admin] PATH_INFO: `/v3/projects/09e5899a135840f3a8cdeb96945d5623` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:54.438070 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787e45f-e054-49a5-9071-6b236c073737 None admin] RBAC: Authorizing `identity:get_project(project_id=09e5899a135840f3a8cdeb96945d5623)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:54.439577 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787e45f-e054-49a5-9071-6b236c073737 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:54.442030 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 43/89] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:12:54 2022] GET /identity/v3/projects/09e5899a135840f3a8cdeb96945d5623 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:54.442160 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787e45f-e054-49a5-9071-6b236c073737 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:54.454426 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad5af2-1e60-4222-b608-58982d86e0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:54.454663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad5af2-1e60-4222-b608-58982d86e0d4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:54.454949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad5af2-1e60-4222-b608-58982d86e0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:54.455225 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad5af2-1e60-4222-b608-58982d86e0d4 None admin] PATH_INFO: `/v3/users/317a95cd3128411790c45fac9bb511fb` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:54.456764 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad5af2-1e60-4222-b608-58982d86e0d4 None admin] RBAC: Authorizing `identity:get_user(user_id=317a95cd3128411790c45fac9bb511fb)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:54.458601 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad5af2-1e60-4222-b608-58982d86e0d4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:54.460216 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 47/90] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:12:54 2022] GET /identity/v3/users/317a95cd3128411790c45fac9bb511fb => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:54.460989 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad5af2-1e60-4222-b608-58982d86e0d4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:54.491760 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:54.572067 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787e45f-e054-49a5-9071-6b236c073737 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:54.587098 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:54.592162 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad5af2-1e60-4222-b608-58982d86e0d4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:54.611072 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be533cf1-6bec-44cc-8a5b-1d0feb7e8a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:54.612269 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be533cf1-6bec-44cc-8a5b-1d0feb7e8a37 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:54.612269 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be533cf1-6bec-44cc-8a5b-1d0feb7e8a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:54.612269 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be533cf1-6bec-44cc-8a5b-1d0feb7e8a37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:54.613133 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be533cf1-6bec-44cc-8a5b-1d0feb7e8a37 None admin] RBAC: Adding query filter params (role.id=a78fbf73b27d4781ac14690bbcb1cd9f, scope.project.id=09e5899a135840f3a8cdeb96945d5623, user.id=317a95cd3128411790c45fac9bb511fb) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:12:54.613782 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be533cf1-6bec-44cc-8a5b-1d0feb7e8a37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:54.615238 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be533cf1-6bec-44cc-8a5b-1d0feb7e8a37 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:54.622136 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 44/91] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:12:54 2022] GET /identity/v3/role_assignments?user.id=317a95cd3128411790c45fac9bb511fb&scope.project.id=09e5899a135840f3a8cdeb96945d5623&role.id=a78fbf73b27d4781ac14690bbcb1cd9f => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:54.622952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be533cf1-6bec-44cc-8a5b-1d0feb7e8a37 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:54.639382 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7779ce-b83c-4787-8f0b-63292b77f4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:54.640642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7779ce-b83c-4787-8f0b-63292b77f4ac None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:54.641127 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7779ce-b83c-4787-8f0b-63292b77f4ac None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:54.641615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7779ce-b83c-4787-8f0b-63292b77f4ac None admin] PATH_INFO: `/v3/projects/09e5899a135840f3a8cdeb96945d5623` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:54.643997 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7779ce-b83c-4787-8f0b-63292b77f4ac None admin] RBAC: Authorizing `identity:get_project(project_id=09e5899a135840f3a8cdeb96945d5623)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:54.646318 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7779ce-b83c-4787-8f0b-63292b77f4ac None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:54.648839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 48/92] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:12:54 2022] GET /identity/v3/projects/09e5899a135840f3a8cdeb96945d5623 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:54.649992 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7779ce-b83c-4787-8f0b-63292b77f4ac None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:54.751616 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be533cf1-6bec-44cc-8a5b-1d0feb7e8a37 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:54.786258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:54.792936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a5717-a550-40cb-8ad9-17c107aa574c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:54.793679 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a5717-a550-40cb-8ad9-17c107aa574c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:54.794063 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a5717-a550-40cb-8ad9-17c107aa574c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:54.794379 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a5717-a550-40cb-8ad9-17c107aa574c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:54.795178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a5717-a550-40cb-8ad9-17c107aa574c None admin] RBAC: Adding query filter params (role.id=70f911a75b7b40a19f65857b9d19cfad, scope.project.id=09e5899a135840f3a8cdeb96945d5623, user.id=50b675acba8e48388c8e8252cc16a021) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:12:54.795553 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a5717-a550-40cb-8ad9-17c107aa574c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:54.796598 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7779ce-b83c-4787-8f0b-63292b77f4ac None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:54.797190 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a5717-a550-40cb-8ad9-17c107aa574c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:54.803615 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 45/93] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:12:54 2022] GET /identity/v3/role_assignments?user.id=50b675acba8e48388c8e8252cc16a021&scope.project.id=09e5899a135840f3a8cdeb96945d5623&role.id=70f911a75b7b40a19f65857b9d19cfad => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:54.804530 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a5717-a550-40cb-8ad9-17c107aa574c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:54.849514 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3c3e9-fcd8-4cd1-8d36-8f703274f62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:54.850531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3c3e9-fcd8-4cd1-8d36-8f703274f62d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:54.851023 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3c3e9-fcd8-4cd1-8d36-8f703274f62d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:54.851482 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3c3e9-fcd8-4cd1-8d36-8f703274f62d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:54.857617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:54.925032 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a5717-a550-40cb-8ad9-17c107aa574c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:54.953036 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3c3e9-fcd8-4cd1-8d36-8f703274f62d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:54.956215 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3c3e9-fcd8-4cd1-8d36-8f703274f62d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:54.968854 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49388b-1c8f-4347-a0a5-1e96e7c99026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:54.969506 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49388b-1c8f-4347-a0a5-1e96e7c99026 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:54.969788 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49388b-1c8f-4347-a0a5-1e96e7c99026 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:54.970061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49388b-1c8f-4347-a0a5-1e96e7c99026 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:54.970804 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49388b-1c8f-4347-a0a5-1e96e7c99026 None admin] RBAC: Adding query filter params (role.id=9131e2ca337e4d1286ef32a4ba63cafa, scope.project.id=09e5899a135840f3a8cdeb96945d5623, user.id=317a95cd3128411790c45fac9bb511fb) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:12:54.971111 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49388b-1c8f-4347-a0a5-1e96e7c99026 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:54.972590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49388b-1c8f-4347-a0a5-1e96e7c99026 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:54.979105 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 46/94] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:12:54 2022] GET /identity/v3/role_assignments?user.id=317a95cd3128411790c45fac9bb511fb&scope.project.id=09e5899a135840f3a8cdeb96945d5623&role.id=9131e2ca337e4d1286ef32a4ba63cafa => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:55.067442 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:55.076502 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 49/95] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:12:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:12:55.085534 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49388b-1c8f-4347-a0a5-1e96e7c99026 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:55.215796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49388b-1c8f-4347-a0a5-1e96e7c99026 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:55.218287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:55.265364 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff144e01-0c70-44c5-b79b-45e91ee3e264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:55.266089 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff144e01-0c70-44c5-b79b-45e91ee3e264 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:55.266374 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff144e01-0c70-44c5-b79b-45e91ee3e264 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:55.266652 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff144e01-0c70-44c5-b79b-45e91ee3e264 None admin] PATH_INFO: `/v3/projects/10dfafcb84084137963c79092309f4c5` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:55.270107 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff144e01-0c70-44c5-b79b-45e91ee3e264 None admin] RBAC: Authorizing `identity:get_project(project_id=10dfafcb84084137963c79092309f4c5)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:55.271574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff144e01-0c70-44c5-b79b-45e91ee3e264 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:55.273583 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 47/96] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:12:55 2022] GET /identity/v3/projects/10dfafcb84084137963c79092309f4c5 => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:55.279532 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3c3e9-fcd8-4cd1-8d36-8f703274f62d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:55.404937 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3c3e9-fcd8-4cd1-8d36-8f703274f62d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:55.454639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbdce9-9bac-4082-803c-7f87ee766b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:55.455260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbdce9-9bac-4082-803c-7f87ee766b6f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:55.455548 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbdce9-9bac-4082-803c-7f87ee766b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:55.455822 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbdce9-9bac-4082-803c-7f87ee766b6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:55.456610 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbdce9-9bac-4082-803c-7f87ee766b6f None admin] RBAC: Adding query filter params (role.id=a78fbf73b27d4781ac14690bbcb1cd9f, scope.project.id=10dfafcb84084137963c79092309f4c5, user.id=317a95cd3128411790c45fac9bb511fb) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:12:55.456919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbdce9-9bac-4082-803c-7f87ee766b6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:55.458438 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbdce9-9bac-4082-803c-7f87ee766b6f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:55.464069 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 50/97] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:12:55 2022] GET /identity/v3/role_assignments?user.id=317a95cd3128411790c45fac9bb511fb&scope.project.id=10dfafcb84084137963c79092309f4c5&role.id=a78fbf73b27d4781ac14690bbcb1cd9f => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:57.153970 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9ddaf-d48a-47f7-a7f4-cb6418e6c202 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:57.154481 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9ddaf-d48a-47f7-a7f4-cb6418e6c202 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:57.154589 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9ddaf-d48a-47f7-a7f4-cb6418e6c202 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:57.155854 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 48/98] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:12:57.161289 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c1178-ec61-4a77-b675-c77e19eb8d60 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:57.161731 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c1178-ec61-4a77-b675-c77e19eb8d60 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:57.161927 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c1178-ec61-4a77-b675-c77e19eb8d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:57.185447 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c50c1178-ec61-4a77-b675-c77e19eb8d60 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:12:57.187078 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c50c1178-ec61-4a77-b675-c77e19eb8d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:12:57.267091 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:57.287276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 51/99] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:12:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:12:57.723089 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffe6d2-f4e5-4274-bbc3-3c2e466390ce None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:57.723365 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffe6d2-f4e5-4274-bbc3-3c2e466390ce None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:57.723868 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffe6d2-f4e5-4274-bbc3-3c2e466390ce None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:57.725669 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 49/100] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:12:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:12:57.731215 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba5419-8564-47f4-aefc-022ebe58a931 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:57.731726 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba5419-8564-47f4-aefc-022ebe58a931 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:57.732228 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba5419-8564-47f4-aefc-022ebe58a931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:57.759341 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a1ba5419-8564-47f4-aefc-022ebe58a931 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:12:57.760847 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a1ba5419-8564-47f4-aefc-022ebe58a931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:12:57.835226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 52/101] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:12:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:12:57.843656 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffe6d2-f4e5-4274-bbc3-3c2e466390ce None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:57.877671 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfc07c-c2ea-40aa-90ef-ab3ec0cbd54b None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:57.878278 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfc07c-c2ea-40aa-90ef-ab3ec0cbd54b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:57.878747 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfc07c-c2ea-40aa-90ef-ab3ec0cbd54b None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:57.880606 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 53/102] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:12:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:12:57.886395 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5bb20-c809-4c8a-839a-f9603d9233a7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:57.887161 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5bb20-c809-4c8a-839a-f9603d9233a7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:57.887677 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5bb20-c809-4c8a-839a-f9603d9233a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:57.907370 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5fa5bb20-c809-4c8a-839a-f9603d9233a7 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:12:57.908834 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5fa5bb20-c809-4c8a-839a-f9603d9233a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:12:57.979066 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 54/103] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:12:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:12:57.985614 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb233c75-c87c-499d-bf94-13c729ce593e None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:57.985614 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb233c75-c87c-499d-bf94-13c729ce593e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:57.985614 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb233c75-c87c-499d-bf94-13c729ce593e None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:57.985614 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 55/104] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:12:57.985614 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c56f1c-524d-479b-827b-850372ab3616 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:57.985614 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c56f1c-524d-479b-827b-850372ab3616 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:57.986047 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c56f1c-524d-479b-827b-850372ab3616 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:57.986047 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 56/105] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:12:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:12:57.986047 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a83ee-fdc1-4302-aef9-c29c3cad2125 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:57.986047 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a83ee-fdc1-4302-aef9-c29c3cad2125 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:57.986320 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a83ee-fdc1-4302-aef9-c29c3cad2125 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:57.987697 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 57/106] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:12:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:12:57.990094 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffe6d2-f4e5-4274-bbc3-3c2e466390ce None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:57.992656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2fab7-ca40-4779-87ea-0de11d9ec3b1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:57.992935 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2fab7-ca40-4779-87ea-0de11d9ec3b1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:57.993205 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2fab7-ca40-4779-87ea-0de11d9ec3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:58.011827 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-19e2fab7-ca40-4779-87ea-0de11d9ec3b1 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:12:58.013013 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-19e2fab7-ca40-4779-87ea-0de11d9ec3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:12:58.031398 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1399671-95d0-4838-a765-6ba435bbcb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:58.032310 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1399671-95d0-4838-a765-6ba435bbcb1e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:58.032791 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1399671-95d0-4838-a765-6ba435bbcb1e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:58.033337 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1399671-95d0-4838-a765-6ba435bbcb1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:58.034669 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1399671-95d0-4838-a765-6ba435bbcb1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:58.036513 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1399671-95d0-4838-a765-6ba435bbcb1e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:58.038558 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 50/107] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:12:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:58.044964 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99349825-c8bd-4eec-affb-717f9bf49ab5 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:58.045474 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99349825-c8bd-4eec-affb-717f9bf49ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:58.045923 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99349825-c8bd-4eec-affb-717f9bf49ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:58.057704 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:58.072150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-99349825-c8bd-4eec-affb-717f9bf49ab5 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:12:58.073673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-99349825-c8bd-4eec-affb-717f9bf49ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:12:58.097877 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 58/108] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:12:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:12:58.099430 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1140c5c-3147-4104-9b2e-5f5a24c23054 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:58.099868 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1140c5c-3147-4104-9b2e-5f5a24c23054 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:58.100278 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1140c5c-3147-4104-9b2e-5f5a24c23054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:58.115146 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:58.138719 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a1140c5c-3147-4104-9b2e-5f5a24c23054 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:12:58.140183 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a1140c5c-3147-4104-9b2e-5f5a24c23054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:12:58.154972 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 51/109] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:12:58.156428 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99349825-c8bd-4eec-affb-717f9bf49ab5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:58.259299 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 59/110] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:12:58.260196 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1140c5c-3147-4104-9b2e-5f5a24c23054 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:58.267450 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99349825-c8bd-4eec-affb-717f9bf49ab5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:58.322020 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f170a9-a1ad-4f7d-a606-e771bb997c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:58.322634 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f170a9-a1ad-4f7d-a606-e771bb997c0b None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:58.322911 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f170a9-a1ad-4f7d-a606-e771bb997c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:58.323182 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f170a9-a1ad-4f7d-a606-e771bb997c0b None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:58.323831 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f170a9-a1ad-4f7d-a606-e771bb997c0b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:58.325857 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f170a9-a1ad-4f7d-a606-e771bb997c0b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:58.372951 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 52/111] 10.222.0.94 () {60 vars in 1141 bytes} [Thu Sep 1 17:12:58 2022] POST /identity/v3/projects => generated 302 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:12:58.373550 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f170a9-a1ad-4f7d-a606-e771bb997c0b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:58.406357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:58.451045 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1140c5c-3147-4104-9b2e-5f5a24c23054 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:58.468580 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:58.522831 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f170a9-a1ad-4f7d-a606-e771bb997c0b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:58.534480 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ebcbe-2be2-4011-b264-f4394c729c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:58.535144 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ebcbe-2be2-4011-b264-f4394c729c86 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:58.535421 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ebcbe-2be2-4011-b264-f4394c729c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:58.535693 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ebcbe-2be2-4011-b264-f4394c729c86 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:58.550778 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ebcbe-2be2-4011-b264-f4394c729c86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:12:58.555999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-c10ebcbe-2be2-4011-b264-f4394c729c86 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:12:58.555999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:12:58.555999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:12:58.555999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:12:58.555999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:12:58.555999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:12:58.555999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:12:58.555999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:12:58.555999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:12:58.555999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:12:58.555999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:12:58.555999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:12:58.555999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:12:58.555999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:12:58.555999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:12:58.555999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:12:58.556840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:12:58.556840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:12:58.556840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:12:58.556840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:12:58.556840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:12:58.556840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:12:58.556840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:12:58.556840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:12:58.556840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:12:58.556840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:12:58.556840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:12:58.556840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:12:58.556840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:12:58.556840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:12:58.556840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:12:58.556840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:12:58.557622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:12:58.557622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:12:58.557622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:12:58.557622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:12:58.557622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:12:58.557622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:12:58.557622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:12:58.557622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:12:58.557622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:12:58.557622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:12:58.557622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:12:58.557622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:12:58.559894 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 60/112] 10.222.0.94 () {56 vars in 1114 bytes} [Thu Sep 1 17:12:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:12:58.561015 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ebcbe-2be2-4011-b264-f4394c729c86 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:58.581279 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1aa4b-7abb-4039-951e-f2ce3f5578e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:58.582187 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1aa4b-7abb-4039-951e-f2ce3f5578e8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:58.582605 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1aa4b-7abb-4039-951e-f2ce3f5578e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:58.583073 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1aa4b-7abb-4039-951e-f2ce3f5578e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:58.596657 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1aa4b-7abb-4039-951e-f2ce3f5578e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:12:58.603617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-04e1aa4b-7abb-4039-951e-f2ce3f5578e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:12:58.603617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:12:58.603617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:12:58.603617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:12:58.603617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:12:58.603617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:12:58.603617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:12:58.603617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:12:58.603617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:12:58.603617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:12:58.603617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:12:58.603617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:12:58.603617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:12:58.603617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:12:58.603617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:12:58.603617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:12:58.604532 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:12:58.604532 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:12:58.604532 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:12:58.604532 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:12:58.604532 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:12:58.604532 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:12:58.604532 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:12:58.604532 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:12:58.604532 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:12:58.604532 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:12:58.604532 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:12:58.604532 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:12:58.604532 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:12:58.604532 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:12:58.604532 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:12:58.604532 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:12:58.605846 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:12:58.605846 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:12:58.605846 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:12:58.605846 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:12:58.605846 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:12:58.605846 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:12:58.605846 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:12:58.605846 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:12:58.605846 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:12:58.605846 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:12:58.605846 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:12:58.605846 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:12:58.605846 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 53/113] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:12:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:12:58.605846 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1aa4b-7abb-4039-951e-f2ce3f5578e8 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:58.680221 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ebcbe-2be2-4011-b264-f4394c729c86 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:58.709200 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:58.719604 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36341017-db20-4c35-8e1d-93dee1245843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:58.720401 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36341017-db20-4c35-8e1d-93dee1245843 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:58.720677 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36341017-db20-4c35-8e1d-93dee1245843 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:58.721274 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36341017-db20-4c35-8e1d-93dee1245843 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:58.729828 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1aa4b-7abb-4039-951e-f2ce3f5578e8 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:58.732469 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36341017-db20-4c35-8e1d-93dee1245843 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:12:58.737913 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-36341017-db20-4c35-8e1d-93dee1245843 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:12:58.737913 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:12:58.737913 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:12:58.737913 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:12:58.737913 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:12:58.737913 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:12:58.737913 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:12:58.737913 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:12:58.737913 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:12:58.737913 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:12:58.737913 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:12:58.737913 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:12:58.737913 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:12:58.737913 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:12:58.737913 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:12:58.737913 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:12:58.739031 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:12:58.739031 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:12:58.739031 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:12:58.739031 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:12:58.739031 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:12:58.739031 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:12:58.739031 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:12:58.739031 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:12:58.739031 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:12:58.739031 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:12:58.739031 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:12:58.739031 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:12:58.739031 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:12:58.739031 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:12:58.739031 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:12:58.739031 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:12:58.739986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:12:58.739986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:12:58.739986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:12:58.739986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:12:58.739986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:12:58.739986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:12:58.739986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:12:58.739986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:12:58.739986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:12:58.739986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:12:58.739986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:12:58.739986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:12:58.739986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 61/114] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:12:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:12:58.739986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36341017-db20-4c35-8e1d-93dee1245843 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:58.770468 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3b630-e259-4479-96bf-a19aed3d4e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:58.770949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:58.772109 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3b630-e259-4479-96bf-a19aed3d4e70 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:58.772593 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3b630-e259-4479-96bf-a19aed3d4e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:58.773041 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3b630-e259-4479-96bf-a19aed3d4e70 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:58.785378 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3b630-e259-4479-96bf-a19aed3d4e70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:12:58.790382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-97c3b630-e259-4479-96bf-a19aed3d4e70 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:12:58.790382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:12:58.790382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:12:58.790382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:12:58.790382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:12:58.790382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:12:58.790382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:12:58.790382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:12:58.790382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:12:58.790382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:12:58.790382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:12:58.790382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:12:58.790382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:12:58.790382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:12:58.790382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:12:58.790382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:12:58.791233 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:12:58.791233 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:12:58.791233 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:12:58.791233 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:12:58.791233 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:12:58.791233 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:12:58.791233 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:12:58.791233 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:12:58.791233 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:12:58.791233 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:12:58.791233 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:12:58.791233 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:12:58.791233 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:12:58.791233 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:12:58.791233 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:12:58.791233 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:12:58.791982 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:12:58.791982 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:12:58.791982 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:12:58.791982 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:12:58.791982 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:12:58.791982 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:12:58.791982 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:12:58.791982 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:12:58.791982 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:12:58.791982 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:12:58.791982 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:12:58.791982 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:12:58.791982 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 54/115] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:12:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:12:58.792712 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3b630-e259-4479-96bf-a19aed3d4e70 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:58.852096 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36341017-db20-4c35-8e1d-93dee1245843 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:58.894516 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698ae21-8125-4d95-bcee-9256f8bb1011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:58.895128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698ae21-8125-4d95-bcee-9256f8bb1011 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:58.895411 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698ae21-8125-4d95-bcee-9256f8bb1011 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:58.895682 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698ae21-8125-4d95-bcee-9256f8bb1011 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:58.896351 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698ae21-8125-4d95-bcee-9256f8bb1011 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:12:58.896655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698ae21-8125-4d95-bcee-9256f8bb1011 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:58.898090 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698ae21-8125-4d95-bcee-9256f8bb1011 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:58.898644 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3b630-e259-4479-96bf-a19aed3d4e70 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:58.910787 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 62/116] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:12:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:58.910787 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698ae21-8125-4d95-bcee-9256f8bb1011 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:58.939974 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6199724-7214-48cc-918b-dc0164433ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:58.940491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6199724-7214-48cc-918b-dc0164433ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:58.940771 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6199724-7214-48cc-918b-dc0164433ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:58.941040 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6199724-7214-48cc-918b-dc0164433ab3 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:58.941734 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6199724-7214-48cc-918b-dc0164433ab3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:12:58.942035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6199724-7214-48cc-918b-dc0164433ab3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:58.943443 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6199724-7214-48cc-918b-dc0164433ab3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:58.959200 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 55/117] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:12:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:58.959200 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6199724-7214-48cc-918b-dc0164433ab3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:58.962642 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:59.017554 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:59.028926 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698ae21-8125-4d95-bcee-9256f8bb1011 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:59.064138 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2efd04-1790-4dfb-ad0f-466e8d45a184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:59.065031 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2efd04-1790-4dfb-ad0f-466e8d45a184 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:59.065469 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2efd04-1790-4dfb-ad0f-466e8d45a184 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:59.065895 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2efd04-1790-4dfb-ad0f-466e8d45a184 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:59.073319 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6199724-7214-48cc-918b-dc0164433ab3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:59.077254 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2efd04-1790-4dfb-ad0f-466e8d45a184 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:12:59.084957 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-3d2efd04-1790-4dfb-ad0f-466e8d45a184 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:12:59.084957 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:12:59.084957 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:12:59.084957 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:12:59.084957 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:12:59.084957 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:12:59.084957 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:12:59.084957 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:12:59.084957 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:12:59.084957 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:12:59.084957 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:12:59.084957 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:12:59.084957 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:12:59.084957 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:12:59.084957 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:12:59.084957 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:12:59.086030 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:12:59.086030 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:12:59.086030 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:12:59.086030 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:12:59.086030 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:12:59.086030 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:12:59.086030 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:12:59.086030 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:12:59.086030 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:12:59.086030 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:12:59.086030 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:12:59.086030 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:12:59.086030 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:12:59.086030 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:12:59.086030 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:12:59.086030 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:12:59.086975 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:12:59.086975 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:12:59.086975 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:12:59.086975 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:12:59.086975 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:12:59.086975 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:12:59.086975 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:12:59.086975 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:12:59.086975 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:12:59.086975 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:12:59.086975 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:12:59.086975 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:12:59.086975 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 63/118] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:12:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:12:59.086975 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2efd04-1790-4dfb-ad0f-466e8d45a184 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:59.113189 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b536540-192e-4dc1-b1ec-39101c94d68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:59.113837 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b536540-192e-4dc1-b1ec-39101c94d68f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:59.114116 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b536540-192e-4dc1-b1ec-39101c94d68f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:59.114387 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b536540-192e-4dc1-b1ec-39101c94d68f None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:59.115048 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b536540-192e-4dc1-b1ec-39101c94d68f None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:12:59.115351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b536540-192e-4dc1-b1ec-39101c94d68f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:59.116725 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b536540-192e-4dc1-b1ec-39101c94d68f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:59.129813 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 56/119] 10.222.0.94 () {56 vars in 1101 bytes} [Thu Sep 1 17:12:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:59.129813 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b536540-192e-4dc1-b1ec-39101c94d68f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:59.197813 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:59.203938 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2efd04-1790-4dfb-ad0f-466e8d45a184 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:59.237461 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b536540-192e-4dc1-b1ec-39101c94d68f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:59.239682 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a26636-cb15-4683-925b-167d05e96d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:59.240289 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a26636-cb15-4683-925b-167d05e96d95 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:59.240567 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a26636-cb15-4683-925b-167d05e96d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:59.240888 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a26636-cb15-4683-925b-167d05e96d95 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:59.241590 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a26636-cb15-4683-925b-167d05e96d95 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:12:59.241895 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a26636-cb15-4683-925b-167d05e96d95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:59.243289 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a26636-cb15-4683-925b-167d05e96d95 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:59.252241 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 64/120] 10.222.0.94 () {56 vars in 1101 bytes} [Thu Sep 1 17:12:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:59.252861 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a26636-cb15-4683-925b-167d05e96d95 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:59.270158 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:59.280204 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd2fbc-4539-4ee2-833e-c94fd857a412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:59.280996 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd2fbc-4539-4ee2-833e-c94fd857a412 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:59.281350 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd2fbc-4539-4ee2-833e-c94fd857a412 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:59.281720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd2fbc-4539-4ee2-833e-c94fd857a412 None admin] PATH_INFO: `/v3/users/317a95cd3128411790c45fac9bb511fb` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:59.282925 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd2fbc-4539-4ee2-833e-c94fd857a412 None admin] RBAC: Authorizing `identity:get_user(user_id=317a95cd3128411790c45fac9bb511fb)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:59.284365 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd2fbc-4539-4ee2-833e-c94fd857a412 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:59.290321 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 57/121] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:12:59 2022] GET /identity/v3/users/317a95cd3128411790c45fac9bb511fb => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:59.290321 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd2fbc-4539-4ee2-833e-c94fd857a412 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:59.367280 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a26636-cb15-4683-925b-167d05e96d95 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:59.393383 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd2fbc-4539-4ee2-833e-c94fd857a412 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:59.402177 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf742d-8826-4cc3-be31-89f1a455cc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:59.403340 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf742d-8826-4cc3-be31-89f1a455cc53 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:59.403624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf742d-8826-4cc3-be31-89f1a455cc53 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:59.403901 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf742d-8826-4cc3-be31-89f1a455cc53 None admin] PATH_INFO: `/v3/users/50b675acba8e48388c8e8252cc16a021` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:59.405038 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf742d-8826-4cc3-be31-89f1a455cc53 None admin] RBAC: Authorizing `identity:get_user(user_id=50b675acba8e48388c8e8252cc16a021)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:59.406515 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf742d-8826-4cc3-be31-89f1a455cc53 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:59.408246 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 65/122] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:12:59 2022] GET /identity/v3/users/50b675acba8e48388c8e8252cc16a021 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:59.410194 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf742d-8826-4cc3-be31-89f1a455cc53 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:59.431861 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e2b90-b4cc-4ad2-9bbc-865420ce7ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:59.432476 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e2b90-b4cc-4ad2-9bbc-865420ce7ebd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:59.432758 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e2b90-b4cc-4ad2-9bbc-865420ce7ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:59.433085 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e2b90-b4cc-4ad2-9bbc-865420ce7ebd None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:59.434329 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e2b90-b4cc-4ad2-9bbc-865420ce7ebd None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:12:59.434635 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e2b90-b4cc-4ad2-9bbc-865420ce7ebd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:59.435995 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e2b90-b4cc-4ad2-9bbc-865420ce7ebd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:59.437504 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:59.447377 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 58/123] 10.222.0.94 () {56 vars in 1101 bytes} [Thu Sep 1 17:12:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:59.450604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e2b90-b4cc-4ad2-9bbc-865420ce7ebd None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:59.496767 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:59.516859 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf742d-8826-4cc3-be31-89f1a455cc53 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:59.560713 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef44690-1edf-49d1-ade9-27bc072fc6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:59.561331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e2b90-b4cc-4ad2-9bbc-865420ce7ebd None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:59.561469 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef44690-1edf-49d1-ade9-27bc072fc6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:59.561656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef44690-1edf-49d1-ade9-27bc072fc6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:59.561931 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef44690-1edf-49d1-ade9-27bc072fc6f1 None admin] PATH_INFO: `/v3/users/317a95cd3128411790c45fac9bb511fb` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:59.563086 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef44690-1edf-49d1-ade9-27bc072fc6f1 None admin] RBAC: Authorizing `identity:get_user(user_id=317a95cd3128411790c45fac9bb511fb)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:59.564587 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef44690-1edf-49d1-ade9-27bc072fc6f1 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:59.566300 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 66/124] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:12:59 2022] GET /identity/v3/users/317a95cd3128411790c45fac9bb511fb => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:59.567126 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef44690-1edf-49d1-ade9-27bc072fc6f1 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:59.599998 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15aa65-1574-4b13-8ffb-2fae786d9dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:59.600620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15aa65-1574-4b13-8ffb-2fae786d9dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:59.600902 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15aa65-1574-4b13-8ffb-2fae786d9dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:59.601175 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15aa65-1574-4b13-8ffb-2fae786d9dd8 None admin] PATH_INFO: `/v3/users/e37a83ce1a6e43be8bf899c347b8a30d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:59.620322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe15aa65-1574-4b13-8ffb-2fae786d9dd8 None admin] RBAC: Authorizing `identity:get_user(user_id=e37a83ce1a6e43be8bf899c347b8a30d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:59.622199 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe15aa65-1574-4b13-8ffb-2fae786d9dd8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:59.623842 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 59/125] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:12:59 2022] GET /identity/v3/users/e37a83ce1a6e43be8bf899c347b8a30d => generated 289 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:59.624606 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15aa65-1574-4b13-8ffb-2fae786d9dd8 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:59.680646 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef44690-1edf-49d1-ade9-27bc072fc6f1 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:59.681766 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:59.717113 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756bb23-d6b9-45f8-9496-68e4cdf22263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:59.717773 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756bb23-d6b9-45f8-9496-68e4cdf22263 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:59.717982 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756bb23-d6b9-45f8-9496-68e4cdf22263 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:59.718258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756bb23-d6b9-45f8-9496-68e4cdf22263 None admin] PATH_INFO: `/v3/projects/09e5899a135840f3a8cdeb96945d5623` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:59.719379 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756bb23-d6b9-45f8-9496-68e4cdf22263 None admin] RBAC: Authorizing `identity:get_project(project_id=09e5899a135840f3a8cdeb96945d5623)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:59.720862 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756bb23-d6b9-45f8-9496-68e4cdf22263 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:59.722712 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 67/126] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:12:59 2022] GET /identity/v3/projects/09e5899a135840f3a8cdeb96945d5623 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:59.727759 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15aa65-1574-4b13-8ffb-2fae786d9dd8 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:59.727893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756bb23-d6b9-45f8-9496-68e4cdf22263 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:59.749444 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:59.765608 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc89e0-2a26-4b2a-88d9-2f6fd486bea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:59.766245 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc89e0-2a26-4b2a-88d9-2f6fd486bea5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:59.766527 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc89e0-2a26-4b2a-88d9-2f6fd486bea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:59.766802 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc89e0-2a26-4b2a-88d9-2f6fd486bea5 None admin] PATH_INFO: `/v3/projects/09e5899a135840f3a8cdeb96945d5623` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:59.768595 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc89e0-2a26-4b2a-88d9-2f6fd486bea5 None admin] RBAC: Authorizing `identity:get_project(project_id=09e5899a135840f3a8cdeb96945d5623)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:59.769423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc89e0-2a26-4b2a-88d9-2f6fd486bea5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:59.775842 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 60/127] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:12:59 2022] GET /identity/v3/projects/09e5899a135840f3a8cdeb96945d5623 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:59.775842 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc89e0-2a26-4b2a-88d9-2f6fd486bea5 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:59.839364 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756bb23-d6b9-45f8-9496-68e4cdf22263 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:59.877132 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ef657-a1f4-471d-abdc-1985d5000713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:59.877881 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ef657-a1f4-471d-abdc-1985d5000713 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:59.878245 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ef657-a1f4-471d-abdc-1985d5000713 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:59.878530 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ef657-a1f4-471d-abdc-1985d5000713 None admin] PATH_INFO: `/v3/users/317a95cd3128411790c45fac9bb511fb` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:59.879654 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463ef657-a1f4-471d-abdc-1985d5000713 None admin] RBAC: Authorizing `identity:get_user(user_id=317a95cd3128411790c45fac9bb511fb)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:59.881104 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463ef657-a1f4-471d-abdc-1985d5000713 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:59.882874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 68/128] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:12:59 2022] GET /identity/v3/users/317a95cd3128411790c45fac9bb511fb => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:59.882977 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc89e0-2a26-4b2a-88d9-2f6fd486bea5 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:12:59.886236 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ef657-a1f4-471d-abdc-1985d5000713 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:59.906262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:12:59.920323 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f7056-29c4-4a60-9012-abf79f5fa7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:12:59.921058 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f7056-29c4-4a60-9012-abf79f5fa7eb None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:12:59.921340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f7056-29c4-4a60-9012-abf79f5fa7eb None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:12:59.921650 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f7056-29c4-4a60-9012-abf79f5fa7eb None admin] PATH_INFO: `/v3/projects/09e5899a135840f3a8cdeb96945d5623` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:12:59.922776 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f7056-29c4-4a60-9012-abf79f5fa7eb None admin] RBAC: Authorizing `identity:get_project(project_id=09e5899a135840f3a8cdeb96945d5623)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:12:59.924239 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f7056-29c4-4a60-9012-abf79f5fa7eb None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:12:59.926074 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 61/129] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:12:59 2022] GET /identity/v3/projects/09e5899a135840f3a8cdeb96945d5623 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:12:59.926661 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f7056-29c4-4a60-9012-abf79f5fa7eb None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:12:59.982959 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:00.000502 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ef657-a1f4-471d-abdc-1985d5000713 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:00.036176 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409d0be-27b5-414a-a933-a9db0b4e30b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:00.036980 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409d0be-27b5-414a-a933-a9db0b4e30b7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:00.037268 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409d0be-27b5-414a-a933-a9db0b4e30b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:00.037875 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409d0be-27b5-414a-a933-a9db0b4e30b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:00.040297 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f7056-29c4-4a60-9012-abf79f5fa7eb None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:00.075195 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72401dd-e8d4-4877-a46b-06aee1b82dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:00.075867 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72401dd-e8d4-4877-a46b-06aee1b82dde None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:00.076153 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72401dd-e8d4-4877-a46b-06aee1b82dde None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:00.076431 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72401dd-e8d4-4877-a46b-06aee1b82dde None admin] PATH_INFO: `/v3/projects/09e5899a135840f3a8cdeb96945d5623/users/317a95cd3128411790c45fac9bb511fb/roles/9131e2ca337e4d1286ef32a4ba63cafa` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:00.078668 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72401dd-e8d4-4877-a46b-06aee1b82dde None admin] RBAC: Authorizing `identity:create_grant(project_id=09e5899a135840f3a8cdeb96945d5623, user_id=317a95cd3128411790c45fac9bb511fb, role_id=9131e2ca337e4d1286ef32a4ba63cafa)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:00.080129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72401dd-e8d4-4877-a46b-06aee1b82dde None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:00.094534 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 62/130] 10.222.0.94 () {58 vars in 1439 bytes} [Thu Sep 1 17:12:59 2022] PUT /identity/v3/projects/09e5899a135840f3a8cdeb96945d5623/users/317a95cd3128411790c45fac9bb511fb/roles/9131e2ca337e4d1286ef32a4ba63cafa => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:13:00.095129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72401dd-e8d4-4877-a46b-06aee1b82dde None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:00.120533 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409d0be-27b5-414a-a933-a9db0b4e30b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:00.123145 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409d0be-27b5-414a-a933-a9db0b4e30b7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:00.164751 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:00.230116 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72401dd-e8d4-4877-a46b-06aee1b82dde None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:00.246619 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:00.269117 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 69/131] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:12:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:13:00.270106 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409d0be-27b5-414a-a933-a9db0b4e30b7 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:00.271513 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac220f7-70f0-4c33-b78f-743f254fdc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:00.272259 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac220f7-70f0-4c33-b78f-743f254fdc49 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:00.272620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac220f7-70f0-4c33-b78f-743f254fdc49 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:00.272973 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac220f7-70f0-4c33-b78f-743f254fdc49 None admin] PATH_INFO: `/v3/projects/09e5899a135840f3a8cdeb96945d5623/users/50b675acba8e48388c8e8252cc16a021/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:00.275761 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac220f7-70f0-4c33-b78f-743f254fdc49 None admin] RBAC: Authorizing `identity:create_grant(project_id=09e5899a135840f3a8cdeb96945d5623, user_id=50b675acba8e48388c8e8252cc16a021, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:00.277953 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac220f7-70f0-4c33-b78f-743f254fdc49 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:00.295287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 63/132] 10.222.0.94 () {58 vars in 1439 bytes} [Thu Sep 1 17:13:00 2022] PUT /identity/v3/projects/09e5899a135840f3a8cdeb96945d5623/users/50b675acba8e48388c8e8252cc16a021/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:13:00.296141 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac220f7-70f0-4c33-b78f-743f254fdc49 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:00.424222 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac220f7-70f0-4c33-b78f-743f254fdc49 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:00.425378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409d0be-27b5-414a-a933-a9db0b4e30b7 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:00.436771 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:00.466566 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e1ac3-e254-4c76-89d5-7405c39b663d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:00.467597 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e1ac3-e254-4c76-89d5-7405c39b663d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:00.468077 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e1ac3-e254-4c76-89d5-7405c39b663d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:00.468542 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e1ac3-e254-4c76-89d5-7405c39b663d None admin] PATH_INFO: `/v3/projects/10dfafcb84084137963c79092309f4c5` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:00.470048 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293e1ac3-e254-4c76-89d5-7405c39b663d None admin] RBAC: Authorizing `identity:get_project(project_id=10dfafcb84084137963c79092309f4c5)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:00.471910 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293e1ac3-e254-4c76-89d5-7405c39b663d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:00.472300 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893dd291-3ceb-4003-8f2b-f87d7e9b1228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:00.473070 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dd291-3ceb-4003-8f2b-f87d7e9b1228 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:00.473445 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dd291-3ceb-4003-8f2b-f87d7e9b1228 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:00.473808 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dd291-3ceb-4003-8f2b-f87d7e9b1228 None admin] PATH_INFO: `/v3/projects/09e5899a135840f3a8cdeb96945d5623/users/317a95cd3128411790c45fac9bb511fb/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:00.474646 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 70/133] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:00 2022] GET /identity/v3/projects/10dfafcb84084137963c79092309f4c5 => generated 312 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:00.480265 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e1ac3-e254-4c76-89d5-7405c39b663d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:00.480427 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893dd291-3ceb-4003-8f2b-f87d7e9b1228 None admin] RBAC: Authorizing `identity:create_grant(project_id=09e5899a135840f3a8cdeb96945d5623, user_id=317a95cd3128411790c45fac9bb511fb, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:00.480427 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893dd291-3ceb-4003-8f2b-f87d7e9b1228 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:00.501131 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 64/134] 10.222.0.94 () {58 vars in 1439 bytes} [Thu Sep 1 17:13:00 2022] PUT /identity/v3/projects/09e5899a135840f3a8cdeb96945d5623/users/317a95cd3128411790c45fac9bb511fb/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:13:00.502715 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76965e71-05f8-4fdd-91ce-2fe043f9c3e1 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:00.504388 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76965e71-05f8-4fdd-91ce-2fe043f9c3e1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:00.504813 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76965e71-05f8-4fdd-91ce-2fe043f9c3e1 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:00.506314 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 65/135] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:00.507152 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76965e71-05f8-4fdd-91ce-2fe043f9c3e1 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:00.569427 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:00.625368 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76965e71-05f8-4fdd-91ce-2fe043f9c3e1 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:00.630105 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e1ac3-e254-4c76-89d5-7405c39b663d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:00.663988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc36ad-fa7c-4379-acef-cd210dd65bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:00.664834 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc36ad-fa7c-4379-acef-cd210dd65bff None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:00.665246 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc36ad-fa7c-4379-acef-cd210dd65bff None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:00.669430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc36ad-fa7c-4379-acef-cd210dd65bff None admin] PATH_INFO: `/v3/projects/10dfafcb84084137963c79092309f4c5/users/317a95cd3128411790c45fac9bb511fb/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:00.669430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc36ad-fa7c-4379-acef-cd210dd65bff None admin] RBAC: Authorizing `identity:create_grant(project_id=10dfafcb84084137963c79092309f4c5, user_id=317a95cd3128411790c45fac9bb511fb, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:00.670022 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc36ad-fa7c-4379-acef-cd210dd65bff None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:00.687549 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 66/136] 10.222.0.94 () {58 vars in 1439 bytes} [Thu Sep 1 17:13:00 2022] PUT /identity/v3/projects/10dfafcb84084137963c79092309f4c5/users/317a95cd3128411790c45fac9bb511fb/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:13:00.689701 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53e093-105a-44c1-a1a3-d33cce868071 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:00.690300 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53e093-105a-44c1-a1a3-d33cce868071 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:00.690646 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53e093-105a-44c1-a1a3-d33cce868071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:00.698391 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bccd804-3017-439c-aeda-e27977767583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:00.700011 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccd804-3017-439c-aeda-e27977767583 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:00.700299 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccd804-3017-439c-aeda-e27977767583 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:00.700571 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccd804-3017-439c-aeda-e27977767583 None admin] PATH_INFO: `/v3/projects/09e5899a135840f3a8cdeb96945d5623` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:00.704131 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bccd804-3017-439c-aeda-e27977767583 None admin] RBAC: Authorizing `identity:get_project(project_id=09e5899a135840f3a8cdeb96945d5623)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:00.705777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bccd804-3017-439c-aeda-e27977767583 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:00.707677 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 71/137] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:00 2022] GET /identity/v3/projects/09e5899a135840f3a8cdeb96945d5623 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:00.713734 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bccd804-3017-439c-aeda-e27977767583 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:00.714057 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6b53e093-105a-44c1-a1a3-d33cce868071 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:00.715468 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6b53e093-105a-44c1-a1a3-d33cce868071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:00.758670 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:00.843909 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bccd804-3017-439c-aeda-e27977767583 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:00.854913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 67/138] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:00.866461 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:00.882591 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a3286-98a8-4a7f-b7d7-e9ac182c0b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:00.883260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a3286-98a8-4a7f-b7d7-e9ac182c0b4b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:00.883543 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a3286-98a8-4a7f-b7d7-e9ac182c0b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:00.883819 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a3286-98a8-4a7f-b7d7-e9ac182c0b4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:00.884544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a3286-98a8-4a7f-b7d7-e9ac182c0b4b None admin] RBAC: Adding query filter params (role.id=1052488681f94c6f8039fa871f46daa9, scope.project.id=09e5899a135840f3a8cdeb96945d5623, user.id=e37a83ce1a6e43be8bf899c347b8a30d) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:00.884848 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a3286-98a8-4a7f-b7d7-e9ac182c0b4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:00.886489 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a3286-98a8-4a7f-b7d7-e9ac182c0b4b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:00.892859 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 72/139] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:13:00 2022] GET /identity/v3/role_assignments?user.id=e37a83ce1a6e43be8bf899c347b8a30d&scope.project.id=09e5899a135840f3a8cdeb96945d5623&role.id=1052488681f94c6f8039fa871f46daa9 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:13:01.329449 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53e093-105a-44c1-a1a3-d33cce868071 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:01.460653 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53e093-105a-44c1-a1a3-d33cce868071 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:01.508109 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed40f3-d0d1-425d-a019-9353d287a1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:01.508765 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed40f3-d0d1-425d-a019-9353d287a1d6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:01.509049 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed40f3-d0d1-425d-a019-9353d287a1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:01.509325 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed40f3-d0d1-425d-a019-9353d287a1d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:01.510475 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed40f3-d0d1-425d-a019-9353d287a1d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:01.512521 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed40f3-d0d1-425d-a019-9353d287a1d6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:01.514150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 68/140] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:13:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:01.522494 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a3286-98a8-4a7f-b7d7-e9ac182c0b4b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:01.677786 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a3286-98a8-4a7f-b7d7-e9ac182c0b4b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:01.726369 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2989c0-2c40-4217-a23f-0a663126b359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:01.726987 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2989c0-2c40-4217-a23f-0a663126b359 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:01.727270 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2989c0-2c40-4217-a23f-0a663126b359 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:01.727554 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2989c0-2c40-4217-a23f-0a663126b359 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:01.728211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2989c0-2c40-4217-a23f-0a663126b359 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:01.729707 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2989c0-2c40-4217-a23f-0a663126b359 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:01.758383 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 73/141] 10.222.0.94 () {60 vars in 1132 bytes} [Thu Sep 1 17:13:01 2022] POST /identity/v3/users => generated 283 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:13:02.789666 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d84a8b-ec0d-4dd8-a803-bd69a1490da0 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:02.790156 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d84a8b-ec0d-4dd8-a803-bd69a1490da0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:02.790230 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d84a8b-ec0d-4dd8-a803-bd69a1490da0 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:02.791574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 69/142] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:02.797498 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48331bfd-17a0-4ae4-b246-1ec54a54ced9 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:02.797901 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48331bfd-17a0-4ae4-b246-1ec54a54ced9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:02.798069 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48331bfd-17a0-4ae4-b246-1ec54a54ced9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:02.823049 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-48331bfd-17a0-4ae4-b246-1ec54a54ced9 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:02.824260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-48331bfd-17a0-4ae4-b246-1ec54a54ced9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:02.870874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:02.919093 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 74/143] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:03.487449 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d84a8b-ec0d-4dd8-a803-bd69a1490da0 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:03.514629 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cf217-c248-484f-9d49-e9fb374f0410 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:03.514936 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cf217-c248-484f-9d49-e9fb374f0410 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:03.515172 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cf217-c248-484f-9d49-e9fb374f0410 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:03.516520 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 75/144] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:13:03.521802 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99589b-34bf-4fa0-9eb1-7a6c7b47afed None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:03.522076 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99589b-34bf-4fa0-9eb1-7a6c7b47afed None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:03.522347 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99589b-34bf-4fa0-9eb1-7a6c7b47afed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:03.551408 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ca99589b-34bf-4fa0-9eb1-7a6c7b47afed None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:03.552595 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ca99589b-34bf-4fa0-9eb1-7a6c7b47afed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:03.555522 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:03.724702 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 76/145] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 01 17:13:03.730340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d84a8b-ec0d-4dd8-a803-bd69a1490da0 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:03.771012 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e640b1-61c0-4403-b9aa-cda80cd5f53d None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:03.771284 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e640b1-61c0-4403-b9aa-cda80cd5f53d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:03.771507 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e640b1-61c0-4403-b9aa-cda80cd5f53d None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:03.772979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 77/146] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:03.774161 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118774f-788b-4f37-bf37-ec759dbdd367 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:03.774288 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118774f-788b-4f37-bf37-ec759dbdd367 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:03.774545 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118774f-788b-4f37-bf37-ec759dbdd367 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:03.775919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 78/147] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:03.776206 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af87968-3dd5-458a-96c7-5057f7531039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:03.776873 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af87968-3dd5-458a-96c7-5057f7531039 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:03.777210 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af87968-3dd5-458a-96c7-5057f7531039 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:03.777577 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af87968-3dd5-458a-96c7-5057f7531039 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:03.784009 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face750d-199f-4fa3-b85f-ac396f7e68ca None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:03.784288 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face750d-199f-4fa3-b85f-ac396f7e68ca None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:03.784560 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face750d-199f-4fa3-b85f-ac396f7e68ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:03.797675 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af87968-3dd5-458a-96c7-5057f7531039 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:03.802673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-3af87968-3dd5-458a-96c7-5057f7531039 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:13:03.802673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:03.802673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:03.802673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:03.802673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:03.802673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:03.802673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:03.802673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:03.802673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:03.802673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:03.802673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:03.802673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:03.802673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:03.802673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:03.802673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:03.802673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:03.803510 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:03.803510 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:03.803510 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:03.803510 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:03.803510 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:03.803510 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:03.803510 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:03.803510 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:03.803510 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:03.803510 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:03.803510 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:03.803510 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:03.803510 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:03.803510 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:03.803510 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:03.803510 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:03.804288 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:03.804288 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:03.804288 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:03.804288 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:03.804288 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:03.804288 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:03.804288 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:03.804288 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:03.804288 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:03.804288 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:03.804288 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:13:03.804288 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:03.804288 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 70/148] 10.222.0.94 () {56 vars in 1114 bytes} [Thu Sep 1 17:13:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:03.809423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f520fd5-3389-4e60-b1d1-a07677aa44f8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:03.809423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f520fd5-3389-4e60-b1d1-a07677aa44f8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:03.809423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f520fd5-3389-4e60-b1d1-a07677aa44f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:03.809911 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-face750d-199f-4fa3-b85f-ac396f7e68ca None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:03.809911 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-face750d-199f-4fa3-b85f-ac396f7e68ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:03.838646 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-0f520fd5-3389-4e60-b1d1-a07677aa44f8 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:03.839848 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0f520fd5-3389-4e60-b1d1-a07677aa44f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:03.919193 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 79/149] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:03.920078 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face750d-199f-4fa3-b85f-ac396f7e68ca None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:03.928438 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 71/150] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:03.972242 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:04.046080 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face750d-199f-4fa3-b85f-ac396f7e68ca None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:04.085291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15871de6-6812-4515-999e-c805ebdb184d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:04.085932 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15871de6-6812-4515-999e-c805ebdb184d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:04.086209 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15871de6-6812-4515-999e-c805ebdb184d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:04.086475 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15871de6-6812-4515-999e-c805ebdb184d None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:04.087141 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15871de6-6812-4515-999e-c805ebdb184d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:04.087436 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15871de6-6812-4515-999e-c805ebdb184d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:04.088812 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15871de6-6812-4515-999e-c805ebdb184d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:04.100614 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 80/151] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:13:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:04.106941 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f520fd5-3389-4e60-b1d1-a07677aa44f8 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:04.119431 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15871de6-6812-4515-999e-c805ebdb184d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:04.141600 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:04.279197 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f520fd5-3389-4e60-b1d1-a07677aa44f8 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:04.326821 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:04.346231 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be723c86-d328-4320-ab2e-eb7afe0dc84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:04.346910 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be723c86-d328-4320-ab2e-eb7afe0dc84d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:04.347518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be723c86-d328-4320-ab2e-eb7afe0dc84d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:04.347795 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be723c86-d328-4320-ab2e-eb7afe0dc84d None admin] PATH_INFO: `/v3/users/317a95cd3128411790c45fac9bb511fb` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:04.351348 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be723c86-d328-4320-ab2e-eb7afe0dc84d None admin] RBAC: Authorizing `identity:get_user(user_id=317a95cd3128411790c45fac9bb511fb)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:04.352821 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be723c86-d328-4320-ab2e-eb7afe0dc84d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:04.354782 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 72/152] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:13:04 2022] GET /identity/v3/users/317a95cd3128411790c45fac9bb511fb => generated 275 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:04.356163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15871de6-6812-4515-999e-c805ebdb184d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:04.357606 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010319e-dfed-4842-84a0-2593be758bbd None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:04.358165 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010319e-dfed-4842-84a0-2593be758bbd None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:04.358442 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010319e-dfed-4842-84a0-2593be758bbd None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:04.359810 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 73/153] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:04.361737 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010319e-dfed-4842-84a0-2593be758bbd None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:04.453665 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77859f78-9308-4422-a97e-38f3f08e835c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:04.454318 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77859f78-9308-4422-a97e-38f3f08e835c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:04.454599 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77859f78-9308-4422-a97e-38f3f08e835c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:04.454874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77859f78-9308-4422-a97e-38f3f08e835c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:04.482615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77859f78-9308-4422-a97e-38f3f08e835c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:04.487930 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-77859f78-9308-4422-a97e-38f3f08e835c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:13:04.487930 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:04.487930 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:04.487930 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:04.487930 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:04.487930 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:04.487930 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:04.487930 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:04.487930 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:04.487930 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:04.487930 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:04.487930 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:04.487930 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:04.487930 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:04.487930 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:04.487930 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:04.488762 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:04.488762 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:04.488762 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:04.488762 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:04.488762 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:04.488762 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:04.488762 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:04.488762 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:04.488762 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:04.488762 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:04.488762 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:04.488762 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:04.488762 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:04.488762 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:04.488762 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:04.488762 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:04.489563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:04.489563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:04.489563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:04.489563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:04.489563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:04.489563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:04.489563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:04.489563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:04.489563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:04.489563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:04.489563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:13:04.489563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:04.489563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 81/154] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:13:04.495750 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:04.497121 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b18e6-954e-4614-bb5d-ff103eb86763 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:04.497351 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b18e6-954e-4614-bb5d-ff103eb86763 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:04.497645 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b18e6-954e-4614-bb5d-ff103eb86763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:04.534997 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1a2b18e6-954e-4614-bb5d-ff103eb86763 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:04.535655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1a2b18e6-954e-4614-bb5d-ff103eb86763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:04.541445 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010319e-dfed-4842-84a0-2593be758bbd None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:04.640157 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 82/155] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:04.640943 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b18e6-954e-4614-bb5d-ff103eb86763 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:04.645482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd097375-1865-4b65-8b41-df10f93efa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:04.646123 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd097375-1865-4b65-8b41-df10f93efa65 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:04.646401 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd097375-1865-4b65-8b41-df10f93efa65 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:04.646674 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd097375-1865-4b65-8b41-df10f93efa65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:04.774320 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:04.793989 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b18e6-954e-4614-bb5d-ff103eb86763 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:04.817449 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd097375-1865-4b65-8b41-df10f93efa65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:04.818951 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd097375-1865-4b65-8b41-df10f93efa65 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:04.836409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d2eff-419c-4784-a624-daaf355d1b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:04.837774 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d2eff-419c-4784-a624-daaf355d1b12 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:04.838282 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d2eff-419c-4784-a624-daaf355d1b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:04.838738 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d2eff-419c-4784-a624-daaf355d1b12 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:04.839593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d2eff-419c-4784-a624-daaf355d1b12 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:04.840108 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d2eff-419c-4784-a624-daaf355d1b12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:04.841770 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d2eff-419c-4784-a624-daaf355d1b12 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:04.855232 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 83/156] 10.222.0.94 () {56 vars in 1101 bytes} [Thu Sep 1 17:13:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:04.856858 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d2eff-419c-4784-a624-daaf355d1b12 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:05.008383 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d2eff-419c-4784-a624-daaf355d1b12 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:05.085644 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef05db-269f-4228-9c39-ec248d75d738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:05.086291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef05db-269f-4228-9c39-ec248d75d738 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:05.086568 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef05db-269f-4228-9c39-ec248d75d738 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:05.086840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef05db-269f-4228-9c39-ec248d75d738 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:05.099116 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:05.106137 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef05db-269f-4228-9c39-ec248d75d738 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:05.111969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-5fef05db-269f-4228-9c39-ec248d75d738 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:13:05.111969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:05.111969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:05.111969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:05.111969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:05.111969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:05.111969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:05.111969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:05.111969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:05.111969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:05.111969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:05.111969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:05.111969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:05.111969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:05.111969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:05.111969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:05.113023 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:05.113023 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:05.113023 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:05.113023 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:05.113023 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:05.113023 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:05.113023 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:05.113023 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:05.113023 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:05.113023 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:05.113023 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:05.113023 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:05.113023 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:05.113023 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:05.113023 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:05.113023 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:05.113917 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:05.113917 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:05.113917 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:05.113917 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:05.113917 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:05.113917 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:05.113917 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:05.113917 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:05.113917 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:05.113917 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:05.113917 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:13:05.113917 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:05.113917 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 84/157] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:13:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:05.113917 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef05db-269f-4228-9c39-ec248d75d738 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:05.127759 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 74/158] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:13:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 766 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:13:05.128384 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:05.128680 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd097375-1865-4b65-8b41-df10f93efa65 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:05.301105 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef05db-269f-4228-9c39-ec248d75d738 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:05.320236 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd097375-1865-4b65-8b41-df10f93efa65 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:05.347022 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e21aa-29db-44fc-8639-37324c6c798a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:05.347681 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e21aa-29db-44fc-8639-37324c6c798a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:05.347962 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e21aa-29db-44fc-8639-37324c6c798a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:05.348235 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e21aa-29db-44fc-8639-37324c6c798a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:05.368858 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e21aa-29db-44fc-8639-37324c6c798a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:05.374425 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-3f9e21aa-29db-44fc-8639-37324c6c798a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:13:05.374425 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:05.374425 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:05.374425 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:05.374425 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:05.374425 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:05.374425 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:05.374425 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:05.374425 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:05.374425 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:05.374425 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:05.374425 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:05.374425 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:05.374425 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:05.374425 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:05.374425 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:05.375491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:05.375491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:05.375491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:05.375491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:05.375491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:05.375491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:05.375491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:05.375491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:05.375491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:05.375491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:05.375491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:05.375491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:05.375491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:05.375491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:05.375491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:05.375491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:05.376553 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:05.376553 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:05.376553 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:05.376553 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:05.376553 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:05.376553 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:05.376553 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:05.376553 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:05.376553 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:05.376553 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:05.376553 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:13:05.376553 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:05.379185 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 85/159] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:05.380119 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e21aa-29db-44fc-8639-37324c6c798a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:05.434621 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0bdcc0-be84-4b85-b078-3f8fc16dd644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:05.435274 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bdcc0-be84-4b85-b078-3f8fc16dd644 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:05.435557 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bdcc0-be84-4b85-b078-3f8fc16dd644 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:05.435832 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bdcc0-be84-4b85-b078-3f8fc16dd644 None admin] PATH_INFO: `/v3/users/e37a83ce1a6e43be8bf899c347b8a30d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:05.436981 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0bdcc0-be84-4b85-b078-3f8fc16dd644 None admin] RBAC: Authorizing `identity:get_user(user_id=e37a83ce1a6e43be8bf899c347b8a30d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:05.438444 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0bdcc0-be84-4b85-b078-3f8fc16dd644 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:05.440175 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 75/160] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:13:05 2022] GET /identity/v3/users/e37a83ce1a6e43be8bf899c347b8a30d => generated 289 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:05.441125 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0bdcc0-be84-4b85-b078-3f8fc16dd644 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:05.454818 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:05.498557 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e21aa-29db-44fc-8639-37324c6c798a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:05.543926 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03241e-d165-4974-ad47-b4ab7fb9e206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:05.544761 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03241e-d165-4974-ad47-b4ab7fb9e206 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:05.545166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03241e-d165-4974-ad47-b4ab7fb9e206 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:05.545590 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03241e-d165-4974-ad47-b4ab7fb9e206 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:05.568605 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03241e-d165-4974-ad47-b4ab7fb9e206 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:05.574321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-ca03241e-d165-4974-ad47-b4ab7fb9e206 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:13:05.574321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:05.574321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:05.574321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:05.574321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:05.574321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:05.574321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:05.574321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:05.574321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:05.574321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:05.574321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:05.574321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:05.574321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:05.574321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:05.574321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:05.574321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:05.575791 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:05.575791 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:05.575791 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:05.575791 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:05.575791 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:05.575791 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:05.575791 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:05.575791 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:05.575791 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:05.575791 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:05.575791 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:05.575791 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:05.575791 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:05.575791 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:05.575791 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:05.575791 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:05.576562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:05.576562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:05.576562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:05.576562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:05.576562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:05.576562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:05.576562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:05.576562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:05.576562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:05.576562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:05.576562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:13:05.576562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:05.588105 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 86/161] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:05.589179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03241e-d165-4974-ad47-b4ab7fb9e206 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:05.593557 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:05.682696 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0bdcc0-be84-4b85-b078-3f8fc16dd644 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:05.744488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359cbbd-1ce3-4302-8f3e-852b545e4b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:05.745352 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359cbbd-1ce3-4302-8f3e-852b545e4b35 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:05.745790 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359cbbd-1ce3-4302-8f3e-852b545e4b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:05.746344 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359cbbd-1ce3-4302-8f3e-852b545e4b35 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:05.747262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359cbbd-1ce3-4302-8f3e-852b545e4b35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:05.747743 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359cbbd-1ce3-4302-8f3e-852b545e4b35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:05.749515 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359cbbd-1ce3-4302-8f3e-852b545e4b35 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:05.764034 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 76/162] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:05.765182 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359cbbd-1ce3-4302-8f3e-852b545e4b35 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:05.769871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03241e-d165-4974-ad47-b4ab7fb9e206 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:05.797835 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:05.810376 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1b9f4-552f-4e22-9cc8-8b294c87bf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:05.811114 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1b9f4-552f-4e22-9cc8-8b294c87bf09 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:05.811488 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1b9f4-552f-4e22-9cc8-8b294c87bf09 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:05.811834 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1b9f4-552f-4e22-9cc8-8b294c87bf09 None admin] PATH_INFO: `/v3/projects/09e5899a135840f3a8cdeb96945d5623` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:05.813051 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1b9f4-552f-4e22-9cc8-8b294c87bf09 None admin] RBAC: Authorizing `identity:get_project(project_id=09e5899a135840f3a8cdeb96945d5623)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:05.814759 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1b9f4-552f-4e22-9cc8-8b294c87bf09 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:05.817447 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 87/163] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:05 2022] GET /identity/v3/projects/09e5899a135840f3a8cdeb96945d5623 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:05.817713 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1b9f4-552f-4e22-9cc8-8b294c87bf09 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:05.896245 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359cbbd-1ce3-4302-8f3e-852b545e4b35 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:05.916936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:05.943237 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3d5b2-0123-424e-95ac-e3e0a4dad0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:05.944320 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3d5b2-0123-424e-95ac-e3e0a4dad0b8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:05.944821 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3d5b2-0123-424e-95ac-e3e0a4dad0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:05.945384 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3d5b2-0123-424e-95ac-e3e0a4dad0b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:05.946296 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e3d5b2-0123-424e-95ac-e3e0a4dad0b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:05.946804 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e3d5b2-0123-424e-95ac-e3e0a4dad0b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:05.947812 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1b9f4-552f-4e22-9cc8-8b294c87bf09 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:05.948959 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e3d5b2-0123-424e-95ac-e3e0a4dad0b8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:05.958796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 77/164] 10.222.0.94 () {56 vars in 1101 bytes} [Thu Sep 1 17:13:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:05.960091 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3d5b2-0123-424e-95ac-e3e0a4dad0b8 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:05.988069 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8079457-dc7e-4602-ac2e-bee547255366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:05.988705 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8079457-dc7e-4602-ac2e-bee547255366 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:05.989002 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8079457-dc7e-4602-ac2e-bee547255366 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:05.989306 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8079457-dc7e-4602-ac2e-bee547255366 None admin] PATH_INFO: `/v3/projects/09e5899a135840f3a8cdeb96945d5623` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:05.990534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8079457-dc7e-4602-ac2e-bee547255366 None admin] RBAC: Authorizing `identity:get_project(project_id=09e5899a135840f3a8cdeb96945d5623)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:05.991897 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8079457-dc7e-4602-ac2e-bee547255366 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:05.993538 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 88/165] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:05 2022] GET /identity/v3/projects/09e5899a135840f3a8cdeb96945d5623 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:05.998451 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148f037-c670-4506-9415-9f2815cacb10 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:05.998739 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148f037-c670-4506-9415-9f2815cacb10 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:05.999144 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148f037-c670-4506-9415-9f2815cacb10 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:06.000486 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 89/166] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:06.004869 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148f037-c670-4506-9415-9f2815cacb10 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:06.066272 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:06.082495 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3d5b2-0123-424e-95ac-e3e0a4dad0b8 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:06.111927 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148f037-c670-4506-9415-9f2815cacb10 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:06.121185 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf510975-d77e-4264-8031-0bbaadd3bd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:06.122071 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf510975-d77e-4264-8031-0bbaadd3bd72 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:06.122512 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf510975-d77e-4264-8031-0bbaadd3bd72 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:06.122937 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf510975-d77e-4264-8031-0bbaadd3bd72 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:06.123768 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf510975-d77e-4264-8031-0bbaadd3bd72 None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:06.124237 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf510975-d77e-4264-8031-0bbaadd3bd72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:06.125647 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf510975-d77e-4264-8031-0bbaadd3bd72 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:06.134532 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 78/167] 10.222.0.94 () {56 vars in 1101 bytes} [Thu Sep 1 17:13:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:06.135114 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf510975-d77e-4264-8031-0bbaadd3bd72 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:06.151501 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe39230-9ab0-40f5-a6cd-ed727255428c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:06.152141 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe39230-9ab0-40f5-a6cd-ed727255428c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:06.152424 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe39230-9ab0-40f5-a6cd-ed727255428c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:06.153226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe39230-9ab0-40f5-a6cd-ed727255428c None admin] PATH_INFO: `/v3/users/50b675acba8e48388c8e8252cc16a021` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:06.154387 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe39230-9ab0-40f5-a6cd-ed727255428c None admin] RBAC: Authorizing `identity:get_user(user_id=50b675acba8e48388c8e8252cc16a021)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:06.155855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe39230-9ab0-40f5-a6cd-ed727255428c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:06.162164 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 90/168] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:13:06 2022] GET /identity/v3/users/50b675acba8e48388c8e8252cc16a021 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:06.162164 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe39230-9ab0-40f5-a6cd-ed727255428c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:06.179564 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:06.241951 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf510975-d77e-4264-8031-0bbaadd3bd72 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:06.264809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe39230-9ab0-40f5-a6cd-ed727255428c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:06.275329 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89509f4d-7db4-46be-a182-ebcec8c50b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:06.275928 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89509f4d-7db4-46be-a182-ebcec8c50b20 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:06.276199 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89509f4d-7db4-46be-a182-ebcec8c50b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:06.276466 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89509f4d-7db4-46be-a182-ebcec8c50b20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:06.277182 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89509f4d-7db4-46be-a182-ebcec8c50b20 None admin] RBAC: Adding query filter params (role.id=9131e2ca337e4d1286ef32a4ba63cafa, scope.project.id=09e5899a135840f3a8cdeb96945d5623, user.id=317a95cd3128411790c45fac9bb511fb) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:06.277516 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89509f4d-7db4-46be-a182-ebcec8c50b20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:06.280497 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89509f4d-7db4-46be-a182-ebcec8c50b20 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:06.286086 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 79/169] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:13:06 2022] GET /identity/v3/role_assignments?user.id=317a95cd3128411790c45fac9bb511fb&scope.project.id=09e5899a135840f3a8cdeb96945d5623&role.id=9131e2ca337e4d1286ef32a4ba63cafa => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:06.286831 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89509f4d-7db4-46be-a182-ebcec8c50b20 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:06.297830 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:06.307806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0e30c-095d-4cf2-a2ef-842fad764ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:06.308473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0e30c-095d-4cf2-a2ef-842fad764ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:06.308757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0e30c-095d-4cf2-a2ef-842fad764ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:06.309075 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0e30c-095d-4cf2-a2ef-842fad764ac2 None admin] PATH_INFO: `/v3/users/317a95cd3128411790c45fac9bb511fb` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:06.310427 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0e30c-095d-4cf2-a2ef-842fad764ac2 None admin] RBAC: Authorizing `identity:get_user(user_id=317a95cd3128411790c45fac9bb511fb)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:06.311994 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0e30c-095d-4cf2-a2ef-842fad764ac2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:06.313746 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 91/170] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:13:06 2022] GET /identity/v3/users/317a95cd3128411790c45fac9bb511fb => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:06.314989 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6bc3a-87c5-4278-aa51-dd38f3cf648a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:06.315273 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6bc3a-87c5-4278-aa51-dd38f3cf648a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:06.315545 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6bc3a-87c5-4278-aa51-dd38f3cf648a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:06.336942 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-cdd6bc3a-87c5-4278-aa51-dd38f3cf648a None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:06.338679 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cdd6bc3a-87c5-4278-aa51-dd38f3cf648a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:06.406608 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89509f4d-7db4-46be-a182-ebcec8c50b20 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:06.409160 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:06.422856 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 92/171] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:06.422856 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243da2a-6be3-4790-8aaf-4b7bf6243700 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:06.422856 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243da2a-6be3-4790-8aaf-4b7bf6243700 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:06.422856 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243da2a-6be3-4790-8aaf-4b7bf6243700 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:06.422856 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 93/172] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:06.422856 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243da2a-6be3-4790-8aaf-4b7bf6243700 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:06.459024 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b5b31-4b47-45b3-b7fc-972c6a70bcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:06.459691 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b5b31-4b47-45b3-b7fc-972c6a70bcfe None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:06.459971 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b5b31-4b47-45b3-b7fc-972c6a70bcfe None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:06.460242 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b5b31-4b47-45b3-b7fc-972c6a70bcfe None admin] PATH_INFO: `/v3/projects/09e5899a135840f3a8cdeb96945d5623/users/e37a83ce1a6e43be8bf899c347b8a30d/roles/1052488681f94c6f8039fa871f46daa9` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:06.462806 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b5b31-4b47-45b3-b7fc-972c6a70bcfe None admin] RBAC: Authorizing `identity:create_grant(project_id=09e5899a135840f3a8cdeb96945d5623, user_id=e37a83ce1a6e43be8bf899c347b8a30d, role_id=1052488681f94c6f8039fa871f46daa9)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:06.463950 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b5b31-4b47-45b3-b7fc-972c6a70bcfe None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:06.487053 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 80/173] 10.222.0.94 () {58 vars in 1439 bytes} [Thu Sep 1 17:13:06 2022] PUT /identity/v3/projects/09e5899a135840f3a8cdeb96945d5623/users/e37a83ce1a6e43be8bf899c347b8a30d/roles/1052488681f94c6f8039fa871f46daa9 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:13:06.487741 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b5b31-4b47-45b3-b7fc-972c6a70bcfe None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:06.577160 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243da2a-6be3-4790-8aaf-4b7bf6243700 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:06.614867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:06.626816 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b5b31-4b47-45b3-b7fc-972c6a70bcfe None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:06.628231 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e2605-b0de-4650-b7ec-41b5ee4e836e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:06.629156 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e2605-b0de-4650-b7ec-41b5ee4e836e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:06.630512 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e2605-b0de-4650-b7ec-41b5ee4e836e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:06.630814 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e2605-b0de-4650-b7ec-41b5ee4e836e None admin] PATH_INFO: `/v3/users/317a95cd3128411790c45fac9bb511fb` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:06.632037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e2605-b0de-4650-b7ec-41b5ee4e836e None admin] RBAC: Authorizing `identity:get_user(user_id=317a95cd3128411790c45fac9bb511fb)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:06.633555 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e2605-b0de-4650-b7ec-41b5ee4e836e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:06.635894 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 94/174] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:13:06 2022] GET /identity/v3/users/317a95cd3128411790c45fac9bb511fb => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:06.637377 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe1252-7446-4ba3-b694-e455e26283e0 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:06.637689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe1252-7446-4ba3-b694-e455e26283e0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:06.637962 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe1252-7446-4ba3-b694-e455e26283e0 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:06.639478 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 95/175] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:06.643286 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe1252-7446-4ba3-b694-e455e26283e0 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:06.680118 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66d0dd-4882-4f8c-9931-b8cfa762027b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:06.680664 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66d0dd-4882-4f8c-9931-b8cfa762027b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:06.680941 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66d0dd-4882-4f8c-9931-b8cfa762027b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:06.681211 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66d0dd-4882-4f8c-9931-b8cfa762027b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:06.719757 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:06.764247 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66d0dd-4882-4f8c-9931-b8cfa762027b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:06.765728 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66d0dd-4882-4f8c-9931-b8cfa762027b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:06.771773 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe1252-7446-4ba3-b694-e455e26283e0 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:06.807009 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be19284-d357-4f0d-aa2a-5ed14e4461d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:06.807628 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be19284-d357-4f0d-aa2a-5ed14e4461d6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:06.807908 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be19284-d357-4f0d-aa2a-5ed14e4461d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:06.808182 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be19284-d357-4f0d-aa2a-5ed14e4461d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:06.873368 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:06.875473 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 81/176] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:13:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:13:06.881174 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dd2ee-e8c0-42a9-b168-85566ff1db7a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:06.881473 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dd2ee-e8c0-42a9-b168-85566ff1db7a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:06.881749 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dd2ee-e8c0-42a9-b168-85566ff1db7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:06.882674 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be19284-d357-4f0d-aa2a-5ed14e4461d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:06.884135 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be19284-d357-4f0d-aa2a-5ed14e4461d6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:06.900456 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f56dd2ee-e8c0-42a9-b168-85566ff1db7a None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:06.901760 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f56dd2ee-e8c0-42a9-b168-85566ff1db7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:06.964271 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:06.974571 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 82/177] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:06.986303 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56dd2ee-e8c0-42a9-b168-85566ff1db7a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:06.991477 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 96/178] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:13:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:13:06.996496 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91530c81-edc8-4cd0-9660-3f45259a6c8a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:06.996496 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91530c81-edc8-4cd0-9660-3f45259a6c8a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:06.996496 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91530c81-edc8-4cd0-9660-3f45259a6c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:07.020170 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-91530c81-edc8-4cd0-9660-3f45259a6c8a None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:07.021559 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-91530c81-edc8-4cd0-9660-3f45259a6c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:07.096417 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 97/179] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:07.097532 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91530c81-edc8-4cd0-9660-3f45259a6c8a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:07.114472 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56dd2ee-e8c0-42a9-b168-85566ff1db7a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:07.152516 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25c52b-3de4-4588-8a55-f9c14cacd569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:07.154072 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25c52b-3de4-4588-8a55-f9c14cacd569 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:07.154570 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25c52b-3de4-4588-8a55-f9c14cacd569 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:07.154928 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:07.155266 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25c52b-3de4-4588-8a55-f9c14cacd569 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:07.233573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25c52b-3de4-4588-8a55-f9c14cacd569 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:07.237605 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:07.238733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25c52b-3de4-4588-8a55-f9c14cacd569 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:07.371329 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 83/180] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:13:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:13:07.373393 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25c52b-3de4-4588-8a55-f9c14cacd569 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:07.385899 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91530c81-edc8-4cd0-9660-3f45259a6c8a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:07.438463 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906505b-f8e7-4c22-917d-1751669185de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:07.439360 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906505b-f8e7-4c22-917d-1751669185de None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:07.439646 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906505b-f8e7-4c22-917d-1751669185de None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:07.439919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906505b-f8e7-4c22-917d-1751669185de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:07.451619 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906505b-f8e7-4c22-917d-1751669185de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:07.456689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-1906505b-f8e7-4c22-917d-1751669185de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:13:07.456689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:07.456689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:07.456689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:07.456689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:07.456689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:07.456689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:07.456689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:07.456689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:07.456689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:07.456689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:07.456689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:07.456689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:07.456689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:07.456689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:07.456689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:07.457663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:07.457663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:07.457663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:07.457663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:07.457663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:07.457663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:07.457663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:07.457663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:07.457663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:07.457663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:07.457663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:07.457663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:07.457663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:07.457663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:07.457663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:07.457663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:07.458506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:07.458506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:07.458506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:07.458506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:07.458506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:07.458506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:07.458506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:07.458506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:07.458506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:07.458506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:07.458506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:13:07.458506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:07.458506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 98/181] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:13:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:07.459204 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906505b-f8e7-4c22-917d-1751669185de None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:07.478982 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:07.489061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25c52b-3de4-4588-8a55-f9c14cacd569 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:07.533142 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dceaf-4de5-4ebf-bb2b-ca840fff2a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:07.534986 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dceaf-4de5-4ebf-bb2b-ca840fff2a55 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:07.534986 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dceaf-4de5-4ebf-bb2b-ca840fff2a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:07.535460 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dceaf-4de5-4ebf-bb2b-ca840fff2a55 None admin] PATH_INFO: `/v3/projects/09e5899a135840f3a8cdeb96945d5623` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:07.536689 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3dceaf-4de5-4ebf-bb2b-ca840fff2a55 None admin] RBAC: Authorizing `identity:get_project(project_id=09e5899a135840f3a8cdeb96945d5623)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:07.538251 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3dceaf-4de5-4ebf-bb2b-ca840fff2a55 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:07.539970 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 84/182] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:07 2022] GET /identity/v3/projects/09e5899a135840f3a8cdeb96945d5623 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:07.540739 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dceaf-4de5-4ebf-bb2b-ca840fff2a55 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:07.552696 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:07.571410 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906505b-f8e7-4c22-917d-1751669185de None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:07.619875 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df109e0-e882-448b-abd4-17a424dbe9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:07.620521 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df109e0-e882-448b-abd4-17a424dbe9e3 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:07.620790 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df109e0-e882-448b-abd4-17a424dbe9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:07.621056 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df109e0-e882-448b-abd4-17a424dbe9e3 None admin] PATH_INFO: `/v3/projects/09e5899a135840f3a8cdeb96945d5623` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:07.622756 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df109e0-e882-448b-abd4-17a424dbe9e3 None admin] RBAC: Authorizing `identity:get_project(project_id=09e5899a135840f3a8cdeb96945d5623)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:07.624372 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df109e0-e882-448b-abd4-17a424dbe9e3 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:07.626446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 99/183] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:07 2022] GET /identity/v3/projects/09e5899a135840f3a8cdeb96945d5623 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:07.627146 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df109e0-e882-448b-abd4-17a424dbe9e3 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:07.663168 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dceaf-4de5-4ebf-bb2b-ca840fff2a55 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:07.713620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776cb30-a589-4c37-8118-48b3014654f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:07.714366 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776cb30-a589-4c37-8118-48b3014654f7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:07.714747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776cb30-a589-4c37-8118-48b3014654f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:07.715646 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776cb30-a589-4c37-8118-48b3014654f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:07.716887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776cb30-a589-4c37-8118-48b3014654f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:07.718884 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776cb30-a589-4c37-8118-48b3014654f7 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:07.720915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 85/184] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:13:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:07.724989 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776cb30-a589-4c37-8118-48b3014654f7 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:07.758497 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df109e0-e882-448b-abd4-17a424dbe9e3 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:07.759272 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:07.797069 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12795a8e-ae16-42de-a1ed-5488d7d966c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:07.797863 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12795a8e-ae16-42de-a1ed-5488d7d966c8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:07.798062 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12795a8e-ae16-42de-a1ed-5488d7d966c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:07.798339 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12795a8e-ae16-42de-a1ed-5488d7d966c8 None admin] PATH_INFO: `/v3/projects/10dfafcb84084137963c79092309f4c5` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:07.799649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12795a8e-ae16-42de-a1ed-5488d7d966c8 None admin] RBAC: Authorizing `identity:get_project(project_id=10dfafcb84084137963c79092309f4c5)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:07.801065 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12795a8e-ae16-42de-a1ed-5488d7d966c8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:07.803051 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 100/185] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:07 2022] GET /identity/v3/projects/10dfafcb84084137963c79092309f4c5 => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:07.808399 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12795a8e-ae16-42de-a1ed-5488d7d966c8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:07.831369 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:07.835759 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776cb30-a589-4c37-8118-48b3014654f7 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:07.871308 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dcc513-eee2-4f15-a7ec-4e9d9950b8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:07.872136 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcc513-eee2-4f15-a7ec-4e9d9950b8cc None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:07.872463 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcc513-eee2-4f15-a7ec-4e9d9950b8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:07.872784 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcc513-eee2-4f15-a7ec-4e9d9950b8cc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:07.884100 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dcc513-eee2-4f15-a7ec-4e9d9950b8cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:07.890087 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-11dcc513-eee2-4f15-a7ec-4e9d9950b8cc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:13:07.890087 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:07.890087 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:07.890087 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:07.890087 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:07.890087 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:07.890087 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:07.890087 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:07.890087 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:07.890087 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:07.890087 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:07.890087 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:07.890087 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:07.890087 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:07.890087 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:07.890087 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:07.890987 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:07.890987 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:07.890987 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:07.890987 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:07.890987 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:07.890987 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:07.890987 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:07.890987 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:07.890987 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:07.890987 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:07.890987 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:07.890987 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:07.890987 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:07.890987 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:07.890987 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:07.890987 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:07.894377 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:07.894377 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:07.894377 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:07.894377 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:07.894377 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:07.894377 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:07.894377 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:07.894377 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:07.894377 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:07.894377 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:07.894377 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:13:07.894377 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:07.894377 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 86/186] 10.222.0.94 () {56 vars in 1114 bytes} [Thu Sep 1 17:13:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:07.894377 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dcc513-eee2-4f15-a7ec-4e9d9950b8cc None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:07.917763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12795a8e-ae16-42de-a1ed-5488d7d966c8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:07.955465 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dcbef-cf8e-4261-aa7e-5827095ddb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:07.956302 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dcbef-cf8e-4261-aa7e-5827095ddb2e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:07.956738 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dcbef-cf8e-4261-aa7e-5827095ddb2e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:07.957018 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dcbef-cf8e-4261-aa7e-5827095ddb2e None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:07.957726 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181dcbef-cf8e-4261-aa7e-5827095ddb2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:07.958032 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181dcbef-cf8e-4261-aa7e-5827095ddb2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:07.959438 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181dcbef-cf8e-4261-aa7e-5827095ddb2e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:07.968792 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 101/187] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:07.969431 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dcbef-cf8e-4261-aa7e-5827095ddb2e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:07.989234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:07.999088 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dcc513-eee2-4f15-a7ec-4e9d9950b8cc None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:08.033200 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b198b2-35de-4a93-9c03-415396284092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:08.033750 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b198b2-35de-4a93-9c03-415396284092 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:08.034026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b198b2-35de-4a93-9c03-415396284092 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:08.034293 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b198b2-35de-4a93-9c03-415396284092 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:08.035046 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b198b2-35de-4a93-9c03-415396284092 None admin] RBAC: Adding query filter params (role.id=70f911a75b7b40a19f65857b9d19cfad, scope.project.id=09e5899a135840f3a8cdeb96945d5623, user.id=50b675acba8e48388c8e8252cc16a021) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:08.035354 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b198b2-35de-4a93-9c03-415396284092 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:08.036806 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b198b2-35de-4a93-9c03-415396284092 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:08.042588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 87/188] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:13:07 2022] GET /identity/v3/role_assignments?user.id=50b675acba8e48388c8e8252cc16a021&scope.project.id=09e5899a135840f3a8cdeb96945d5623&role.id=70f911a75b7b40a19f65857b9d19cfad => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:08.042588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b198b2-35de-4a93-9c03-415396284092 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:08.070972 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:08.092705 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dcbef-cf8e-4261-aa7e-5827095ddb2e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:08.130344 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84292931-1f60-4422-b34c-14727a7a2616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:08.131143 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84292931-1f60-4422-b34c-14727a7a2616 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:08.131492 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84292931-1f60-4422-b34c-14727a7a2616 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:08.131776 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84292931-1f60-4422-b34c-14727a7a2616 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:08.132523 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84292931-1f60-4422-b34c-14727a7a2616 None admin] RBAC: Adding query filter params (role.id=a78fbf73b27d4781ac14690bbcb1cd9f, scope.project.id=09e5899a135840f3a8cdeb96945d5623, user.id=317a95cd3128411790c45fac9bb511fb) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:08.132846 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84292931-1f60-4422-b34c-14727a7a2616 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:08.134348 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84292931-1f60-4422-b34c-14727a7a2616 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:08.141709 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 102/189] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:13:07 2022] GET /identity/v3/role_assignments?user.id=317a95cd3128411790c45fac9bb511fb&scope.project.id=09e5899a135840f3a8cdeb96945d5623&role.id=a78fbf73b27d4781ac14690bbcb1cd9f => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:08.150492 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84292931-1f60-4422-b34c-14727a7a2616 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:08.163880 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b198b2-35de-4a93-9c03-415396284092 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:08.212528 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b078488-7516-40d3-b8ea-20dcef782d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:08.213576 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b078488-7516-40d3-b8ea-20dcef782d84 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:08.214082 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b078488-7516-40d3-b8ea-20dcef782d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:08.214791 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b078488-7516-40d3-b8ea-20dcef782d84 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:08.216807 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b078488-7516-40d3-b8ea-20dcef782d84 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:08.218782 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b078488-7516-40d3-b8ea-20dcef782d84 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:08.251988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 88/190] 10.222.0.94 () {60 vars in 1132 bytes} [Thu Sep 1 17:13:08 2022] POST /identity/v3/users => generated 297 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:13:08.254027 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b078488-7516-40d3-b8ea-20dcef782d84 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:08.273449 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:08.324396 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84292931-1f60-4422-b34c-14727a7a2616 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:08.367435 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9fb1d-e7e9-43a3-9368-e2e4a1f93257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:08.368305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9fb1d-e7e9-43a3-9368-e2e4a1f93257 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:08.368871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9fb1d-e7e9-43a3-9368-e2e4a1f93257 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:08.369285 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9fb1d-e7e9-43a3-9368-e2e4a1f93257 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:08.370316 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9fb1d-e7e9-43a3-9368-e2e4a1f93257 None admin] RBAC: Adding query filter params (role.id=a78fbf73b27d4781ac14690bbcb1cd9f, scope.project.id=10dfafcb84084137963c79092309f4c5, user.id=317a95cd3128411790c45fac9bb511fb) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:08.370774 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9fb1d-e7e9-43a3-9368-e2e4a1f93257 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:08.373088 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9fb1d-e7e9-43a3-9368-e2e4a1f93257 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:08.381353 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 103/191] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:13:08 2022] GET /identity/v3/role_assignments?user.id=317a95cd3128411790c45fac9bb511fb&scope.project.id=10dfafcb84084137963c79092309f4c5&role.id=a78fbf73b27d4781ac14690bbcb1cd9f => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:08.383243 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9fb1d-e7e9-43a3-9368-e2e4a1f93257 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:08.398889 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:08.402231 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b078488-7516-40d3-b8ea-20dcef782d84 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:08.473368 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3ceaa-fc11-4c08-af40-8625a43f76c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:08.474298 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3ceaa-fc11-4c08-af40-8625a43f76c5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:08.474738 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3ceaa-fc11-4c08-af40-8625a43f76c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:08.475158 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3ceaa-fc11-4c08-af40-8625a43f76c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:08.475980 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3ceaa-fc11-4c08-af40-8625a43f76c5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:08.476496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3ceaa-fc11-4c08-af40-8625a43f76c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:08.482493 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3ceaa-fc11-4c08-af40-8625a43f76c5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:08.497245 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 89/192] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:13:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:08.505990 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3ceaa-fc11-4c08-af40-8625a43f76c5 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:08.509390 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9fb1d-e7e9-43a3-9368-e2e4a1f93257 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:08.614816 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6198db-f130-4044-af46-dfbae03f4973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:08.615393 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6198db-f130-4044-af46-dfbae03f4973 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:08.615672 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6198db-f130-4044-af46-dfbae03f4973 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:08.615945 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6198db-f130-4044-af46-dfbae03f4973 None admin] PATH_INFO: `/v3/users/ac5e98c524cf4fcbaccc18bf72ae8217` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:08.617691 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:08.657207 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6198db-f130-4044-af46-dfbae03f4973 None admin] RBAC: Authorizing `identity:get_user(user_id=ac5e98c524cf4fcbaccc18bf72ae8217)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:08.658776 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6198db-f130-4044-af46-dfbae03f4973 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:08.659910 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3ceaa-fc11-4c08-af40-8625a43f76c5 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:08.660477 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 104/193] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:13:08 2022] GET /identity/v3/users/ac5e98c524cf4fcbaccc18bf72ae8217 => generated 283 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:08.666154 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6198db-f130-4044-af46-dfbae03f4973 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:08.702458 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1930cc-4b0f-4551-91ae-9fd33189e0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:08.703069 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1930cc-4b0f-4551-91ae-9fd33189e0fd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:08.703346 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1930cc-4b0f-4551-91ae-9fd33189e0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:08.703619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1930cc-4b0f-4551-91ae-9fd33189e0fd None admin] PATH_INFO: `/v3/users/ac5e98c524cf4fcbaccc18bf72ae8217` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:08.704787 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1930cc-4b0f-4551-91ae-9fd33189e0fd None admin] RBAC: Authorizing `identity:get_user(user_id=ac5e98c524cf4fcbaccc18bf72ae8217)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:08.706391 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1930cc-4b0f-4551-91ae-9fd33189e0fd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:08.708315 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 90/194] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:13:08 2022] GET /identity/v3/users/ac5e98c524cf4fcbaccc18bf72ae8217 => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:13:08.716835 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1930cc-4b0f-4551-91ae-9fd33189e0fd None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:08.758564 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:08.810619 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6198db-f130-4044-af46-dfbae03f4973 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:08.851688 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae913e-e689-48c6-984f-115e658b4c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:08.852586 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae913e-e689-48c6-984f-115e658b4c0f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:08.852867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae913e-e689-48c6-984f-115e658b4c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:08.853144 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae913e-e689-48c6-984f-115e658b4c0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:08.866481 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1930cc-4b0f-4551-91ae-9fd33189e0fd None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:08.905638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9350df-5f96-4979-a33c-790417f657a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:08.906672 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9350df-5f96-4979-a33c-790417f657a1 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:08.907141 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9350df-5f96-4979-a33c-790417f657a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:08.907548 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9350df-5f96-4979-a33c-790417f657a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:08.919549 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:08.936681 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae913e-e689-48c6-984f-115e658b4c0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:08.938454 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae913e-e689-48c6-984f-115e658b4c0f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:08.998560 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9350df-5f96-4979-a33c-790417f657a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:09.000037 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9350df-5f96-4979-a33c-790417f657a1 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:09.018883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:09.070032 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 105/195] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:13:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 17:13:09.070862 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ea19f-f0f9-4baa-8889-ae22d56f8b4c None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:09.071147 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ea19f-f0f9-4baa-8889-ae22d56f8b4c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:09.071669 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ea19f-f0f9-4baa-8889-ae22d56f8b4c None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:09.072879 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 106/196] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:09.073476 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ea19f-f0f9-4baa-8889-ae22d56f8b4c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:09.126129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 91/197] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:13:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:13:09.128351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d819230-b546-46f6-a801-07da9fd4f5ac None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:09.129136 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d819230-b546-46f6-a801-07da9fd4f5ac None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:09.129660 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d819230-b546-46f6-a801-07da9fd4f5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:09.152298 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7d819230-b546-46f6-a801-07da9fd4f5ac None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:09.154906 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7d819230-b546-46f6-a801-07da9fd4f5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:09.192471 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ea19f-f0f9-4baa-8889-ae22d56f8b4c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:09.201241 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:09.237254 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e62015-f511-4d2b-a884-96604646c70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:09.237933 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e62015-f511-4d2b-a884-96604646c70e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:09.238392 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e62015-f511-4d2b-a884-96604646c70e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:09.238669 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e62015-f511-4d2b-a884-96604646c70e None admin] PATH_INFO: `/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:09.241233 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e62015-f511-4d2b-a884-96604646c70e None admin] RBAC: Authorizing `identity:get_project(project_id=13936e7054f44ceebcd8d6dfa85eb8a7)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:09.242719 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e62015-f511-4d2b-a884-96604646c70e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:09.245699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 107/198] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:09 2022] GET /identity/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:09.247105 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e62015-f511-4d2b-a884-96604646c70e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:09.252920 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 92/199] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:09.254370 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d819230-b546-46f6-a801-07da9fd4f5ac None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:09.313032 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:09.404374 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e62015-f511-4d2b-a884-96604646c70e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:09.406619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d819230-b546-46f6-a801-07da9fd4f5ac None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:09.442032 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be4343-6122-4123-8a60-8d06c9b622d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:09.443014 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be4343-6122-4123-8a60-8d06c9b622d8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:09.443504 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be4343-6122-4123-8a60-8d06c9b622d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:09.443970 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be4343-6122-4123-8a60-8d06c9b622d8 None admin] PATH_INFO: `/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:09.445443 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be4343-6122-4123-8a60-8d06c9b622d8 None admin] RBAC: Authorizing `identity:get_project(project_id=13936e7054f44ceebcd8d6dfa85eb8a7)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:09.447102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be4343-6122-4123-8a60-8d06c9b622d8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:09.449076 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 108/200] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:09 2022] GET /identity/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:09.455639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be4343-6122-4123-8a60-8d06c9b622d8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:09.482632 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93189615-455a-48c3-b7b1-82b71cef69e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:09.483294 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93189615-455a-48c3-b7b1-82b71cef69e2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:09.483639 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93189615-455a-48c3-b7b1-82b71cef69e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:09.483912 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93189615-455a-48c3-b7b1-82b71cef69e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:09.484637 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93189615-455a-48c3-b7b1-82b71cef69e2 None admin] RBAC: Adding query filter params (role.id=70f911a75b7b40a19f65857b9d19cfad, scope.project.id=13936e7054f44ceebcd8d6dfa85eb8a7, user.id=ac5e98c524cf4fcbaccc18bf72ae8217) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:09.484944 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93189615-455a-48c3-b7b1-82b71cef69e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:09.486769 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93189615-455a-48c3-b7b1-82b71cef69e2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:09.497803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 93/201] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:13:09 2022] GET /identity/v3/role_assignments?user.id=ac5e98c524cf4fcbaccc18bf72ae8217&scope.project.id=13936e7054f44ceebcd8d6dfa85eb8a7&role.id=70f911a75b7b40a19f65857b9d19cfad => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:09.608836 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be4343-6122-4123-8a60-8d06c9b622d8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:09.614550 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:09.658660 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3862c-65b6-48d9-9eb7-b71eb7b5c653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:09.659200 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3862c-65b6-48d9-9eb7-b71eb7b5c653 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:09.659479 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3862c-65b6-48d9-9eb7-b71eb7b5c653 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:09.659748 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3862c-65b6-48d9-9eb7-b71eb7b5c653 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:09.661888 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3862c-65b6-48d9-9eb7-b71eb7b5c653 None admin] RBAC: Adding query filter params (role.id=9131e2ca337e4d1286ef32a4ba63cafa, scope.project.id=13936e7054f44ceebcd8d6dfa85eb8a7, user.id=ac5e98c524cf4fcbaccc18bf72ae8217) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:09.661888 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3862c-65b6-48d9-9eb7-b71eb7b5c653 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:09.662255 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3862c-65b6-48d9-9eb7-b71eb7b5c653 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:09.672138 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 109/202] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:13:09 2022] GET /identity/v3/role_assignments?user.id=ac5e98c524cf4fcbaccc18bf72ae8217&scope.project.id=13936e7054f44ceebcd8d6dfa85eb8a7&role.id=9131e2ca337e4d1286ef32a4ba63cafa => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:13:09.698165 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93189615-455a-48c3-b7b1-82b71cef69e2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:09.740001 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:09.827013 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93189615-455a-48c3-b7b1-82b71cef69e2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:09.867326 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be6627-f062-4aa4-aaa0-fdbdbc6cb852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:09.867971 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be6627-f062-4aa4-aaa0-fdbdbc6cb852 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:09.868246 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be6627-f062-4aa4-aaa0-fdbdbc6cb852 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:09.868517 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be6627-f062-4aa4-aaa0-fdbdbc6cb852 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:09.879662 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be6627-f062-4aa4-aaa0-fdbdbc6cb852 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:09.885061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-83be6627-f062-4aa4-aaa0-fdbdbc6cb852 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:13:09.885061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:09.885061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:09.885061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:09.885061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:09.885061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:09.885061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:09.885061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:09.885061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:09.885061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:09.885061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:09.885061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:09.885061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:09.885061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:09.885061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:09.885061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:09.885993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:09.885993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:09.885993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:09.885993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:09.885993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:09.885993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:09.885993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:09.885993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:09.885993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:09.885993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:09.885993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:09.885993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:09.885993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:09.885993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:09.885993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:09.885993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:09.886802 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:09.886802 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:09.886802 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:09.886802 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:09.886802 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:09.886802 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:09.886802 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:09.886802 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:09.886802 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:09.886802 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:09.886802 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:13:09.886802 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:09.886802 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 94/203] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:09.893655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3862c-65b6-48d9-9eb7-b71eb7b5c653 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:10.058605 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3862c-65b6-48d9-9eb7-b71eb7b5c653 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:10.107946 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668191f8-3de9-4fa5-84f5-467a26063d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:10.108594 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668191f8-3de9-4fa5-84f5-467a26063d52 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:10.108818 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668191f8-3de9-4fa5-84f5-467a26063d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:10.109096 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668191f8-3de9-4fa5-84f5-467a26063d52 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:10.109792 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668191f8-3de9-4fa5-84f5-467a26063d52 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:10.110100 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668191f8-3de9-4fa5-84f5-467a26063d52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:10.111496 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668191f8-3de9-4fa5-84f5-467a26063d52 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:10.124890 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 110/204] 10.222.0.94 () {56 vars in 1101 bytes} [Thu Sep 1 17:13:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:10.130634 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be6627-f062-4aa4-aaa0-fdbdbc6cb852 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:10.263581 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:10.272170 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be6627-f062-4aa4-aaa0-fdbdbc6cb852 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:10.324055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b45183-240e-41b2-a069-520efb904de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:10.325863 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b45183-240e-41b2-a069-520efb904de6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:10.326341 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b45183-240e-41b2-a069-520efb904de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:10.326820 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b45183-240e-41b2-a069-520efb904de6 None admin] PATH_INFO: `/v3/users/e37a83ce1a6e43be8bf899c347b8a30d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:10.328177 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b45183-240e-41b2-a069-520efb904de6 None admin] RBAC: Authorizing `identity:get_user(user_id=e37a83ce1a6e43be8bf899c347b8a30d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:10.329855 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b45183-240e-41b2-a069-520efb904de6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:10.332641 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 95/205] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:13:10 2022] GET /identity/v3/users/e37a83ce1a6e43be8bf899c347b8a30d => generated 289 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:10.337463 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668191f8-3de9-4fa5-84f5-467a26063d52 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:10.375636 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:10.472803 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668191f8-3de9-4fa5-84f5-467a26063d52 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:10.507190 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40af6c9-6a4f-4c68-a07a-3904fba24a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:10.507813 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40af6c9-6a4f-4c68-a07a-3904fba24a0e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:10.508096 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40af6c9-6a4f-4c68-a07a-3904fba24a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:10.508374 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40af6c9-6a4f-4c68-a07a-3904fba24a0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:10.603942 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40af6c9-6a4f-4c68-a07a-3904fba24a0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:10.605340 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40af6c9-6a4f-4c68-a07a-3904fba24a0e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:10.649782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:10.731794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 111/206] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:13:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:13:10.737364 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b45183-240e-41b2-a069-520efb904de6 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:10.767608 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03d5ed-67d4-4c3a-899a-1295b011a51a None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:10.767913 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03d5ed-67d4-4c3a-899a-1295b011a51a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:10.768170 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03d5ed-67d4-4c3a-899a-1295b011a51a None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:10.769563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 112/207] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:10.774434 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad057e1-5337-4302-b985-e55d932c974b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:10.774721 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad057e1-5337-4302-b985-e55d932c974b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:10.774996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad057e1-5337-4302-b985-e55d932c974b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:10.793122 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-fad057e1-5337-4302-b985-e55d932c974b None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:10.794373 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fad057e1-5337-4302-b985-e55d932c974b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:10.920238 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 113/208] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:13:10.935838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b45183-240e-41b2-a069-520efb904de6 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:10.976803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60a87d-db5c-440b-98de-b479f52e3475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:10.977499 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60a87d-db5c-440b-98de-b479f52e3475 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:10.977780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60a87d-db5c-440b-98de-b479f52e3475 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:10.978052 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60a87d-db5c-440b-98de-b479f52e3475 None admin] PATH_INFO: `/v3/projects/09e5899a135840f3a8cdeb96945d5623` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:10.979192 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60a87d-db5c-440b-98de-b479f52e3475 None admin] RBAC: Authorizing `identity:get_project(project_id=09e5899a135840f3a8cdeb96945d5623)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:10.980769 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60a87d-db5c-440b-98de-b479f52e3475 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:10.983271 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 96/209] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:10 2022] GET /identity/v3/projects/09e5899a135840f3a8cdeb96945d5623 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:10.988872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad057e1-5337-4302-b985-e55d932c974b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:11.050286 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:11.053766 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e8168-d58f-496f-9cb9-69cb67410962 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:11.054124 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e8168-d58f-496f-9cb9-69cb67410962 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:11.054404 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e8168-d58f-496f-9cb9-69cb67410962 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:11.055756 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 97/210] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:13:11.063121 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea87410-0134-4138-86b6-dd4bc1758a27 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:11.063404 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea87410-0134-4138-86b6-dd4bc1758a27 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:11.063733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea87410-0134-4138-86b6-dd4bc1758a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:11.091611 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-aea87410-0134-4138-86b6-dd4bc1758a27 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:11.093540 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-aea87410-0134-4138-86b6-dd4bc1758a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:11.124616 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad057e1-5337-4302-b985-e55d932c974b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:11.136991 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:11.190217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529a721-d0ee-42e0-90ea-fedfc2407b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:11.190745 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529a721-d0ee-42e0-90ea-fedfc2407b1c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:11.191024 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529a721-d0ee-42e0-90ea-fedfc2407b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:11.192441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529a721-d0ee-42e0-90ea-fedfc2407b1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:11.193174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529a721-d0ee-42e0-90ea-fedfc2407b1c None admin] RBAC: Adding query filter params (role.id=1052488681f94c6f8039fa871f46daa9, scope.project.id=09e5899a135840f3a8cdeb96945d5623, user.id=e37a83ce1a6e43be8bf899c347b8a30d) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:11.196443 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529a721-d0ee-42e0-90ea-fedfc2407b1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:11.197939 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529a721-d0ee-42e0-90ea-fedfc2407b1c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:11.209101 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 114/211] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:13:10 2022] GET /identity/v3/role_assignments?user.id=e37a83ce1a6e43be8bf899c347b8a30d&scope.project.id=09e5899a135840f3a8cdeb96945d5623&role.id=1052488681f94c6f8039fa871f46daa9 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:11.220399 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 98/212] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:13:11.264671 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529a721-d0ee-42e0-90ea-fedfc2407b1c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:11.400217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529a721-d0ee-42e0-90ea-fedfc2407b1c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:11.433144 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:11.447607 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0389bd-a2ed-4081-acbf-3f715d7582b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:11.448172 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0389bd-a2ed-4081-acbf-3f715d7582b2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:11.448500 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0389bd-a2ed-4081-acbf-3f715d7582b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:11.448779 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0389bd-a2ed-4081-acbf-3f715d7582b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:11.464473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0389bd-a2ed-4081-acbf-3f715d7582b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:11.470588 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-7c0389bd-a2ed-4081-acbf-3f715d7582b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:13:11.470588 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:11.470588 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:11.470588 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:11.470588 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:11.470588 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:11.470588 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:11.470588 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:11.470588 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:11.470588 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:11.470588 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:11.470588 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:11.470588 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:11.470588 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:11.470588 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:11.470588 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:11.471464 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:11.471464 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:11.471464 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:11.471464 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:11.471464 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:11.471464 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:11.471464 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:11.471464 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:11.471464 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:11.471464 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:11.471464 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:11.471464 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:11.471464 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:11.471464 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:11.471464 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:11.471464 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:11.472281 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:11.472281 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:11.472281 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:11.472281 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:11.472281 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:11.472281 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:11.472281 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:11.472281 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:11.472281 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:11.472281 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:11.472281 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:13:11.472281 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:11.472281 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 115/213] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:11.479194 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea87410-0134-4138-86b6-dd4bc1758a27 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:11.513919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0389bd-a2ed-4081-acbf-3f715d7582b2 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:11.639502 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea87410-0134-4138-86b6-dd4bc1758a27 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:11.655429 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0389bd-a2ed-4081-acbf-3f715d7582b2 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:11.682494 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc6b4a-7cd2-4254-8552-5c9b5271241e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:11.683116 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc6b4a-7cd2-4254-8552-5c9b5271241e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:11.683395 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc6b4a-7cd2-4254-8552-5c9b5271241e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:11.683667 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc6b4a-7cd2-4254-8552-5c9b5271241e None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:11.684411 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc6b4a-7cd2-4254-8552-5c9b5271241e None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:11.684717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc6b4a-7cd2-4254-8552-5c9b5271241e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:11.686374 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc6b4a-7cd2-4254-8552-5c9b5271241e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:11.694515 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267a689-2e41-415b-9c1b-a4d520ed8374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:11.695151 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267a689-2e41-415b-9c1b-a4d520ed8374 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:11.695487 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267a689-2e41-415b-9c1b-a4d520ed8374 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:11.695758 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267a689-2e41-415b-9c1b-a4d520ed8374 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:11.696519 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 99/214] 10.222.0.94 () {56 vars in 1101 bytes} [Thu Sep 1 17:13:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:11.696975 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267a689-2e41-415b-9c1b-a4d520ed8374 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:11.702233 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267a689-2e41-415b-9c1b-a4d520ed8374 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:11.703434 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc6b4a-7cd2-4254-8552-5c9b5271241e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:11.703658 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 116/215] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:13:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:13:11.710537 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267a689-2e41-415b-9c1b-a4d520ed8374 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:11.732169 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:11.774682 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:11.823592 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc6b4a-7cd2-4254-8552-5c9b5271241e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:11.836069 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267a689-2e41-415b-9c1b-a4d520ed8374 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:11.861510 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b7241-00e7-4a2e-accf-94567995e8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:11.862684 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b7241-00e7-4a2e-accf-94567995e8e5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:11.863302 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b7241-00e7-4a2e-accf-94567995e8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:11.863783 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b7241-00e7-4a2e-accf-94567995e8e5 None admin] PATH_INFO: `/v3/users/5047f266f4444687a4de010ef6d48607` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:11.879275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b790ef8-a5d2-4c6b-9253-1795ea09c144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:11.879830 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b7241-00e7-4a2e-accf-94567995e8e5 None admin] RBAC: Authorizing `identity:get_user(user_id=5047f266f4444687a4de010ef6d48607)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:11.880028 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b790ef8-a5d2-4c6b-9253-1795ea09c144 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:11.880291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b790ef8-a5d2-4c6b-9253-1795ea09c144 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:11.880563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b790ef8-a5d2-4c6b-9253-1795ea09c144 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:11.881228 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b790ef8-a5d2-4c6b-9253-1795ea09c144 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:11.882351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b7241-00e7-4a2e-accf-94567995e8e5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:11.882826 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b790ef8-a5d2-4c6b-9253-1795ea09c144 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:11.884502 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 100/216] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:13:11 2022] GET /identity/v3/users/5047f266f4444687a4de010ef6d48607 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:11.891403 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b7241-00e7-4a2e-accf-94567995e8e5 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:11.910101 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 117/217] 10.222.0.94 () {60 vars in 1132 bytes} [Thu Sep 1 17:13:11 2022] POST /identity/v3/users => generated 297 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:13:11.932200 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e785ab-8fcd-4b87-ad67-f7b90cddf4ee None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:11.932827 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e785ab-8fcd-4b87-ad67-f7b90cddf4ee None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:11.933307 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e785ab-8fcd-4b87-ad67-f7b90cddf4ee None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:11.935903 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 118/218] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:13:11.941777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f74d14-001c-471c-ac95-bdbb2d665972 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:11.942410 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f74d14-001c-471c-ac95-bdbb2d665972 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:11.942904 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f74d14-001c-471c-ac95-bdbb2d665972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:11.963136 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-14f74d14-001c-471c-ac95-bdbb2d665972 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:11.964819 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-14f74d14-001c-471c-ac95-bdbb2d665972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:12.013782 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:12.034079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b7241-00e7-4a2e-accf-94567995e8e5 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:12.048310 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 119/219] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:13:12.076885 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a5428-2a6b-42bf-b2c1-ca252ac7104c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:12.077562 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a5428-2a6b-42bf-b2c1-ca252ac7104c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:12.077846 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a5428-2a6b-42bf-b2c1-ca252ac7104c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:12.078119 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a5428-2a6b-42bf-b2c1-ca252ac7104c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:12.080594 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6d340-c841-47aa-b655-161459e4196c None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:12.080875 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6d340-c841-47aa-b655-161459e4196c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:12.081146 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6d340-c841-47aa-b655-161459e4196c None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:12.082805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 120/220] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:13:12.087597 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe05073-8ced-4238-badc-8f0a2d8b14a7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:12.087885 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe05073-8ced-4238-badc-8f0a2d8b14a7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:12.088145 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe05073-8ced-4238-badc-8f0a2d8b14a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:12.107382 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-bbe05073-8ced-4238-badc-8f0a2d8b14a7 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:12.107573 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bbe05073-8ced-4238-badc-8f0a2d8b14a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:12.145013 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:12.165770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a5428-2a6b-42bf-b2c1-ca252ac7104c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:12.167258 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a5428-2a6b-42bf-b2c1-ca252ac7104c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:12.203376 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 121/221] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:13:12.268583 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:12.290597 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 101/222] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:13:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:13:12.296703 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe05073-8ced-4238-badc-8f0a2d8b14a7 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:12.322892 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a5428-2a6b-42bf-b2c1-ca252ac7104c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:12.427423 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe05073-8ced-4238-badc-8f0a2d8b14a7 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:12.442539 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a5428-2a6b-42bf-b2c1-ca252ac7104c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:12.465111 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159d81e-e080-4e9f-9fa8-7667656cb29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:12.465835 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159d81e-e080-4e9f-9fa8-7667656cb29e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:12.466116 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159d81e-e080-4e9f-9fa8-7667656cb29e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:12.466387 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159d81e-e080-4e9f-9fa8-7667656cb29e None admin] PATH_INFO: `/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:12.467715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159d81e-e080-4e9f-9fa8-7667656cb29e None admin] RBAC: Authorizing `identity:get_project(project_id=13936e7054f44ceebcd8d6dfa85eb8a7)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:12.469172 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159d81e-e080-4e9f-9fa8-7667656cb29e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:12.471403 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 122/223] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:12 2022] GET /identity/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:12.477768 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159d81e-e080-4e9f-9fa8-7667656cb29e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:12.484016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f73e9-5b69-443e-a97d-5f6051d5fb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:12.484890 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f73e9-5b69-443e-a97d-5f6051d5fb3f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:12.485164 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f73e9-5b69-443e-a97d-5f6051d5fb3f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:12.485441 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f73e9-5b69-443e-a97d-5f6051d5fb3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:12.503750 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f73e9-5b69-443e-a97d-5f6051d5fb3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:12.508800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-5b9f73e9-5b69-443e-a97d-5f6051d5fb3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:13:12.508800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:12.508800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:12.508800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:12.508800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:12.508800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:12.508800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:12.508800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:12.508800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:12.508800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:12.508800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:12.508800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:12.508800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:12.508800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:12.508800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:12.508800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:12.509727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:12.509727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:12.509727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:12.509727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:12.509727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:12.509727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:12.509727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:12.509727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:12.509727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:12.509727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:12.509727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:12.509727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:12.509727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:12.509727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:12.509727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:12.509727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:12.510545 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:12.510545 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:12.510545 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:12.510545 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:12.510545 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:12.510545 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:12.510545 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:12.510545 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:12.510545 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:12.510545 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:12.510545 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:13:12.510545 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:12.510545 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 102/224] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:13:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:12.511216 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f73e9-5b69-443e-a97d-5f6051d5fb3f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:12.525897 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:12.561893 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:12.617732 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159d81e-e080-4e9f-9fa8-7667656cb29e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:12.628668 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f73e9-5b69-443e-a97d-5f6051d5fb3f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:12.654917 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503249ff-9d8f-4330-849c-1725a5fb123b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:12.655531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503249ff-9d8f-4330-849c-1725a5fb123b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:12.655804 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503249ff-9d8f-4330-849c-1725a5fb123b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:12.656068 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503249ff-9d8f-4330-849c-1725a5fb123b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:12.656792 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503249ff-9d8f-4330-849c-1725a5fb123b None admin] RBAC: Adding query filter params (role.id=a78fbf73b27d4781ac14690bbcb1cd9f, scope.project.id=13936e7054f44ceebcd8d6dfa85eb8a7, user.id=5047f266f4444687a4de010ef6d48607) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:12.657093 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503249ff-9d8f-4330-849c-1725a5fb123b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:12.658760 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503249ff-9d8f-4330-849c-1725a5fb123b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:12.664844 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 123/225] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:13:12 2022] GET /identity/v3/role_assignments?user.id=5047f266f4444687a4de010ef6d48607&scope.project.id=13936e7054f44ceebcd8d6dfa85eb8a7&role.id=a78fbf73b27d4781ac14690bbcb1cd9f => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:12.665718 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503249ff-9d8f-4330-849c-1725a5fb123b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:12.672961 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69f772-6321-4994-b5a3-f179239f8048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:12.673660 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69f772-6321-4994-b5a3-f179239f8048 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:12.673935 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69f772-6321-4994-b5a3-f179239f8048 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:12.674202 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69f772-6321-4994-b5a3-f179239f8048 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:12.701711 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69f772-6321-4994-b5a3-f179239f8048 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:12.707016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-8e69f772-6321-4994-b5a3-f179239f8048 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:13:12.707016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:12.707016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:12.707016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:12.707016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:12.707016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:12.707016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:12.707016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:12.707016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:12.707016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:12.707016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:12.707016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:12.707016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:12.707016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:12.707016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:12.707016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:12.707952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:12.707952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:12.707952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:12.707952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:12.707952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:12.707952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:12.707952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:12.707952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:12.707952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:12.707952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:12.707952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:12.707952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:12.707952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:12.707952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:12.707952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:12.707952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:12.708767 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:12.708767 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:12.708767 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:12.708767 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:12.708767 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:12.708767 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:12.708767 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:12.708767 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:12.708767 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:12.708767 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:12.708767 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:13:12.708767 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:12.708767 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 103/226] 10.222.0.94 () {56 vars in 1114 bytes} [Thu Sep 1 17:13:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:12.713964 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69f772-6321-4994-b5a3-f179239f8048 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:12.826585 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:12.829838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69f772-6321-4994-b5a3-f179239f8048 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:12.865275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:12.868756 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90288c48-7287-4f4c-ae02-33df6f9f0836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:12.868903 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503249ff-9d8f-4330-849c-1725a5fb123b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:12.869010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90288c48-7287-4f4c-ae02-33df6f9f0836 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:12.869102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90288c48-7287-4f4c-ae02-33df6f9f0836 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:12.869375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90288c48-7287-4f4c-ae02-33df6f9f0836 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:12.870074 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90288c48-7287-4f4c-ae02-33df6f9f0836 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:12.871466 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90288c48-7287-4f4c-ae02-33df6f9f0836 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:12.873432 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90288c48-7287-4f4c-ae02-33df6f9f0836 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:12.882124 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 104/227] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:13:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:13:12.887763 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90288c48-7287-4f4c-ae02-33df6f9f0836 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:12.932962 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25122ce7-e9b8-4343-8d11-0589df2d3f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:12.933961 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25122ce7-e9b8-4343-8d11-0589df2d3f34 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:12.934532 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25122ce7-e9b8-4343-8d11-0589df2d3f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:12.935178 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25122ce7-e9b8-4343-8d11-0589df2d3f34 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:12.936134 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25122ce7-e9b8-4343-8d11-0589df2d3f34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:12.936627 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25122ce7-e9b8-4343-8d11-0589df2d3f34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:12.938363 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25122ce7-e9b8-4343-8d11-0589df2d3f34 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:12.956624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 124/228] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:12.971152 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25122ce7-e9b8-4343-8d11-0589df2d3f34 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:13.006084 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90288c48-7287-4f4c-ae02-33df6f9f0836 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:13.082253 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072613a4-b652-4331-94ae-78a7008934a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:13.082817 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072613a4-b652-4331-94ae-78a7008934a1 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:13.083098 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072613a4-b652-4331-94ae-78a7008934a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:13.083422 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072613a4-b652-4331-94ae-78a7008934a1 None admin] PATH_INFO: `/v3/users/ac5e98c524cf4fcbaccc18bf72ae8217` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:13.085255 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072613a4-b652-4331-94ae-78a7008934a1 None admin] RBAC: Authorizing `identity:get_user(user_id=ac5e98c524cf4fcbaccc18bf72ae8217)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:13.086731 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072613a4-b652-4331-94ae-78a7008934a1 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:13.092238 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 105/229] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:13:12 2022] GET /identity/v3/users/ac5e98c524cf4fcbaccc18bf72ae8217 => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:13:13.098181 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072613a4-b652-4331-94ae-78a7008934a1 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:13.154607 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25122ce7-e9b8-4343-8d11-0589df2d3f34 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:13.192356 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc5295-b3ae-47b7-b7f7-462f2235d06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:13.193043 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc5295-b3ae-47b7-b7f7-462f2235d06c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:13.193376 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc5295-b3ae-47b7-b7f7-462f2235d06c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:13.193689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc5295-b3ae-47b7-b7f7-462f2235d06c None admin] PATH_INFO: `/v3/users/ac5e98c524cf4fcbaccc18bf72ae8217` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:13.195141 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc5295-b3ae-47b7-b7f7-462f2235d06c None admin] RBAC: Authorizing `identity:get_user(user_id=ac5e98c524cf4fcbaccc18bf72ae8217)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:13.196586 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc5295-b3ae-47b7-b7f7-462f2235d06c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:13.198533 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 125/230] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:13:12 2022] GET /identity/v3/users/ac5e98c524cf4fcbaccc18bf72ae8217 => generated 283 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:13.205241 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc5295-b3ae-47b7-b7f7-462f2235d06c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:13.221761 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:13.245789 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:13.359640 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc5295-b3ae-47b7-b7f7-462f2235d06c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:13.381050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072613a4-b652-4331-94ae-78a7008934a1 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:13.435404 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348a35f-0a01-459e-951e-572952190981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:13.437746 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348a35f-0a01-459e-951e-572952190981 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:13.438029 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348a35f-0a01-459e-951e-572952190981 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:13.438302 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348a35f-0a01-459e-951e-572952190981 None admin] PATH_INFO: `/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:13.440831 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348a35f-0a01-459e-951e-572952190981 None admin] RBAC: Authorizing `identity:get_project(project_id=13936e7054f44ceebcd8d6dfa85eb8a7)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:13.442307 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348a35f-0a01-459e-951e-572952190981 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:13.452499 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 126/231] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:13 2022] GET /identity/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:13:13.454805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348a35f-0a01-459e-951e-572952190981 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:13.460716 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4951a4a-f71c-4e9e-90ae-3e23ca8a9a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:13.461361 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4951a4a-f71c-4e9e-90ae-3e23ca8a9a67 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:13.461666 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4951a4a-f71c-4e9e-90ae-3e23ca8a9a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:13.461940 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4951a4a-f71c-4e9e-90ae-3e23ca8a9a67 None admin] PATH_INFO: `/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:13.468050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4951a4a-f71c-4e9e-90ae-3e23ca8a9a67 None admin] RBAC: Authorizing `identity:get_project(project_id=13936e7054f44ceebcd8d6dfa85eb8a7)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:13.469596 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4951a4a-f71c-4e9e-90ae-3e23ca8a9a67 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:13.471322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 106/232] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:13 2022] GET /identity/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7 => generated 302 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:13.476838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4951a4a-f71c-4e9e-90ae-3e23ca8a9a67 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:13.588574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4951a4a-f71c-4e9e-90ae-3e23ca8a9a67 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:13.609883 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:13.625098 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91dac4-8b3f-4c96-afa6-010fe4967745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:13.625939 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91dac4-8b3f-4c96-afa6-010fe4967745 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:13.626317 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91dac4-8b3f-4c96-afa6-010fe4967745 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:13.626686 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91dac4-8b3f-4c96-afa6-010fe4967745 None admin] PATH_INFO: `/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7/users/ac5e98c524cf4fcbaccc18bf72ae8217/roles/9131e2ca337e4d1286ef32a4ba63cafa` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:13.629189 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91dac4-8b3f-4c96-afa6-010fe4967745 None admin] RBAC: Authorizing `identity:create_grant(project_id=13936e7054f44ceebcd8d6dfa85eb8a7, user_id=ac5e98c524cf4fcbaccc18bf72ae8217, role_id=9131e2ca337e4d1286ef32a4ba63cafa)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:13.631155 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91dac4-8b3f-4c96-afa6-010fe4967745 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:13.651654 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 107/233] 10.222.0.94 () {58 vars in 1439 bytes} [Thu Sep 1 17:13:13 2022] PUT /identity/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7/users/ac5e98c524cf4fcbaccc18bf72ae8217/roles/9131e2ca337e4d1286ef32a4ba63cafa => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:13:13.689704 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348a35f-0a01-459e-951e-572952190981 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:13.697848 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:13.727522 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7be68-5a37-4dee-8bb8-68588302223e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:13.728376 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7be68-5a37-4dee-8bb8-68588302223e None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:13.728864 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7be68-5a37-4dee-8bb8-68588302223e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:13.729447 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7be68-5a37-4dee-8bb8-68588302223e None admin] PATH_INFO: `/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7/users/ac5e98c524cf4fcbaccc18bf72ae8217/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:13.731694 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7be68-5a37-4dee-8bb8-68588302223e None admin] RBAC: Authorizing `identity:create_grant(project_id=13936e7054f44ceebcd8d6dfa85eb8a7, user_id=ac5e98c524cf4fcbaccc18bf72ae8217, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:13.733602 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7be68-5a37-4dee-8bb8-68588302223e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:13.752686 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 127/234] 10.222.0.94 () {58 vars in 1439 bytes} [Thu Sep 1 17:13:13 2022] PUT /identity/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7/users/ac5e98c524cf4fcbaccc18bf72ae8217/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:13:14.269973 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8f2e0-d082-4b5d-aaae-9c121e6eda7c None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:14.270493 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8f2e0-d082-4b5d-aaae-9c121e6eda7c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:14.270493 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8f2e0-d082-4b5d-aaae-9c121e6eda7c None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:14.272136 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 108/235] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:14.277650 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a70149-27e4-493c-b28e-f2251bc40593 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:14.279022 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a70149-27e4-493c-b28e-f2251bc40593 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:14.279493 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a70149-27e4-493c-b28e-f2251bc40593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:14.298908 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-50a70149-27e4-493c-b28e-f2251bc40593 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:14.300446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-50a70149-27e4-493c-b28e-f2251bc40593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:14.370874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 128/236] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:14.599865 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56cec8-4084-4f5f-877b-93087d279754 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:14.600489 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56cec8-4084-4f5f-877b-93087d279754 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:14.600982 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56cec8-4084-4f5f-877b-93087d279754 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:14.602569 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 109/237] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:14.608264 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782a5ed-2c4c-4ef5-a1db-d6b9978c9f3a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:14.608804 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782a5ed-2c4c-4ef5-a1db-d6b9978c9f3a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:14.609274 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782a5ed-2c4c-4ef5-a1db-d6b9978c9f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:14.628149 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2782a5ed-2c4c-4ef5-a1db-d6b9978c9f3a None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:14.633693 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2782a5ed-2c4c-4ef5-a1db-d6b9978c9f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:14.694954 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56cec8-4084-4f5f-877b-93087d279754 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:14.736652 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 129/238] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:14.839277 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56cec8-4084-4f5f-877b-93087d279754 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:14.867858 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114aa30-8815-4112-9941-cde3350f414a None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:14.868460 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114aa30-8815-4112-9941-cde3350f414a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:14.868928 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114aa30-8815-4112-9941-cde3350f414a None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:14.870544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 130/239] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:13:14.876806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5154da-f0de-43a8-8d24-232bf5eac67b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:14.877526 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5154da-f0de-43a8-8d24-232bf5eac67b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:14.878025 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5154da-f0de-43a8-8d24-232bf5eac67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:14.889749 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f86f66-7786-455e-ab3d-f7d786f77757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:14.890394 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f86f66-7786-455e-ab3d-f7d786f77757 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:14.890738 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f86f66-7786-455e-ab3d-f7d786f77757 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:14.891416 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f86f66-7786-455e-ab3d-f7d786f77757 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:14.897570 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5c5154da-f0de-43a8-8d24-232bf5eac67b None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:14.898952 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5c5154da-f0de-43a8-8d24-232bf5eac67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:14.912643 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f86f66-7786-455e-ab3d-f7d786f77757 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:14.917747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-61f86f66-7786-455e-ab3d-f7d786f77757 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:13:14.917747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:14.917747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:14.917747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:14.917747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:14.917747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:14.917747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:14.917747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:14.917747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:14.917747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:14.917747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:14.917747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:14.917747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:14.917747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:14.917747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:14.917747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:14.919162 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:14.919162 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:14.919162 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:14.919162 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:14.919162 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:14.919162 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:14.919162 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:14.919162 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:14.919162 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:14.919162 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:14.919162 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:14.919162 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:14.919162 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:14.919162 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:14.919162 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:14.919162 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:14.919952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:14.919952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:14.919952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:14.919952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:14.919952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:14.919952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:14.919952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:14.919952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:14.919952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:14.919952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:14.919952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:13:14.919952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:14.924235 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 110/240] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:14.926249 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:14.931326 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f86f66-7786-455e-ab3d-f7d786f77757 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:14.964331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:15.024592 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 131/241] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:13:15.091543 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f86f66-7786-455e-ab3d-f7d786f77757 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:15.113208 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5154da-f0de-43a8-8d24-232bf5eac67b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:15.152086 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266118a0-471a-47f4-aef3-2091861ff38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:15.153868 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266118a0-471a-47f4-aef3-2091861ff38d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:15.154353 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266118a0-471a-47f4-aef3-2091861ff38d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:15.154851 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266118a0-471a-47f4-aef3-2091861ff38d None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:15.155759 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266118a0-471a-47f4-aef3-2091861ff38d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:15.156268 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266118a0-471a-47f4-aef3-2091861ff38d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:15.157948 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266118a0-471a-47f4-aef3-2091861ff38d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:15.174075 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 111/242] 10.222.0.94 () {56 vars in 1101 bytes} [Thu Sep 1 17:13:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:15.176524 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266118a0-471a-47f4-aef3-2091861ff38d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:15.300180 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5154da-f0de-43a8-8d24-232bf5eac67b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:15.313855 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:15.326000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266118a0-471a-47f4-aef3-2091861ff38d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:15.339447 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768c4f4-ce9a-4c5e-8eaf-a625159fe3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:15.340354 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768c4f4-ce9a-4c5e-8eaf-a625159fe3c9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:15.340886 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768c4f4-ce9a-4c5e-8eaf-a625159fe3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:15.341351 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768c4f4-ce9a-4c5e-8eaf-a625159fe3c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:15.342808 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768c4f4-ce9a-4c5e-8eaf-a625159fe3c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:15.344459 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768c4f4-ce9a-4c5e-8eaf-a625159fe3c9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:15.350930 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 132/243] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:13:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:13:15.352307 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768c4f4-ce9a-4c5e-8eaf-a625159fe3c9 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:15.371233 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:15.398994 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f52a2-a5ca-4232-b838-682d5c608055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:15.399610 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f52a2-a5ca-4232-b838-682d5c608055 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:15.400044 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f52a2-a5ca-4232-b838-682d5c608055 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:15.400478 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f52a2-a5ca-4232-b838-682d5c608055 None admin] PATH_INFO: `/v3/users/6946723909e1481f8fcaefedcdc1f2b4` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:15.431866 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f52a2-a5ca-4232-b838-682d5c608055 None admin] RBAC: Authorizing `identity:get_user(user_id=6946723909e1481f8fcaefedcdc1f2b4)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:15.433575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f52a2-a5ca-4232-b838-682d5c608055 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:15.435722 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 112/244] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:13:15 2022] GET /identity/v3/users/6946723909e1481f8fcaefedcdc1f2b4 => generated 297 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:15.436616 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f52a2-a5ca-4232-b838-682d5c608055 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:15.467916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768c4f4-ce9a-4c5e-8eaf-a625159fe3c9 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:15.516695 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc7bd2-42e4-4cee-805f-51016da94380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:15.517298 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc7bd2-42e4-4cee-805f-51016da94380 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:15.517599 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc7bd2-42e4-4cee-805f-51016da94380 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:15.517865 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc7bd2-42e4-4cee-805f-51016da94380 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:15.518510 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc7bd2-42e4-4cee-805f-51016da94380 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:15.520009 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc7bd2-42e4-4cee-805f-51016da94380 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:15.556946 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 133/245] 10.222.0.94 () {60 vars in 1132 bytes} [Thu Sep 1 17:13:15 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:13:15.556946 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc7bd2-42e4-4cee-805f-51016da94380 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:15.606625 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f52a2-a5ca-4232-b838-682d5c608055 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:15.674683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5fc2b-56b5-4008-b043-80cb5e1366a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:15.675333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5fc2b-56b5-4008-b043-80cb5e1366a7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:15.675606 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5fc2b-56b5-4008-b043-80cb5e1366a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:15.675872 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5fc2b-56b5-4008-b043-80cb5e1366a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:15.691908 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:15.698649 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5fc2b-56b5-4008-b043-80cb5e1366a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:15.699239 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:15.712688 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-cff5fc2b-56b5-4008-b043-80cb5e1366a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:13:15.712688 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:15.712688 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:15.712688 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:15.712688 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:15.712688 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:15.712688 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:15.712688 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:15.712688 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:15.712688 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:15.712688 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:15.712688 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:15.712688 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:15.712688 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:15.712688 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:15.712688 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:15.714102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:15.714102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:15.714102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:15.714102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:15.714102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:15.714102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:15.714102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:15.714102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:15.714102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:15.714102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:15.714102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:15.714102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:15.714102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:15.714102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:15.714102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:15.714102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:15.715212 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:15.715212 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:15.715212 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:15.715212 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:15.715212 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:15.715212 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:15.715212 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:15.715212 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:15.715212 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:15.715212 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:15.715212 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:13:15.715212 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:15.719778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 113/246] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:15.726490 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5fc2b-56b5-4008-b043-80cb5e1366a7 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:15.767753 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc7bd2-42e4-4cee-805f-51016da94380 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:15.832361 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446dc6d5-daa3-4b4e-9477-041118670923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:15.833338 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446dc6d5-daa3-4b4e-9477-041118670923 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:15.834201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446dc6d5-daa3-4b4e-9477-041118670923 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:15.834703 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446dc6d5-daa3-4b4e-9477-041118670923 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:15.870857 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5fc2b-56b5-4008-b043-80cb5e1366a7 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:15.918425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af0e9d-8681-451b-908f-fc175c2e47c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:15.919640 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af0e9d-8681-451b-908f-fc175c2e47c0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:15.920053 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af0e9d-8681-451b-908f-fc175c2e47c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:15.920474 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af0e9d-8681-451b-908f-fc175c2e47c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:15.921265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af0e9d-8681-451b-908f-fc175c2e47c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:15.921726 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af0e9d-8681-451b-908f-fc175c2e47c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:15.923930 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af0e9d-8681-451b-908f-fc175c2e47c0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:15.928540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446dc6d5-daa3-4b4e-9477-041118670923 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:15.930389 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446dc6d5-daa3-4b4e-9477-041118670923 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:15.935098 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 114/247] 10.222.0.94 () {56 vars in 1101 bytes} [Thu Sep 1 17:13:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:15.941596 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af0e9d-8681-451b-908f-fc175c2e47c0 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:16.015690 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:16.027566 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:16.069713 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 134/248] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:13:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:13:16.070216 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af0e9d-8681-451b-908f-fc175c2e47c0 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:16.074874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb4dfc-b5f5-4374-9dc3-e7bd2aadf91d None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:16.075224 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb4dfc-b5f5-4374-9dc3-e7bd2aadf91d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:16.075754 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb4dfc-b5f5-4374-9dc3-e7bd2aadf91d None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:16.077104 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 135/249] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:16.079948 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb4dfc-b5f5-4374-9dc3-e7bd2aadf91d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:16.122459 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39305a05-102a-45fb-acab-c5b79cfd5608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:16.123026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39305a05-102a-45fb-acab-c5b79cfd5608 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:16.123301 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39305a05-102a-45fb-acab-c5b79cfd5608 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:16.123570 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39305a05-102a-45fb-acab-c5b79cfd5608 None admin] PATH_INFO: `/v3/users/5047f266f4444687a4de010ef6d48607` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:16.125521 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39305a05-102a-45fb-acab-c5b79cfd5608 None admin] RBAC: Authorizing `identity:get_user(user_id=5047f266f4444687a4de010ef6d48607)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:16.127036 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39305a05-102a-45fb-acab-c5b79cfd5608 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:16.128795 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 115/250] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:13:15 2022] GET /identity/v3/users/5047f266f4444687a4de010ef6d48607 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:16.130160 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd55609-ae2f-4dd9-b293-12e2aab536ed None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:16.130581 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd55609-ae2f-4dd9-b293-12e2aab536ed None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:16.130987 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd55609-ae2f-4dd9-b293-12e2aab536ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:16.151541 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9bd55609-ae2f-4dd9-b293-12e2aab536ed None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:16.153132 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9bd55609-ae2f-4dd9-b293-12e2aab536ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:16.213457 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb4dfc-b5f5-4374-9dc3-e7bd2aadf91d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:16.238514 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 116/251] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:16.239451 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd55609-ae2f-4dd9-b293-12e2aab536ed None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:16.252477 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49af14e-04b5-47d3-acff-1296d59d4354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:16.253385 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49af14e-04b5-47d3-acff-1296d59d4354 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:16.253859 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49af14e-04b5-47d3-acff-1296d59d4354 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:16.254300 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49af14e-04b5-47d3-acff-1296d59d4354 None admin] PATH_INFO: `/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:16.255616 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49af14e-04b5-47d3-acff-1296d59d4354 None admin] RBAC: Authorizing `identity:get_project(project_id=13936e7054f44ceebcd8d6dfa85eb8a7)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:16.257247 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49af14e-04b5-47d3-acff-1296d59d4354 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:16.259361 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 136/252] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:16 2022] GET /identity/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:16.260736 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2566464-41f4-46eb-beea-f635a18b4c7d None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:16.261193 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2566464-41f4-46eb-beea-f635a18b4c7d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:16.261678 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2566464-41f4-46eb-beea-f635a18b4c7d None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:16.263345 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 137/253] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:16.265498 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2566464-41f4-46eb-beea-f635a18b4c7d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:16.309079 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:16.313877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:16.358579 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd55609-ae2f-4dd9-b293-12e2aab536ed None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:16.395008 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d0c40-eac4-4ad9-aff2-2cbd5fd7092d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:16.396075 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d0c40-eac4-4ad9-aff2-2cbd5fd7092d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:16.396531 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d0c40-eac4-4ad9-aff2-2cbd5fd7092d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:16.396978 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d0c40-eac4-4ad9-aff2-2cbd5fd7092d None admin] PATH_INFO: `/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:16.398315 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d0c40-eac4-4ad9-aff2-2cbd5fd7092d None admin] RBAC: Authorizing `identity:get_project(project_id=13936e7054f44ceebcd8d6dfa85eb8a7)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:16.400308 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d0c40-eac4-4ad9-aff2-2cbd5fd7092d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:16.400415 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2566464-41f4-46eb-beea-f635a18b4c7d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:16.402759 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 117/254] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:16 2022] GET /identity/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:16.404112 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475f31f-9ed1-42f8-9142-4c0b0f9b2eed None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:16.404574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475f31f-9ed1-42f8-9142-4c0b0f9b2eed None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:16.405043 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475f31f-9ed1-42f8-9142-4c0b0f9b2eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:16.424208 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-1475f31f-9ed1-42f8-9142-4c0b0f9b2eed None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:16.425826 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1475f31f-9ed1-42f8-9142-4c0b0f9b2eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:16.470965 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd7edf-99ab-4b99-be94-da2b0545ab83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:16.471588 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd7edf-99ab-4b99-be94-da2b0545ab83 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:16.471866 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd7edf-99ab-4b99-be94-da2b0545ab83 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:16.472145 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd7edf-99ab-4b99-be94-da2b0545ab83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:16.472871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd7edf-99ab-4b99-be94-da2b0545ab83 None admin] RBAC: Adding query filter params (role.id=1052488681f94c6f8039fa871f46daa9, scope.project.id=13936e7054f44ceebcd8d6dfa85eb8a7, user.id=6946723909e1481f8fcaefedcdc1f2b4) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:16.473340 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd7edf-99ab-4b99-be94-da2b0545ab83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:16.474942 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd7edf-99ab-4b99-be94-da2b0545ab83 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:16.487711 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 138/255] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:13:16 2022] GET /identity/v3/role_assignments?user.id=6946723909e1481f8fcaefedcdc1f2b4&scope.project.id=13936e7054f44ceebcd8d6dfa85eb8a7&role.id=1052488681f94c6f8039fa871f46daa9 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:16.488698 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd7edf-99ab-4b99-be94-da2b0545ab83 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:16.512149 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 118/256] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:16.611243 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475f31f-9ed1-42f8-9142-4c0b0f9b2eed None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:16.629442 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd7edf-99ab-4b99-be94-da2b0545ab83 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:16.630710 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:16.679061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7760d0-a9ab-4e1c-8828-41baa50691c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:16.680133 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7760d0-a9ab-4e1c-8828-41baa50691c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:16.680616 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7760d0-a9ab-4e1c-8828-41baa50691c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:16.681089 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7760d0-a9ab-4e1c-8828-41baa50691c6 None admin] PATH_INFO: `/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7/users/5047f266f4444687a4de010ef6d48607/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:16.684377 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7760d0-a9ab-4e1c-8828-41baa50691c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=13936e7054f44ceebcd8d6dfa85eb8a7, user_id=5047f266f4444687a4de010ef6d48607, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:16.686379 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7760d0-a9ab-4e1c-8828-41baa50691c6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:16.704921 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 139/257] 10.222.0.94 () {58 vars in 1439 bytes} [Thu Sep 1 17:13:16 2022] PUT /identity/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7/users/5047f266f4444687a4de010ef6d48607/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:13:16.741798 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:16.814212 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475f31f-9ed1-42f8-9142-4c0b0f9b2eed None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:16.859985 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e9e7f-eef2-487e-a5a6-9bf9c20ea3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:16.860621 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e9e7f-eef2-487e-a5a6-9bf9c20ea3f4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:16.860896 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e9e7f-eef2-487e-a5a6-9bf9c20ea3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:16.861163 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e9e7f-eef2-487e-a5a6-9bf9c20ea3f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:16.878563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e9e7f-eef2-487e-a5a6-9bf9c20ea3f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:16.883409 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-793e9e7f-eef2-487e-a5a6-9bf9c20ea3f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:13:16.883409 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:16.883409 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:16.883409 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:16.883409 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:16.883409 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:16.883409 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:16.883409 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:16.883409 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:16.883409 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:16.883409 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:16.883409 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:16.883409 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:16.883409 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:16.883409 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:16.883409 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:16.884303 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:16.884303 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:16.884303 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:16.884303 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:16.884303 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:16.884303 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:16.884303 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:16.884303 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:16.884303 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:16.884303 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:16.884303 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:16.884303 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:16.884303 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:16.884303 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:16.884303 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:16.884303 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:16.885709 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:16.885709 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:16.885709 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:16.885709 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:16.885709 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:16.885709 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:16.885709 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:16.885709 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:16.885709 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:16.885709 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:16.885709 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:13:16.885709 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:16.885709 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 119/258] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:13:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:16.890995 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7760d0-a9ab-4e1c-8828-41baa50691c6 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:16.960967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e9e7f-eef2-487e-a5a6-9bf9c20ea3f4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:17.024066 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7760d0-a9ab-4e1c-8828-41baa50691c6 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:17.061783 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e04d9-6b4e-47ff-8ba6-25dc5f4057b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:17.062779 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e04d9-6b4e-47ff-8ba6-25dc5f4057b4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:17.063258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e04d9-6b4e-47ff-8ba6-25dc5f4057b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:17.063726 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e04d9-6b4e-47ff-8ba6-25dc5f4057b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:17.064689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e04d9-6b4e-47ff-8ba6-25dc5f4057b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:17.065204 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e04d9-6b4e-47ff-8ba6-25dc5f4057b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:17.066930 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e04d9-6b4e-47ff-8ba6-25dc5f4057b4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:17.077564 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 140/259] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:17.082898 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e04d9-6b4e-47ff-8ba6-25dc5f4057b4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:17.116495 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:17.191585 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e9e7f-eef2-487e-a5a6-9bf9c20ea3f4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:17.207376 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e04d9-6b4e-47ff-8ba6-25dc5f4057b4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:17.231343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:17.248900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f589921-a708-4fc6-926e-4deae6e8bf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:17.250462 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f589921-a708-4fc6-926e-4deae6e8bf3e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:17.250946 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f589921-a708-4fc6-926e-4deae6e8bf3e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:17.251458 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f589921-a708-4fc6-926e-4deae6e8bf3e None admin] PATH_INFO: `/v3/users/ac5e98c524cf4fcbaccc18bf72ae8217` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:17.252795 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f589921-a708-4fc6-926e-4deae6e8bf3e None admin] RBAC: Authorizing `identity:get_user(user_id=ac5e98c524cf4fcbaccc18bf72ae8217)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:17.254981 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f589921-a708-4fc6-926e-4deae6e8bf3e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:17.257129 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 141/260] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:13:17 2022] GET /identity/v3/users/ac5e98c524cf4fcbaccc18bf72ae8217 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:17.263120 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f589921-a708-4fc6-926e-4deae6e8bf3e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:17.290195 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea6a60-2740-45bc-96a5-10f049770675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:17.290854 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea6a60-2740-45bc-96a5-10f049770675 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:17.291130 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea6a60-2740-45bc-96a5-10f049770675 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:17.291400 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea6a60-2740-45bc-96a5-10f049770675 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:17.314453 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea6a60-2740-45bc-96a5-10f049770675 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:17.319609 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-92ea6a60-2740-45bc-96a5-10f049770675 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:13:17.319609 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:17.319609 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:17.319609 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:17.319609 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:17.319609 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:17.319609 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:17.319609 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:17.319609 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:17.319609 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:17.319609 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:17.319609 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:17.319609 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:17.319609 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:17.319609 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:17.319609 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:17.320500 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:17.320500 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:17.320500 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:17.320500 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:17.320500 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:17.320500 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:17.320500 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:17.320500 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:17.320500 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:17.320500 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:17.320500 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:17.320500 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:17.320500 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:17.320500 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:17.320500 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:17.320500 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:17.321897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:17.321897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:17.321897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:17.321897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:17.321897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:17.321897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:17.321897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:17.321897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:17.321897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:17.321897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:17.321897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:13:17.321897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:17.321897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 120/261] 10.222.0.94 () {56 vars in 1114 bytes} [Thu Sep 1 17:13:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:17.326718 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea6a60-2740-45bc-96a5-10f049770675 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:17.378511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:17.388631 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f589921-a708-4fc6-926e-4deae6e8bf3e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:17.428631 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f250774-b831-4c76-92c2-39ace225d40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:17.429658 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f250774-b831-4c76-92c2-39ace225d40c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:17.430187 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f250774-b831-4c76-92c2-39ace225d40c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:17.430678 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f250774-b831-4c76-92c2-39ace225d40c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:17.512922 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f250774-b831-4c76-92c2-39ace225d40c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:17.515187 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f250774-b831-4c76-92c2-39ace225d40c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:17.633463 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:17.635455 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea6a60-2740-45bc-96a5-10f049770675 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:17.644404 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 142/262] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:13:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 17:13:17.662772 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f250774-b831-4c76-92c2-39ace225d40c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:17.685129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef86d8-50c7-4815-a797-acd8c62742d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:17.685771 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef86d8-50c7-4815-a797-acd8c62742d9 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:17.686051 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef86d8-50c7-4815-a797-acd8c62742d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:17.686323 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef86d8-50c7-4815-a797-acd8c62742d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:17.686989 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef86d8-50c7-4815-a797-acd8c62742d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:17.687311 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef86d8-50c7-4815-a797-acd8c62742d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:17.688670 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef86d8-50c7-4815-a797-acd8c62742d9 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:17.705286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 121/263] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:13:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:17.710738 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef86d8-50c7-4815-a797-acd8c62742d9 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:17.753119 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:17.781103 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f250774-b831-4c76-92c2-39ace225d40c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:17.813950 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef86d8-50c7-4815-a797-acd8c62742d9 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:17.818544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83313c9-0dbf-4d83-a233-8dd8e620cfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:17.819492 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83313c9-0dbf-4d83-a233-8dd8e620cfa7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:17.820001 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83313c9-0dbf-4d83-a233-8dd8e620cfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:17.820468 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83313c9-0dbf-4d83-a233-8dd8e620cfa7 None admin] PATH_INFO: `/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:17.821908 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83313c9-0dbf-4d83-a233-8dd8e620cfa7 None admin] RBAC: Authorizing `identity:get_project(project_id=13936e7054f44ceebcd8d6dfa85eb8a7)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:17.823684 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83313c9-0dbf-4d83-a233-8dd8e620cfa7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:17.826837 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 143/264] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:17 2022] GET /identity/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:13:17.835044 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83313c9-0dbf-4d83-a233-8dd8e620cfa7 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:17.859079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6047eb6-ed02-418c-a63b-7fdb7835d301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:17.860027 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6047eb6-ed02-418c-a63b-7fdb7835d301 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:17.860027 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6047eb6-ed02-418c-a63b-7fdb7835d301 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:17.860232 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6047eb6-ed02-418c-a63b-7fdb7835d301 None admin] PATH_INFO: `/v3/users/ac5e98c524cf4fcbaccc18bf72ae8217` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:17.861369 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6047eb6-ed02-418c-a63b-7fdb7835d301 None admin] RBAC: Authorizing `identity:get_user(user_id=ac5e98c524cf4fcbaccc18bf72ae8217)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:17.862843 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6047eb6-ed02-418c-a63b-7fdb7835d301 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:17.864698 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 122/265] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:13:17 2022] GET /identity/v3/users/ac5e98c524cf4fcbaccc18bf72ae8217 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:13:17.870098 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6047eb6-ed02-418c-a63b-7fdb7835d301 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:17.907970 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:17.952625 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83313c9-0dbf-4d83-a233-8dd8e620cfa7 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:17.972741 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6047eb6-ed02-418c-a63b-7fdb7835d301 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:17.980030 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:18.008622 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068284f-bcfc-44bb-9a87-0990da9e966b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:18.009242 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068284f-bcfc-44bb-9a87-0990da9e966b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:18.009548 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068284f-bcfc-44bb-9a87-0990da9e966b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:18.009919 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068284f-bcfc-44bb-9a87-0990da9e966b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:18.015760 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4fee6-ea03-4d12-a07e-2518bc080995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:18.016634 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4fee6-ea03-4d12-a07e-2518bc080995 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:18.017122 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4fee6-ea03-4d12-a07e-2518bc080995 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:18.017615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4fee6-ea03-4d12-a07e-2518bc080995 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:18.018542 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4fee6-ea03-4d12-a07e-2518bc080995 None admin] RBAC: Adding query filter params (role.id=70f911a75b7b40a19f65857b9d19cfad, scope.project.id=13936e7054f44ceebcd8d6dfa85eb8a7, user.id=ac5e98c524cf4fcbaccc18bf72ae8217) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:18.019096 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4fee6-ea03-4d12-a07e-2518bc080995 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:18.020732 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4fee6-ea03-4d12-a07e-2518bc080995 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:18.035528 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 144/266] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:13:17 2022] GET /identity/v3/role_assignments?user.id=ac5e98c524cf4fcbaccc18bf72ae8217&scope.project.id=13936e7054f44ceebcd8d6dfa85eb8a7&role.id=70f911a75b7b40a19f65857b9d19cfad => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:13:18.096802 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068284f-bcfc-44bb-9a87-0990da9e966b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:18.098322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068284f-bcfc-44bb-9a87-0990da9e966b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:18.206709 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 123/267] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:13:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 17:13:18.212325 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4fee6-ea03-4d12-a07e-2518bc080995 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:18.345385 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4fee6-ea03-4d12-a07e-2518bc080995 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:18.377777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:18.392830 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0d2b1-eeb5-4815-9841-00c31366f6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:18.393581 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0d2b1-eeb5-4815-9841-00c31366f6e9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:18.393767 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0d2b1-eeb5-4815-9841-00c31366f6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:18.394042 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0d2b1-eeb5-4815-9841-00c31366f6e9 None admin] PATH_INFO: `/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:18.395191 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0d2b1-eeb5-4815-9841-00c31366f6e9 None admin] RBAC: Authorizing `identity:get_project(project_id=13936e7054f44ceebcd8d6dfa85eb8a7)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:18.396641 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0d2b1-eeb5-4815-9841-00c31366f6e9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:18.398296 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 145/268] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:18 2022] GET /identity/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:18.404532 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068284f-bcfc-44bb-9a87-0990da9e966b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:18.417433 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:18.533547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068284f-bcfc-44bb-9a87-0990da9e966b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:18.580753 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37c888-740d-4064-8500-b802e5db911e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:18.581685 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37c888-740d-4064-8500-b802e5db911e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:18.582135 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37c888-740d-4064-8500-b802e5db911e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:18.582600 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37c888-740d-4064-8500-b802e5db911e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:18.583490 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37c888-740d-4064-8500-b802e5db911e None admin] RBAC: Adding query filter params (role.id=9131e2ca337e4d1286ef32a4ba63cafa, scope.project.id=13936e7054f44ceebcd8d6dfa85eb8a7, user.id=ac5e98c524cf4fcbaccc18bf72ae8217) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:18.583966 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37c888-740d-4064-8500-b802e5db911e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:18.585613 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37c888-740d-4064-8500-b802e5db911e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:18.598392 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 124/269] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:13:18 2022] GET /identity/v3/role_assignments?user.id=ac5e98c524cf4fcbaccc18bf72ae8217&scope.project.id=13936e7054f44ceebcd8d6dfa85eb8a7&role.id=9131e2ca337e4d1286ef32a4ba63cafa => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:18.633179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9c0e1-5765-409b-a0f2-b0a0c18f50fe None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:18.633486 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9c0e1-5765-409b-a0f2-b0a0c18f50fe None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:18.633926 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9c0e1-5765-409b-a0f2-b0a0c18f50fe None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:18.635523 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 146/270] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:18.641874 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a2f53-ab79-4d18-bfc5-132a77621adb None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:18.642213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a2f53-ab79-4d18-bfc5-132a77621adb None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:18.642416 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a2f53-ab79-4d18-bfc5-132a77621adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:18.667406 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-bb2a2f53-ab79-4d18-bfc5-132a77621adb None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:18.669215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bb2a2f53-ab79-4d18-bfc5-132a77621adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:18.766685 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:18.771820 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 125/271] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:18.923895 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39c4b3-855b-4053-b17f-daafa171ab92 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:18.924563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39c4b3-855b-4053-b17f-daafa171ab92 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:18.925063 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39c4b3-855b-4053-b17f-daafa171ab92 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:18.926924 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 147/272] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:18.940767 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65270f4d-8f58-42d8-a360-f5c528c96513 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:18.941048 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65270f4d-8f58-42d8-a360-f5c528c96513 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:18.941317 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65270f4d-8f58-42d8-a360-f5c528c96513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:18.962810 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-65270f4d-8f58-42d8-a360-f5c528c96513 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:18.964018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-65270f4d-8f58-42d8-a360-f5c528c96513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:19.042125 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 126/273] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:19.072701 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39c4b3-855b-4053-b17f-daafa171ab92 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:19.186403 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39c4b3-855b-4053-b17f-daafa171ab92 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:19.230382 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f928d7-d874-4450-ace8-da527743f97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:19.231906 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f928d7-d874-4450-ace8-da527743f97b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:19.232387 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f928d7-d874-4450-ace8-da527743f97b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:19.232878 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f928d7-d874-4450-ace8-da527743f97b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:19.234226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f928d7-d874-4450-ace8-da527743f97b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:19.235998 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f928d7-d874-4450-ace8-da527743f97b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:19.237828 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 148/274] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:13:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:19.246560 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65270f4d-8f58-42d8-a360-f5c528c96513 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:19.335916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017022ab-f34d-44b5-a978-1631d78cf26e None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:19.336941 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017022ab-f34d-44b5-a978-1631d78cf26e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:19.337902 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017022ab-f34d-44b5-a978-1631d78cf26e None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:19.339881 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 149/275] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:19.350806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815aaa34-da76-41d5-926b-7c19fb619dd6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:19.351085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815aaa34-da76-41d5-926b-7c19fb619dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:19.351345 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815aaa34-da76-41d5-926b-7c19fb619dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:19.361263 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65270f4d-8f58-42d8-a360-f5c528c96513 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:19.373526 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-815aaa34-da76-41d5-926b-7c19fb619dd6 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:19.374728 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-815aaa34-da76-41d5-926b-7c19fb619dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:19.392059 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:19.398532 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc9b69-757a-4382-8071-d7c0ab56b4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:19.399148 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc9b69-757a-4382-8071-d7c0ab56b4be None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:19.399425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc9b69-757a-4382-8071-d7c0ab56b4be None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:19.399702 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc9b69-757a-4382-8071-d7c0ab56b4be None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:19.400354 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc9b69-757a-4382-8071-d7c0ab56b4be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:19.401826 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc9b69-757a-4382-8071-d7c0ab56b4be None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:19.426397 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 127/276] 10.222.0.94 () {60 vars in 1132 bytes} [Thu Sep 1 17:13:19 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:13:19.428086 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc9b69-757a-4382-8071-d7c0ab56b4be None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:19.457312 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:19.481442 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 150/277] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:19.570022 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc9b69-757a-4382-8071-d7c0ab56b4be None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:19.605666 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16daa63c-5846-4344-b320-0f2a81667cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:19.606362 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16daa63c-5846-4344-b320-0f2a81667cfa None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:19.607147 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16daa63c-5846-4344-b320-0f2a81667cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:19.607418 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16daa63c-5846-4344-b320-0f2a81667cfa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:19.618065 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16daa63c-5846-4344-b320-0f2a81667cfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:19.624178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-16daa63c-5846-4344-b320-0f2a81667cfa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:13:19.624178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:19.624178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:19.624178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:19.624178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:19.624178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:19.624178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:19.624178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:19.624178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:19.624178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:19.624178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:19.624178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:19.624178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:19.624178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:19.624178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:19.624178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:19.625234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:19.625234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:19.625234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:19.625234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:19.625234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:19.625234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:19.625234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:19.625234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:19.625234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:19.625234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:19.625234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:19.625234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:19.625234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:19.625234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:19.625234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:19.625234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:19.626083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:19.626083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:19.626083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:19.626083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:19.626083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:19.626083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:19.626083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:19.626083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:19.626083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:19.626083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:19.626083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:13:19.626083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:19.628113 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 128/278] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:19.632002 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815aaa34-da76-41d5-926b-7c19fb619dd6 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:19.665219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e49f7-45f9-4ba5-a7ce-017ce3be3de4 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:19.665500 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e49f7-45f9-4ba5-a7ce-017ce3be3de4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:19.665777 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e49f7-45f9-4ba5-a7ce-017ce3be3de4 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:19.667374 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 129/279] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:13:19.672850 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7d212-c062-45a0-a076-f696a48229b2 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:19.673130 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7d212-c062-45a0-a076-f696a48229b2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:19.673439 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7d212-c062-45a0-a076-f696a48229b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:19.694249 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e8d7d212-c062-45a0-a076-f696a48229b2 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:19.695465 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e8d7d212-c062-45a0-a076-f696a48229b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:19.749491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:19.764261 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815aaa34-da76-41d5-926b-7c19fb619dd6 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:19.783781 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 130/280] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:13:19.785048 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7d212-c062-45a0-a076-f696a48229b2 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:19.807029 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a80f3-d091-4d35-a04f-e5695f91a435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:19.807649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a80f3-d091-4d35-a04f-e5695f91a435 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:19.807925 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a80f3-d091-4d35-a04f-e5695f91a435 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:19.808192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a80f3-d091-4d35-a04f-e5695f91a435 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:19.808862 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a80f3-d091-4d35-a04f-e5695f91a435 None admin] RBAC: Adding query filter params (name=member) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:19.809160 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a80f3-d091-4d35-a04f-e5695f91a435 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:19.811317 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a80f3-d091-4d35-a04f-e5695f91a435 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:19.821562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 151/281] 10.222.0.94 () {56 vars in 1101 bytes} [Thu Sep 1 17:13:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:19.829735 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a80f3-d091-4d35-a04f-e5695f91a435 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:19.907399 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:19.909760 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7d212-c062-45a0-a076-f696a48229b2 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:19.953035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e16b6f-290e-4c2a-a366-ca559892a576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:19.954101 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e16b6f-290e-4c2a-a366-ca559892a576 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:19.954583 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e16b6f-290e-4c2a-a366-ca559892a576 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:19.955170 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e16b6f-290e-4c2a-a366-ca559892a576 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:19.958604 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a80f3-d091-4d35-a04f-e5695f91a435 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:19.968030 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e16b6f-290e-4c2a-a366-ca559892a576 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:19.973342 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-44e16b6f-290e-4c2a-a366-ca559892a576 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:13:19.973342 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:19.973342 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:19.973342 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:19.973342 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:19.973342 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:19.973342 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:19.973342 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:19.973342 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:19.973342 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:19.973342 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:19.973342 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:19.973342 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:19.973342 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:19.973342 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:19.973342 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:19.974215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:19.974215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:19.974215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:19.974215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:19.974215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:19.974215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:19.974215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:19.974215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:19.974215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:19.974215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:19.974215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:19.974215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:19.974215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:19.974215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:19.974215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:19.974215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:19.975055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:19.975055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:19.975055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:19.975055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:19.975055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:19.975055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:19.975055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:19.975055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:19.975055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:19.975055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:19.975055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:13:19.975055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:19.977645 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 131/282] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:19.986629 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e16b6f-290e-4c2a-a366-ca559892a576 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:19.996618 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef3b8c-26da-4252-9991-7fb576f99628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:19.997292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef3b8c-26da-4252-9991-7fb576f99628 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:20.001569 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef3b8c-26da-4252-9991-7fb576f99628 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:20.001569 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef3b8c-26da-4252-9991-7fb576f99628 None admin] PATH_INFO: `/v3/users/18d1d3b193424646a6ca47bd4cb62a75` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:20.021441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef3b8c-26da-4252-9991-7fb576f99628 None admin] RBAC: Authorizing `identity:get_user(user_id=18d1d3b193424646a6ca47bd4cb62a75)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:20.021441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef3b8c-26da-4252-9991-7fb576f99628 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:20.021441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 152/283] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:13:19 2022] GET /identity/v3/users/18d1d3b193424646a6ca47bd4cb62a75 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:20.022616 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef3b8c-26da-4252-9991-7fb576f99628 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:20.047195 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:20.129816 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e16b6f-290e-4c2a-a366-ca559892a576 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:20.166346 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abba82-336b-4be1-a3b7-9a293de22048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:20.167299 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abba82-336b-4be1-a3b7-9a293de22048 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:20.167817 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abba82-336b-4be1-a3b7-9a293de22048 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:20.168278 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abba82-336b-4be1-a3b7-9a293de22048 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:20.169215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65abba82-336b-4be1-a3b7-9a293de22048 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:20.169734 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65abba82-336b-4be1-a3b7-9a293de22048 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:20.171901 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65abba82-336b-4be1-a3b7-9a293de22048 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:20.180691 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 132/284] 10.222.0.94 () {56 vars in 1101 bytes} [Thu Sep 1 17:13:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:20.181803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abba82-336b-4be1-a3b7-9a293de22048 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:20.197852 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef3b8c-26da-4252-9991-7fb576f99628 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:20.214463 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:20.237482 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abdbe54-c24e-4ef7-84b8-9a0727d1f089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:20.238481 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdbe54-c24e-4ef7-84b8-9a0727d1f089 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:20.238952 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdbe54-c24e-4ef7-84b8-9a0727d1f089 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:20.239520 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdbe54-c24e-4ef7-84b8-9a0727d1f089 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:20.240538 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abdbe54-c24e-4ef7-84b8-9a0727d1f089 None admin] RBAC: Adding query filter params (role.id=a78fbf73b27d4781ac14690bbcb1cd9f, user.id=18d1d3b193424646a6ca47bd4cb62a75, scope.system=all) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:20.241036 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abdbe54-c24e-4ef7-84b8-9a0727d1f089 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:20.242690 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abdbe54-c24e-4ef7-84b8-9a0727d1f089 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:20.248979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 153/285] 10.222.0.94 () {56 vars in 1308 bytes} [Thu Sep 1 17:13:20 2022] GET /identity/v3/role_assignments?user.id=18d1d3b193424646a6ca47bd4cb62a75&scope.system=all&role.id=a78fbf73b27d4781ac14690bbcb1cd9f => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:20.250151 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abdbe54-c24e-4ef7-84b8-9a0727d1f089 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:20.316349 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:20.323693 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abba82-336b-4be1-a3b7-9a293de22048 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:20.371462 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754fc1c-1979-488c-ba10-b1faec3adc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:20.372653 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754fc1c-1979-488c-ba10-b1faec3adc69 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:20.372928 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754fc1c-1979-488c-ba10-b1faec3adc69 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:20.373257 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754fc1c-1979-488c-ba10-b1faec3adc69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:20.378764 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abdbe54-c24e-4ef7-84b8-9a0727d1f089 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:20.394881 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754fc1c-1979-488c-ba10-b1faec3adc69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:20.400449 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-8754fc1c-1979-488c-ba10-b1faec3adc69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:13:20.400449 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:20.400449 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:20.400449 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:20.400449 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:20.400449 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:20.400449 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:20.400449 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:20.400449 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:20.400449 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:20.400449 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:20.400449 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:20.400449 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:20.400449 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:20.400449 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:20.400449 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:20.401332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:20.401332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:20.401332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:20.401332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:20.401332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:20.401332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:20.401332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:20.401332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:20.401332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:20.401332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:20.401332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:20.401332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:20.401332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:20.401332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:20.401332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:20.401332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:20.402159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:20.402159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:20.402159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:20.402159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:20.402159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:20.402159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:20.402159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:20.402159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:20.402159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:20.402159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:20.402159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:13:20.402159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:20.409943 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 133/286] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:20.415848 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754fc1c-1979-488c-ba10-b1faec3adc69 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:20.421956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fad30-c826-4788-995f-0427a786f32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:20.423034 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fad30-c826-4788-995f-0427a786f32f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:20.423507 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fad30-c826-4788-995f-0427a786f32f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:20.423966 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fad30-c826-4788-995f-0427a786f32f None admin] PATH_INFO: `/v3/users/6946723909e1481f8fcaefedcdc1f2b4` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:20.425300 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75fad30-c826-4788-995f-0427a786f32f None admin] RBAC: Authorizing `identity:get_user(user_id=6946723909e1481f8fcaefedcdc1f2b4)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:20.426992 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75fad30-c826-4788-995f-0427a786f32f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:20.428865 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 154/287] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:13:20 2022] GET /identity/v3/users/6946723909e1481f8fcaefedcdc1f2b4 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:20.435499 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fad30-c826-4788-995f-0427a786f32f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:20.545758 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:20.550069 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fad30-c826-4788-995f-0427a786f32f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:20.586328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333667ad-1934-4851-a75b-b6566f61d4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:20.587025 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333667ad-1934-4851-a75b-b6566f61d4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:20.587408 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333667ad-1934-4851-a75b-b6566f61d4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:20.587781 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333667ad-1934-4851-a75b-b6566f61d4c2 None admin] PATH_INFO: `/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:20.589109 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333667ad-1934-4851-a75b-b6566f61d4c2 None admin] RBAC: Authorizing `identity:get_project(project_id=13936e7054f44ceebcd8d6dfa85eb8a7)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:20.590845 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333667ad-1934-4851-a75b-b6566f61d4c2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:20.592897 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 155/288] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:20 2022] GET /identity/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:20.598136 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333667ad-1934-4851-a75b-b6566f61d4c2 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:20.646643 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754fc1c-1979-488c-ba10-b1faec3adc69 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:20.718144 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715445cc-2de7-48fd-8361-c4ecdd152e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:20.718766 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715445cc-2de7-48fd-8361-c4ecdd152e0f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:20.719041 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715445cc-2de7-48fd-8361-c4ecdd152e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:20.719306 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715445cc-2de7-48fd-8361-c4ecdd152e0f None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:20.719967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715445cc-2de7-48fd-8361-c4ecdd152e0f None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:20.720262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715445cc-2de7-48fd-8361-c4ecdd152e0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:20.721672 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715445cc-2de7-48fd-8361-c4ecdd152e0f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:20.730618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 134/289] 10.222.0.94 () {56 vars in 1101 bytes} [Thu Sep 1 17:13:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:13:20.736613 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715445cc-2de7-48fd-8361-c4ecdd152e0f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:20.780262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:20.804948 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333667ad-1934-4851-a75b-b6566f61d4c2 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:20.833766 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:20.893482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715445cc-2de7-48fd-8361-c4ecdd152e0f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:20.911571 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d3467-c4b3-4255-b7e2-d0a0c35edc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:20.912295 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d3467-c4b3-4255-b7e2-d0a0c35edc96 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:20.912572 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d3467-c4b3-4255-b7e2-d0a0c35edc96 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:20.912839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d3467-c4b3-4255-b7e2-d0a0c35edc96 None admin] PATH_INFO: `/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7/users/6946723909e1481f8fcaefedcdc1f2b4/roles/1052488681f94c6f8039fa871f46daa9` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:20.915823 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d3467-c4b3-4255-b7e2-d0a0c35edc96 None admin] RBAC: Authorizing `identity:create_grant(project_id=13936e7054f44ceebcd8d6dfa85eb8a7, user_id=6946723909e1481f8fcaefedcdc1f2b4, role_id=1052488681f94c6f8039fa871f46daa9)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:20.917273 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d3467-c4b3-4255-b7e2-d0a0c35edc96 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:20.949798 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 156/290] 10.222.0.94 () {58 vars in 1439 bytes} [Thu Sep 1 17:13:20 2022] PUT /identity/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7/users/6946723909e1481f8fcaefedcdc1f2b4/roles/1052488681f94c6f8039fa871f46daa9 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:13:20.954233 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf5f35-5d44-481a-b30f-e8daa4e467d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:20.954889 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf5f35-5d44-481a-b30f-e8daa4e467d6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:20.955166 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf5f35-5d44-481a-b30f-e8daa4e467d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:20.955434 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf5f35-5d44-481a-b30f-e8daa4e467d6 None admin] PATH_INFO: `/v3/users/5047f266f4444687a4de010ef6d48607` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:20.957028 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf5f35-5d44-481a-b30f-e8daa4e467d6 None admin] RBAC: Authorizing `identity:get_user(user_id=5047f266f4444687a4de010ef6d48607)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:20.958863 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf5f35-5d44-481a-b30f-e8daa4e467d6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:20.960917 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 135/291] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:13:20 2022] GET /identity/v3/users/5047f266f4444687a4de010ef6d48607 => generated 297 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:20.967619 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d3467-c4b3-4255-b7e2-d0a0c35edc96 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:21.093002 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d3467-c4b3-4255-b7e2-d0a0c35edc96 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:21.128477 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6612519-d7dc-479a-a40f-ba51bd7e46a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:21.129098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6612519-d7dc-479a-a40f-ba51bd7e46a5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:21.129435 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6612519-d7dc-479a-a40f-ba51bd7e46a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:21.129704 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6612519-d7dc-479a-a40f-ba51bd7e46a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:21.190614 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:21.224283 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6612519-d7dc-479a-a40f-ba51bd7e46a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:21.225831 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6612519-d7dc-479a-a40f-ba51bd7e46a5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:21.350086 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 157/292] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:13:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 17:13:21.355796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf5f35-5d44-481a-b30f-e8daa4e467d6 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:21.449343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:21.462751 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf5f35-5d44-481a-b30f-e8daa4e467d6 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:21.497925 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d433970-c365-4594-89b3-2a0b05227f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:21.498560 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d433970-c365-4594-89b3-2a0b05227f81 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:21.499001 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d433970-c365-4594-89b3-2a0b05227f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:21.499281 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d433970-c365-4594-89b3-2a0b05227f81 None admin] PATH_INFO: `/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:21.500409 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d433970-c365-4594-89b3-2a0b05227f81 None admin] RBAC: Authorizing `identity:get_project(project_id=13936e7054f44ceebcd8d6dfa85eb8a7)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:21.501879 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d433970-c365-4594-89b3-2a0b05227f81 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:21.503816 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 136/293] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:21 2022] GET /identity/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:21.509633 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6612519-d7dc-479a-a40f-ba51bd7e46a5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:21.614653 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:21.644892 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6612519-d7dc-479a-a40f-ba51bd7e46a5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:21.679436 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365888a8-a59e-482d-8f1c-6b66fdd5d373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:21.680044 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365888a8-a59e-482d-8f1c-6b66fdd5d373 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:21.680316 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365888a8-a59e-482d-8f1c-6b66fdd5d373 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:21.680586 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365888a8-a59e-482d-8f1c-6b66fdd5d373 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:21.681304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365888a8-a59e-482d-8f1c-6b66fdd5d373 None admin] RBAC: Adding query filter params (role.id=a78fbf73b27d4781ac14690bbcb1cd9f, scope.project.id=13936e7054f44ceebcd8d6dfa85eb8a7, user.id=5047f266f4444687a4de010ef6d48607) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:21.681691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365888a8-a59e-482d-8f1c-6b66fdd5d373 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:21.683177 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365888a8-a59e-482d-8f1c-6b66fdd5d373 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:21.689597 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 158/294] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:13:21 2022] GET /identity/v3/role_assignments?user.id=5047f266f4444687a4de010ef6d48607&scope.project.id=13936e7054f44ceebcd8d6dfa85eb8a7&role.id=a78fbf73b27d4781ac14690bbcb1cd9f => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:21.871798 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd887201-e6ea-47fd-8338-aa085d976692 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:21.871798 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd887201-e6ea-47fd-8338-aa085d976692 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:21.871798 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd887201-e6ea-47fd-8338-aa085d976692 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:21.873982 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 137/295] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:21.879290 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c75cc-4873-4232-9b17-c9a3349c8138 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:21.879622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c75cc-4873-4232-9b17-c9a3349c8138 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:21.879898 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c75cc-4873-4232-9b17-c9a3349c8138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:21.902481 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-756c75cc-4873-4232-9b17-c9a3349c8138 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:21.904234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-756c75cc-4873-4232-9b17-c9a3349c8138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:21.911879 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276430b-568e-45ce-867c-4727e32465c8 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:21.912158 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276430b-568e-45ce-867c-4727e32465c8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:21.912426 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276430b-568e-45ce-867c-4727e32465c8 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:21.914026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 138/296] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:21.920479 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d6a9e-af92-415c-ab36-fa98b6f64998 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:21.920765 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d6a9e-af92-415c-ab36-fa98b6f64998 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:21.921042 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d6a9e-af92-415c-ab36-fa98b6f64998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:21.948939 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-518d6a9e-af92-415c-ab36-fa98b6f64998 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:21.950416 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-518d6a9e-af92-415c-ab36-fa98b6f64998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:21.986774 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 159/297] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:22.042137 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 139/298] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:22.281834 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c75cc-4873-4232-9b17-c9a3349c8138 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:22.318114 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d6a9e-af92-415c-ab36-fa98b6f64998 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:22.361783 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:22.395534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c75cc-4873-4232-9b17-c9a3349c8138 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:22.433253 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8f0e2-1a05-46e2-b16a-ea84d9b22af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:22.435184 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8f0e2-1a05-46e2-b16a-ea84d9b22af7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:22.435907 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8f0e2-1a05-46e2-b16a-ea84d9b22af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:22.436371 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8f0e2-1a05-46e2-b16a-ea84d9b22af7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:22.437805 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:22.437966 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e8f0e2-1a05-46e2-b16a-ea84d9b22af7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:22.439762 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e8f0e2-1a05-46e2-b16a-ea84d9b22af7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:22.442177 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 160/299] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:13:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:22.446987 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8f0e2-1a05-46e2-b16a-ea84d9b22af7 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:22.458063 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d6a9e-af92-415c-ab36-fa98b6f64998 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:22.504750 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba00c95-01da-4bdd-a470-24df61e64ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:22.505917 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba00c95-01da-4bdd-a470-24df61e64ccd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:22.506445 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba00c95-01da-4bdd-a470-24df61e64ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:22.506932 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba00c95-01da-4bdd-a470-24df61e64ccd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:22.519111 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba00c95-01da-4bdd-a470-24df61e64ccd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:22.524604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-bba00c95-01da-4bdd-a470-24df61e64ccd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:13:22.524604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:22.524604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:22.524604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:22.524604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:22.524604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:22.524604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:22.524604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:22.524604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:22.524604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:22.524604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:22.524604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:22.524604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:22.524604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:22.524604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:22.524604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:22.525518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:22.525518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:22.525518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:22.525518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:22.525518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:22.525518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:22.525518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:22.525518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:22.525518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:22.525518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:22.525518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:22.525518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:22.525518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:22.525518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:22.525518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:22.525518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:22.526347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:22.526347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:22.526347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:22.526347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:22.526347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:22.526347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:22.526347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:22.526347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:22.526347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:22.526347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:22.526347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:13:22.526347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:22.539734 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 140/300] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:13:22.549540 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba00c95-01da-4bdd-a470-24df61e64ccd None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:22.562248 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8f0e2-1a05-46e2-b16a-ea84d9b22af7 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:22.596859 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa828b-c8b9-4a44-802a-2f46e95fbfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:22.597512 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa828b-c8b9-4a44-802a-2f46e95fbfb5 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:22.597793 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa828b-c8b9-4a44-802a-2f46e95fbfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:22.598064 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa828b-c8b9-4a44-802a-2f46e95fbfb5 None admin] PATH_INFO: `/v3/groups` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:22.598697 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa828b-c8b9-4a44-802a-2f46e95fbfb5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:22.600244 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa828b-c8b9-4a44-802a-2f46e95fbfb5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:22.604269 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:22.625451 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 161/301] 10.222.0.94 () {60 vars in 1134 bytes} [Thu Sep 1 17:13:22 2022] POST /identity/v3/groups => generated 229 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:13:22.650471 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd7dc7-9126-4e50-9704-7af2fc5ac2c7 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:22.650774 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd7dc7-9126-4e50-9704-7af2fc5ac2c7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:22.651017 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd7dc7-9126-4e50-9704-7af2fc5ac2c7 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:22.652368 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 162/302] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:13:22.661446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfc053-a32d-4222-9688-432bd5aa7ee7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:22.661446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfc053-a32d-4222-9688-432bd5aa7ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:22.661446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfc053-a32d-4222-9688-432bd5aa7ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:22.678467 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e0dfc053-a32d-4222-9688-432bd5aa7ee7 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:22.679760 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e0dfc053-a32d-4222-9688-432bd5aa7ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:22.687515 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba00c95-01da-4bdd-a470-24df61e64ccd None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:22.738508 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473fa5e-e5c3-427b-94f5-1fe54cd9f10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:22.739451 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473fa5e-e5c3-427b-94f5-1fe54cd9f10c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:22.740164 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473fa5e-e5c3-427b-94f5-1fe54cd9f10c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:22.740737 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473fa5e-e5c3-427b-94f5-1fe54cd9f10c None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:22.741714 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473fa5e-e5c3-427b-94f5-1fe54cd9f10c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:22.742244 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473fa5e-e5c3-427b-94f5-1fe54cd9f10c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:22.743945 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473fa5e-e5c3-427b-94f5-1fe54cd9f10c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:22.755866 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 141/303] 10.222.0.94 () {56 vars in 1101 bytes} [Thu Sep 1 17:13:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:13:22.761446 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473fa5e-e5c3-427b-94f5-1fe54cd9f10c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:22.779980 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:22.786920 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 163/304] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:13:22.875996 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473fa5e-e5c3-427b-94f5-1fe54cd9f10c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:22.911687 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b46a7-d45b-4968-b1d3-7f61306a303a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:22.912329 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b46a7-d45b-4968-b1d3-7f61306a303a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:22.912608 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b46a7-d45b-4968-b1d3-7f61306a303a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:22.912881 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b46a7-d45b-4968-b1d3-7f61306a303a None admin] PATH_INFO: `/v3/users/410ffbc7cfef4d249ec463f32cf0cea6` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:22.926641 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b46a7-d45b-4968-b1d3-7f61306a303a None admin] RBAC: Authorizing `identity:get_user(user_id=410ffbc7cfef4d249ec463f32cf0cea6)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:22.928105 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b46a7-d45b-4968-b1d3-7f61306a303a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:22.930160 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 142/305] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:13:22 2022] GET /identity/v3/users/410ffbc7cfef4d249ec463f32cf0cea6 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:13:22.935916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dfc053-a32d-4222-9688-432bd5aa7ee7 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:23.043786 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dfc053-a32d-4222-9688-432bd5aa7ee7 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:23.079498 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:23.091077 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42c3f2-75d0-4479-aca5-a50db5c02f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:23.091720 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42c3f2-75d0-4479-aca5-a50db5c02f9e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:23.092180 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42c3f2-75d0-4479-aca5-a50db5c02f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:23.092454 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42c3f2-75d0-4479-aca5-a50db5c02f9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:23.093259 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42c3f2-75d0-4479-aca5-a50db5c02f9e None admin] RBAC: Adding query filter params (role.id=1052488681f94c6f8039fa871f46daa9, user.id=410ffbc7cfef4d249ec463f32cf0cea6, scope.system=all) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:23.093596 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42c3f2-75d0-4479-aca5-a50db5c02f9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:23.095046 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42c3f2-75d0-4479-aca5-a50db5c02f9e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:23.100841 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 164/306] 10.222.0.94 () {56 vars in 1308 bytes} [Thu Sep 1 17:13:22 2022] GET /identity/v3/role_assignments?user.id=410ffbc7cfef4d249ec463f32cf0cea6&scope.system=all&role.id=1052488681f94c6f8039fa871f46daa9 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:23.111864 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b46a7-d45b-4968-b1d3-7f61306a303a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:23.195187 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:23.234234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b46a7-d45b-4968-b1d3-7f61306a303a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:23.270044 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710211a-63e6-4ca4-a7db-6d2c39ebfad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:23.270681 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710211a-63e6-4ca4-a7db-6d2c39ebfad8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:23.270962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710211a-63e6-4ca4-a7db-6d2c39ebfad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:23.271237 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710211a-63e6-4ca4-a7db-6d2c39ebfad8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:23.282680 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710211a-63e6-4ca4-a7db-6d2c39ebfad8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:23.288092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-0710211a-63e6-4ca4-a7db-6d2c39ebfad8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:13:23.288092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:23.288092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:23.288092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:23.288092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:23.288092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:23.288092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:23.288092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:23.288092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:23.288092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:23.288092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:23.288092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:23.288092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:23.288092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:23.288092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:23.288092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:23.288972 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:23.288972 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:23.288972 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:23.288972 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:23.288972 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:23.288972 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:23.288972 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:23.288972 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:23.288972 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:23.288972 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:23.288972 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:23.288972 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:23.288972 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:23.288972 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:23.288972 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:23.288972 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:23.289814 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:23.289814 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:23.289814 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:23.289814 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:23.289814 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:23.289814 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:23.289814 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:23.289814 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:23.289814 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:23.289814 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:23.289814 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:13:23.289814 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:23.289814 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 143/307] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:23.295998 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42c3f2-75d0-4479-aca5-a50db5c02f9e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:23.394367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a3cb8-b960-4cd1-9cd4-558adc357b9e None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:23.394725 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a3cb8-b960-4cd1-9cd4-558adc357b9e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:23.394909 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a3cb8-b960-4cd1-9cd4-558adc357b9e None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:23.397496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 144/308] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:23.401567 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09656500-dfc8-4b3c-b9f2-67cdf85c8ff2 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:23.401929 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42c3f2-75d0-4479-aca5-a50db5c02f9e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:23.402078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09656500-dfc8-4b3c-b9f2-67cdf85c8ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:23.402155 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09656500-dfc8-4b3c-b9f2-67cdf85c8ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:23.420414 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-09656500-dfc8-4b3c-b9f2-67cdf85c8ff2 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:23.421646 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-09656500-dfc8-4b3c-b9f2-67cdf85c8ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:23.445647 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6436c00-fd94-40ac-bea6-97c5dad78559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:23.446583 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6436c00-fd94-40ac-bea6-97c5dad78559 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:23.446871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6436c00-fd94-40ac-bea6-97c5dad78559 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:23.447146 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6436c00-fd94-40ac-bea6-97c5dad78559 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:23.447983 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6436c00-fd94-40ac-bea6-97c5dad78559 None admin] RBAC: Adding query filter params (name=member) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:23.448691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6436c00-fd94-40ac-bea6-97c5dad78559 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:23.450681 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6436c00-fd94-40ac-bea6-97c5dad78559 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:23.462157 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 165/309] 10.222.0.94 () {56 vars in 1101 bytes} [Thu Sep 1 17:13:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:23.468168 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6436c00-fd94-40ac-bea6-97c5dad78559 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:23.492529 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 145/310] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:13:23.520740 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:23.573681 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6436c00-fd94-40ac-bea6-97c5dad78559 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:23.608735 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd2c04-40d0-4c47-a25f-ebc3ef7bf4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:23.609368 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd2c04-40d0-4c47-a25f-ebc3ef7bf4da None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:23.609675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd2c04-40d0-4c47-a25f-ebc3ef7bf4da None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:23.609949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd2c04-40d0-4c47-a25f-ebc3ef7bf4da None admin] PATH_INFO: `/v3/users/18d1d3b193424646a6ca47bd4cb62a75` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:23.611091 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd2c04-40d0-4c47-a25f-ebc3ef7bf4da None admin] RBAC: Authorizing `identity:get_user(user_id=18d1d3b193424646a6ca47bd4cb62a75)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:23.612544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd2c04-40d0-4c47-a25f-ebc3ef7bf4da None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:23.614566 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 166/311] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:13:23 2022] GET /identity/v3/users/18d1d3b193424646a6ca47bd4cb62a75 => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:13:23.620210 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09656500-dfc8-4b3c-b9f2-67cdf85c8ff2 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:23.676603 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:23.721388 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09656500-dfc8-4b3c-b9f2-67cdf85c8ff2 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:23.756492 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4655b9-6cb6-4c98-817e-b298366291c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:23.757510 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4655b9-6cb6-4c98-817e-b298366291c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:23.757987 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4655b9-6cb6-4c98-817e-b298366291c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:23.758454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4655b9-6cb6-4c98-817e-b298366291c6 None admin] PATH_INFO: `/v3/system/users/18d1d3b193424646a6ca47bd4cb62a75/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:23.760120 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4655b9-6cb6-4c98-817e-b298366291c6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=18d1d3b193424646a6ca47bd4cb62a75, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:23.761712 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4655b9-6cb6-4c98-817e-b298366291c6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:23.774732 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 146/312] 10.222.0.94 () {58 vars in 1334 bytes} [Thu Sep 1 17:13:23 2022] PUT /identity/v3/system/users/18d1d3b193424646a6ca47bd4cb62a75/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:13:23.805716 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd2c04-40d0-4c47-a25f-ebc3ef7bf4da None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:23.927331 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd2c04-40d0-4c47-a25f-ebc3ef7bf4da None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:23.945611 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:23.965089 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e253fb8-f9e1-4456-9f9c-002472d11ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:23.965999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e253fb8-f9e1-4456-9f9c-002472d11ade None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:23.966287 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e253fb8-f9e1-4456-9f9c-002472d11ade None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:23.966561 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e253fb8-f9e1-4456-9f9c-002472d11ade None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:23.976986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e253fb8-f9e1-4456-9f9c-002472d11ade None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:23.983124 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-1e253fb8-f9e1-4456-9f9c-002472d11ade None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:13:23.983124 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:23.983124 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:23.983124 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:23.983124 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:23.983124 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:23.983124 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:23.983124 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:23.983124 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:23.983124 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:23.983124 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:23.983124 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:23.983124 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:23.983124 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:23.983124 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:23.983124 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:23.984001 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:23.984001 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:23.984001 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:23.984001 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:23.984001 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:23.984001 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:23.984001 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:23.984001 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:23.984001 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:23.984001 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:23.984001 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:23.984001 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:23.984001 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:23.984001 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:23.984001 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:23.984001 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:23.985278 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:23.985278 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:23.985278 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:23.985278 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:23.985278 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:23.985278 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:23.985278 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:23.985278 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:23.985278 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:23.985278 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:23.985278 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:13:23.985278 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:23.985278 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 167/313] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:23.991147 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4655b9-6cb6-4c98-817e-b298366291c6 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:24.094854 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4655b9-6cb6-4c98-817e-b298366291c6 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:24.115731 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:24.131177 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafef92-ed01-4d5c-b77a-bbcc10171f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:24.132060 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafef92-ed01-4d5c-b77a-bbcc10171f75 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:24.132518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafef92-ed01-4d5c-b77a-bbcc10171f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:24.132966 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafef92-ed01-4d5c-b77a-bbcc10171f75 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:24.133916 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafef92-ed01-4d5c-b77a-bbcc10171f75 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:24.134398 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafef92-ed01-4d5c-b77a-bbcc10171f75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:24.135964 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafef92-ed01-4d5c-b77a-bbcc10171f75 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:24.146256 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 147/314] 10.222.0.94 () {56 vars in 1101 bytes} [Thu Sep 1 17:13:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:24.151974 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e253fb8-f9e1-4456-9f9c-002472d11ade None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:24.270051 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e253fb8-f9e1-4456-9f9c-002472d11ade None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:24.305898 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8da3e0-5c6f-4580-a61a-c2fa760703d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:24.306567 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8da3e0-5c6f-4580-a61a-c2fa760703d8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:24.306817 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8da3e0-5c6f-4580-a61a-c2fa760703d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:24.307085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8da3e0-5c6f-4580-a61a-c2fa760703d8 None admin] PATH_INFO: `/v3/users/6946723909e1481f8fcaefedcdc1f2b4` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:24.308215 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8da3e0-5c6f-4580-a61a-c2fa760703d8 None admin] RBAC: Authorizing `identity:get_user(user_id=6946723909e1481f8fcaefedcdc1f2b4)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:24.310212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8da3e0-5c6f-4580-a61a-c2fa760703d8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:24.312265 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 168/315] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:13:24 2022] GET /identity/v3/users/6946723909e1481f8fcaefedcdc1f2b4 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:24.318754 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafef92-ed01-4d5c-b77a-bbcc10171f75 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:24.423861 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafef92-ed01-4d5c-b77a-bbcc10171f75 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:24.459295 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f8333-fd49-48be-a39d-8d3fa4d9c90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:24.459914 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f8333-fd49-48be-a39d-8d3fa4d9c90b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:24.460190 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f8333-fd49-48be-a39d-8d3fa4d9c90b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:24.460461 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f8333-fd49-48be-a39d-8d3fa4d9c90b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:24.511193 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:24.542088 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f8333-fd49-48be-a39d-8d3fa4d9c90b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:24.543583 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f8333-fd49-48be-a39d-8d3fa4d9c90b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:24.647403 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 148/316] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:13:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:13:24.654927 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8da3e0-5c6f-4580-a61a-c2fa760703d8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:24.706151 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:24.714379 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50bebb-74a9-4548-ac1d-8b8ad874d702 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:24.715331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50bebb-74a9-4548-ac1d-8b8ad874d702 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:24.715875 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50bebb-74a9-4548-ac1d-8b8ad874d702 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:24.718506 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 149/317] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:13:24.723087 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112d743-0342-4fce-a97f-fc0733b57052 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:24.723672 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112d743-0342-4fce-a97f-fc0733b57052 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:24.724153 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112d743-0342-4fce-a97f-fc0733b57052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:24.746266 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3112d743-0342-4fce-a97f-fc0733b57052 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:24.748957 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3112d743-0342-4fce-a97f-fc0733b57052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:24.765915 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8da3e0-5c6f-4580-a61a-c2fa760703d8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:24.803682 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafab06-0c62-4a54-bbac-b325113e8b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:24.804652 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafab06-0c62-4a54-bbac-b325113e8b90 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:24.805172 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafab06-0c62-4a54-bbac-b325113e8b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:24.805794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafab06-0c62-4a54-bbac-b325113e8b90 None admin] PATH_INFO: `/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:24.807600 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafab06-0c62-4a54-bbac-b325113e8b90 None admin] RBAC: Authorizing `identity:get_project(project_id=13936e7054f44ceebcd8d6dfa85eb8a7)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:24.809260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafab06-0c62-4a54-bbac-b325113e8b90 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:24.816598 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 169/318] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:24 2022] GET /identity/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:24.817715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafab06-0c62-4a54-bbac-b325113e8b90 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:24.837713 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 150/319] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:13:24.927926 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafab06-0c62-4a54-bbac-b325113e8b90 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:24.943144 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:24.964469 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982a5fe-aab0-4fd9-9073-af7c6458aabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:24.965379 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982a5fe-aab0-4fd9-9073-af7c6458aabc None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:24.966423 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982a5fe-aab0-4fd9-9073-af7c6458aabc None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:24.966894 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982a5fe-aab0-4fd9-9073-af7c6458aabc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:24.967909 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982a5fe-aab0-4fd9-9073-af7c6458aabc None admin] RBAC: Adding query filter params (role.id=1052488681f94c6f8039fa871f46daa9, scope.project.id=13936e7054f44ceebcd8d6dfa85eb8a7, user.id=6946723909e1481f8fcaefedcdc1f2b4) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:24.968417 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982a5fe-aab0-4fd9-9073-af7c6458aabc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:24.970101 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982a5fe-aab0-4fd9-9073-af7c6458aabc None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:24.976632 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 170/320] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:13:24 2022] GET /identity/v3/role_assignments?user.id=6946723909e1481f8fcaefedcdc1f2b4&scope.project.id=13936e7054f44ceebcd8d6dfa85eb8a7&role.id=1052488681f94c6f8039fa871f46daa9 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:25.010891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50ae2c-df0d-469a-90e1-96dd91ce38dd None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:25.011441 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50ae2c-df0d-469a-90e1-96dd91ce38dd None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:25.011441 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50ae2c-df0d-469a-90e1-96dd91ce38dd None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:25.013032 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 151/321] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:25.018839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283676e-f447-4e7e-9626-1b749931adf7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:25.019125 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283676e-f447-4e7e-9626-1b749931adf7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:25.019400 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283676e-f447-4e7e-9626-1b749931adf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:25.039967 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c283676e-f447-4e7e-9626-1b749931adf7 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:25.041205 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c283676e-f447-4e7e-9626-1b749931adf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:25.118312 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 171/322] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:25.121998 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50ae2c-df0d-469a-90e1-96dd91ce38dd None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:25.140598 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:25.232098 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50ae2c-df0d-469a-90e1-96dd91ce38dd None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:25.266515 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801b6e9-d688-46f7-b56c-0f5b2996508a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:25.267138 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801b6e9-d688-46f7-b56c-0f5b2996508a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:25.267415 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801b6e9-d688-46f7-b56c-0f5b2996508a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:25.267687 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801b6e9-d688-46f7-b56c-0f5b2996508a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:25.268772 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801b6e9-d688-46f7-b56c-0f5b2996508a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:25.270246 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801b6e9-d688-46f7-b56c-0f5b2996508a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:25.271966 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 152/323] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:13:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:25.277381 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283676e-f447-4e7e-9626-1b749931adf7 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:25.383886 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283676e-f447-4e7e-9626-1b749931adf7 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:25.393888 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:25.397527 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801b6e9-d688-46f7-b56c-0f5b2996508a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:25.421435 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8cf36-82b6-4a3b-8f6b-58991d99c914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:25.422035 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8cf36-82b6-4a3b-8f6b-58991d99c914 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:25.422309 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8cf36-82b6-4a3b-8f6b-58991d99c914 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:25.422573 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8cf36-82b6-4a3b-8f6b-58991d99c914 None admin] PATH_INFO: `/v3/groups` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:25.423327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8cf36-82b6-4a3b-8f6b-58991d99c914 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:25.424874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8cf36-82b6-4a3b-8f6b-58991d99c914 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:25.440739 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 172/324] 10.222.0.94 () {60 vars in 1134 bytes} [Thu Sep 1 17:13:25 2022] POST /identity/v3/groups => generated 226 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:13:25.497639 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:25.520095 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801b6e9-d688-46f7-b56c-0f5b2996508a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:25.562870 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74a014-82ca-4127-9e8e-d147700eb043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:25.563521 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74a014-82ca-4127-9e8e-d147700eb043 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:25.563791 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74a014-82ca-4127-9e8e-d147700eb043 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:25.564055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74a014-82ca-4127-9e8e-d147700eb043 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:25.576307 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74a014-82ca-4127-9e8e-d147700eb043 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:25.582357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-7a74a014-82ca-4127-9e8e-d147700eb043 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:13:25.582357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:25.582357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:25.582357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:25.582357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:25.582357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:25.582357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:25.582357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:25.582357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:25.582357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:25.582357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:25.582357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:25.582357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:25.582357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:25.582357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:25.582357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:25.583275 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:25.583275 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:25.583275 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:25.583275 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:25.583275 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:25.583275 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:25.583275 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:25.583275 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:25.583275 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:25.583275 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:25.583275 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:25.583275 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:25.583275 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:25.583275 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:25.583275 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:25.583275 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:25.584368 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:25.584368 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:25.584368 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:25.584368 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:25.584368 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:25.584368 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:25.584368 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:25.584368 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:25.584368 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:25.584368 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:25.584368 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:13:25.584368 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:25.584368 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 153/325] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:13:25.589992 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8cf36-82b6-4a3b-8f6b-58991d99c914 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:25.699885 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8cf36-82b6-4a3b-8f6b-58991d99c914 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:25.736429 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643c1e5-2807-498e-9e00-6a46c4e31f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:25.737042 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643c1e5-2807-498e-9e00-6a46c4e31f21 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:25.737318 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643c1e5-2807-498e-9e00-6a46c4e31f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:25.737612 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643c1e5-2807-498e-9e00-6a46c4e31f21 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:25.738281 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643c1e5-2807-498e-9e00-6a46c4e31f21 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:25.738579 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643c1e5-2807-498e-9e00-6a46c4e31f21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:25.739945 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643c1e5-2807-498e-9e00-6a46c4e31f21 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:25.749130 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 173/326] 10.222.0.94 () {56 vars in 1101 bytes} [Thu Sep 1 17:13:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:25.754536 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74a014-82ca-4127-9e8e-d147700eb043 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:25.839100 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e41328-b982-4b39-8f03-a232bcc610e4 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:25.839602 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e41328-b982-4b39-8f03-a232bcc610e4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:25.839691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e41328-b982-4b39-8f03-a232bcc610e4 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:25.841718 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 174/327] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:13:25.846572 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dca59-330c-46ce-acc3-e86ac62cd483 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:25.846854 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dca59-330c-46ce-acc3-e86ac62cd483 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:25.847128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dca59-330c-46ce-acc3-e86ac62cd483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:25.866434 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74a014-82ca-4127-9e8e-d147700eb043 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:25.866988 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-9d0dca59-330c-46ce-acc3-e86ac62cd483 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:25.868186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9d0dca59-330c-46ce-acc3-e86ac62cd483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:25.898035 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:25.909632 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78fa73d-8b01-4c5e-8a08-35f0e46908d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:25.910294 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fa73d-8b01-4c5e-8a08-35f0e46908d5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:25.910709 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fa73d-8b01-4c5e-8a08-35f0e46908d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:25.911096 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fa73d-8b01-4c5e-8a08-35f0e46908d5 None admin] PATH_INFO: `/v3/users/410ffbc7cfef4d249ec463f32cf0cea6` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:25.912826 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78fa73d-8b01-4c5e-8a08-35f0e46908d5 None admin] RBAC: Authorizing `identity:get_user(user_id=410ffbc7cfef4d249ec463f32cf0cea6)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:25.914314 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78fa73d-8b01-4c5e-8a08-35f0e46908d5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:25.916193 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 154/328] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:13:25 2022] GET /identity/v3/users/410ffbc7cfef4d249ec463f32cf0cea6 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:25.922377 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78fa73d-8b01-4c5e-8a08-35f0e46908d5 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:25.934803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:25.959774 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 175/329] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:13:26.033534 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78fa73d-8b01-4c5e-8a08-35f0e46908d5 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:26.068824 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee956a3b-3a49-412f-a1e0-f54df48cfa64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:26.069597 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee956a3b-3a49-412f-a1e0-f54df48cfa64 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:26.069921 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee956a3b-3a49-412f-a1e0-f54df48cfa64 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:26.070197 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee956a3b-3a49-412f-a1e0-f54df48cfa64 None admin] PATH_INFO: `/v3/system/users/410ffbc7cfef4d249ec463f32cf0cea6/roles/1052488681f94c6f8039fa871f46daa9` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:26.071606 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee956a3b-3a49-412f-a1e0-f54df48cfa64 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=410ffbc7cfef4d249ec463f32cf0cea6, role_id=1052488681f94c6f8039fa871f46daa9)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:26.072983 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee956a3b-3a49-412f-a1e0-f54df48cfa64 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:26.082144 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 155/330] 10.222.0.94 () {58 vars in 1334 bytes} [Thu Sep 1 17:13:25 2022] PUT /identity/v3/system/users/410ffbc7cfef4d249ec463f32cf0cea6/roles/1052488681f94c6f8039fa871f46daa9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:13:26.244035 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0dca59-330c-46ce-acc3-e86ac62cd483 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:26.348746 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0dca59-330c-46ce-acc3-e86ac62cd483 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:26.384284 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba96fa0-b1ae-4e34-886f-e8bda7b6f8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:26.385320 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba96fa0-b1ae-4e34-886f-e8bda7b6f8c8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:26.385836 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba96fa0-b1ae-4e34-886f-e8bda7b6f8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:26.386303 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba96fa0-b1ae-4e34-886f-e8bda7b6f8c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:26.396944 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba96fa0-b1ae-4e34-886f-e8bda7b6f8c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:26.402234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-aba96fa0-b1ae-4e34-886f-e8bda7b6f8c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:13:26.402234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:26.402234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:26.402234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:26.402234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:26.402234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:26.402234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:26.402234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:26.402234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:26.402234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:26.402234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:26.402234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:26.402234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:26.402234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:26.402234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:26.402234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:26.403107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:26.403107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:26.403107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:26.403107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:26.403107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:26.403107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:26.403107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:26.403107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:26.403107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:26.403107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:26.403107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:26.403107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:26.403107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:26.403107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:26.403107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:26.403107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:26.404446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:26.404446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:26.404446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:26.404446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:26.404446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:26.404446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:26.404446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:26.404446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:26.404446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:26.404446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:26.404446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:13:26.404446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:26.407005 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 176/331] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:26.412882 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee956a3b-3a49-412f-a1e0-f54df48cfa64 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:26.493141 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:26.530712 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee956a3b-3a49-412f-a1e0-f54df48cfa64 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:26.581221 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cd7b8-3a69-4ece-90a9-4812f34cfac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:26.581881 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cd7b8-3a69-4ece-90a9-4812f34cfac3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:26.582159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cd7b8-3a69-4ece-90a9-4812f34cfac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:26.582432 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cd7b8-3a69-4ece-90a9-4812f34cfac3 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:26.583109 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cd7b8-3a69-4ece-90a9-4812f34cfac3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:26.583412 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cd7b8-3a69-4ece-90a9-4812f34cfac3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:26.584778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cd7b8-3a69-4ece-90a9-4812f34cfac3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:26.593667 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 156/332] 10.222.0.94 () {56 vars in 1101 bytes} [Thu Sep 1 17:13:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:26.599294 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba96fa0-b1ae-4e34-886f-e8bda7b6f8c8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:26.631326 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:26.734967 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba96fa0-b1ae-4e34-886f-e8bda7b6f8c8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:26.775289 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39958e2b-95d3-4fb1-9323-7d6898fbcb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:26.776320 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39958e2b-95d3-4fb1-9323-7d6898fbcb04 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:26.776799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39958e2b-95d3-4fb1-9323-7d6898fbcb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:26.777292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39958e2b-95d3-4fb1-9323-7d6898fbcb04 None admin] PATH_INFO: `/v3/users/18d1d3b193424646a6ca47bd4cb62a75` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:26.778710 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39958e2b-95d3-4fb1-9323-7d6898fbcb04 None admin] RBAC: Authorizing `identity:get_user(user_id=18d1d3b193424646a6ca47bd4cb62a75)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:26.780398 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39958e2b-95d3-4fb1-9323-7d6898fbcb04 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:26.782508 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 177/333] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:13:26 2022] GET /identity/v3/users/18d1d3b193424646a6ca47bd4cb62a75 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:26.788323 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cd7b8-3a69-4ece-90a9-4812f34cfac3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:26.914675 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cd7b8-3a69-4ece-90a9-4812f34cfac3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:26.955074 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b213f-7571-4949-8891-17a013dea9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:26.956050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b213f-7571-4949-8891-17a013dea9e1 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:26.956528 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b213f-7571-4949-8891-17a013dea9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:26.957013 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b213f-7571-4949-8891-17a013dea9e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:26.957964 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b213f-7571-4949-8891-17a013dea9e1 None admin] RBAC: Adding query filter params (role.id=a78fbf73b27d4781ac14690bbcb1cd9f, user.id=18d1d3b193424646a6ca47bd4cb62a75, scope.system=all) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:26.958551 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b213f-7571-4949-8891-17a013dea9e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:26.960222 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b213f-7571-4949-8891-17a013dea9e1 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:26.961990 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:26.976407 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 157/334] 10.222.0.94 () {56 vars in 1308 bytes} [Thu Sep 1 17:13:26 2022] GET /identity/v3/role_assignments?user.id=18d1d3b193424646a6ca47bd4cb62a75&scope.system=all&role.id=a78fbf73b27d4781ac14690bbcb1cd9f => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:28.073639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d724c2-6cbe-4390-adef-d10b117b2176 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:28.074784 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d724c2-6cbe-4390-adef-d10b117b2176 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:28.075342 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d724c2-6cbe-4390-adef-d10b117b2176 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:28.077141 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 178/335] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:28.082779 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0172dc-3c64-4564-bb56-093418099196 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:28.083635 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0172dc-3c64-4564-bb56-093418099196 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:28.084112 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0172dc-3c64-4564-bb56-093418099196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:28.105732 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-1d0172dc-3c64-4564-bb56-093418099196 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:28.107807 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1d0172dc-3c64-4564-bb56-093418099196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:28.192153 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 158/336] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:28.434661 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd3783-d3f8-4619-81e5-cbe67385f491 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:28.435367 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd3783-d3f8-4619-81e5-cbe67385f491 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:28.435851 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd3783-d3f8-4619-81e5-cbe67385f491 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:28.437418 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 179/337] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:28.442660 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fd120-c2fa-486c-bffb-2e4d5b11ac0d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:28.443218 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fd120-c2fa-486c-bffb-2e4d5b11ac0d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:28.443710 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fd120-c2fa-486c-bffb-2e4d5b11ac0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:28.448215 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa494e-8b85-4dcb-ba5d-dd4d9092f875 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:28.448498 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa494e-8b85-4dcb-ba5d-dd4d9092f875 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:28.448774 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa494e-8b85-4dcb-ba5d-dd4d9092f875 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:28.450942 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 180/338] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:28.457180 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a4192-e5d1-4a34-b8fd-af217f8c3965 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:28.457492 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a4192-e5d1-4a34-b8fd-af217f8c3965 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:28.457975 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a4192-e5d1-4a34-b8fd-af217f8c3965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:28.466912 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-026fd120-c2fa-486c-bffb-2e4d5b11ac0d None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:28.468415 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-026fd120-c2fa-486c-bffb-2e4d5b11ac0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:28.485364 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-de1a4192-e5d1-4a34-b8fd-af217f8c3965 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:28.486575 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-de1a4192-e5d1-4a34-b8fd-af217f8c3965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:28.594075 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 159/339] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:28.643303 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 181/340] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:13:28.775605 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fd120-c2fa-486c-bffb-2e4d5b11ac0d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:28.847274 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:28.903726 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fd120-c2fa-486c-bffb-2e4d5b11ac0d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:28.941653 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c4031-089e-4ca4-afed-b3e70fc8db9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:28.942292 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c4031-089e-4ca4-afed-b3e70fc8db9d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:28.942570 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c4031-089e-4ca4-afed-b3e70fc8db9d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:28.942842 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c4031-089e-4ca4-afed-b3e70fc8db9d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:28.953965 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c4031-089e-4ca4-afed-b3e70fc8db9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:28.958853 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-088c4031-089e-4ca4-afed-b3e70fc8db9d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:13:28.958853 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:28.958853 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:28.958853 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:28.958853 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:28.958853 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:28.958853 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:28.958853 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:28.958853 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:28.958853 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:28.958853 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:28.958853 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:28.958853 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:28.958853 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:28.958853 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:28.958853 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:28.959755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:28.959755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:28.959755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:28.959755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:28.959755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:28.959755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:28.959755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:28.959755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:28.959755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:28.959755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:28.959755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:28.959755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:28.959755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:28.959755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:28.959755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:28.959755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:28.960938 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:28.960938 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:28.960938 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:28.960938 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:28.960938 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:28.960938 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:28.960938 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:28.960938 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:28.960938 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:28.960938 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:28.960938 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:13:28.960938 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:28.960938 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 160/341] 10.222.0.94 () {56 vars in 1114 bytes} [Thu Sep 1 17:13:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:28.966173 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a4192-e5d1-4a34-b8fd-af217f8c3965 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:29.009833 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:29.123855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a4192-e5d1-4a34-b8fd-af217f8c3965 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:29.159963 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c4031-089e-4ca4-afed-b3e70fc8db9d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:29.168003 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8124b2-e897-4d5d-96ca-1bbebe86befb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:29.168003 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8124b2-e897-4d5d-96ca-1bbebe86befb None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:29.168003 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8124b2-e897-4d5d-96ca-1bbebe86befb None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:29.168003 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8124b2-e897-4d5d-96ca-1bbebe86befb None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:29.168328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8124b2-e897-4d5d-96ca-1bbebe86befb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:29.168328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8124b2-e897-4d5d-96ca-1bbebe86befb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:29.168748 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8124b2-e897-4d5d-96ca-1bbebe86befb None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:29.183546 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 182/342] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:13:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:29.185017 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8124b2-e897-4d5d-96ca-1bbebe86befb None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:29.310667 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c4031-089e-4ca4-afed-b3e70fc8db9d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:29.321796 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:29.327906 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:29.336106 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8124b2-e897-4d5d-96ca-1bbebe86befb None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:29.353080 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f8c39-bfe3-4a84-8985-ad9643c9a3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:29.353979 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f8c39-bfe3-4a84-8985-ad9643c9a3ad None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:29.354404 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f8c39-bfe3-4a84-8985-ad9643c9a3ad None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:29.355015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f8c39-bfe3-4a84-8985-ad9643c9a3ad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:29.366795 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f8c39-bfe3-4a84-8985-ad9643c9a3ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:29.373043 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-c68f8c39-bfe3-4a84-8985-ad9643c9a3ad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:13:29.373043 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:29.373043 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:29.373043 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:29.373043 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:29.373043 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:29.373043 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:29.373043 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:29.373043 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:29.373043 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:29.373043 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:29.373043 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:29.373043 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:29.373043 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:29.373043 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:29.373043 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:29.374198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:29.374198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:29.374198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:29.374198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:29.374198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:29.374198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:29.374198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:29.374198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:29.374198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:29.374198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:29.374198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:29.374198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:29.374198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:29.374198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:29.374198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:29.374198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:29.375190 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:29.375190 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:29.375190 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:29.375190 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:29.375190 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:29.375190 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:29.375190 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:29.375190 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:29.375190 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:29.375190 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:29.375190 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 17:13:29.375190 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:29.375940 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7cb78-ba32-4aa9-bf19-515b67ca98c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:29.376156 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7cb78-ba32-4aa9-bf19-515b67ca98c6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:29.376444 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7cb78-ba32-4aa9-bf19-515b67ca98c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:29.376716 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7cb78-ba32-4aa9-bf19-515b67ca98c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:29.378002 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 161/343] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:29.379424 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c3e4b-44fb-467c-91f3-1fa273a575f4 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:29.384360 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c3e4b-44fb-467c-91f3-1fa273a575f4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:29.385598 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c3e4b-44fb-467c-91f3-1fa273a575f4 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:29.387218 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 162/344] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:29.388662 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c3e4b-44fb-467c-91f3-1fa273a575f4 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:29.459696 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7cb78-ba32-4aa9-bf19-515b67ca98c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:29.461166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7cb78-ba32-4aa9-bf19-515b67ca98c6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:29.507464 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c3e4b-44fb-467c-91f3-1fa273a575f4 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:29.549624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:29.563431 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7384d-263a-4959-b022-c5b36b621ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:29.564121 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7384d-263a-4959-b022-c5b36b621ead None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:29.564337 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7384d-263a-4959-b022-c5b36b621ead None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:29.564603 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7384d-263a-4959-b022-c5b36b621ead None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:29.583747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7384d-263a-4959-b022-c5b36b621ead None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:29.584663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 183/345] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:13:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 17:13:29.585828 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7cb78-ba32-4aa9-bf19-515b67ca98c6 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:29.590789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-fdd7384d-263a-4959-b022-c5b36b621ead None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:13:29.590789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:29.590789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:29.590789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:29.590789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:29.590789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:29.590789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:29.590789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:29.590789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:29.590789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:29.590789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:29.590789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:29.590789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:29.590789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:29.590789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:29.590789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:29.591785 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:29.591785 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:29.591785 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:29.591785 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:29.591785 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:29.591785 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:29.591785 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:29.591785 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:29.591785 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:29.591785 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:29.591785 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:29.591785 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:29.591785 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:29.591785 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:29.591785 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:29.591785 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:29.592632 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:29.592632 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:29.592632 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:29.592632 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:29.592632 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:29.592632 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:29.592632 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:29.592632 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:29.592632 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:29.592632 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:29.592632 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:13:29.592632 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:29.592632 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 163/346] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:29.593315 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c10147-0d7c-4a6d-9ac6-1281d9148c52 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:29.593695 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c10147-0d7c-4a6d-9ac6-1281d9148c52 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:29.594147 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c10147-0d7c-4a6d-9ac6-1281d9148c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:29.619014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a1c10147-0d7c-4a6d-9ac6-1281d9148c52 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:29.621468 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a1c10147-0d7c-4a6d-9ac6-1281d9148c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:29.654719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:29.718030 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7cb78-ba32-4aa9-bf19-515b67ca98c6 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:29.719732 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 164/347] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:29.721202 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c14951-634e-4920-b29d-db801a458d94 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:29.721590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c14951-634e-4920-b29d-db801a458d94 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:29.721869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c14951-634e-4920-b29d-db801a458d94 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:29.723237 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 165/348] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:29.723934 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c14951-634e-4920-b29d-db801a458d94 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:29.764606 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2ec59-5745-4edd-a8d7-1b620273db99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:29.765217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2ec59-5745-4edd-a8d7-1b620273db99 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:29.765517 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2ec59-5745-4edd-a8d7-1b620273db99 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:29.765785 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2ec59-5745-4edd-a8d7-1b620273db99 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:29.768146 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2ec59-5745-4edd-a8d7-1b620273db99 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:29.768146 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2ec59-5745-4edd-a8d7-1b620273db99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:29.768146 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2ec59-5745-4edd-a8d7-1b620273db99 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:29.778854 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 184/349] 10.222.0.94 () {56 vars in 1101 bytes} [Thu Sep 1 17:13:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:29.779738 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2ec59-5745-4edd-a8d7-1b620273db99 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:29.832970 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:29.865533 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c14951-634e-4920-b29d-db801a458d94 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:29.896042 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2ec59-5745-4edd-a8d7-1b620273db99 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:29.902952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62493781-ae28-4245-a235-b6fa1dc2fe85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:29.904492 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62493781-ae28-4245-a235-b6fa1dc2fe85 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:29.905037 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62493781-ae28-4245-a235-b6fa1dc2fe85 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:29.905534 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62493781-ae28-4245-a235-b6fa1dc2fe85 None admin] PATH_INFO: `/v3/projects/09e5899a135840f3a8cdeb96945d5623` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:29.906865 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62493781-ae28-4245-a235-b6fa1dc2fe85 None admin] RBAC: Authorizing `identity:get_project(project_id=09e5899a135840f3a8cdeb96945d5623)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:29.908512 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62493781-ae28-4245-a235-b6fa1dc2fe85 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:29.910419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 166/350] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:29 2022] GET /identity/v3/projects/09e5899a135840f3a8cdeb96945d5623 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:29.911835 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea3ab9-d48f-4cf6-a5c0-1770641ac582 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:29.912312 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea3ab9-d48f-4cf6-a5c0-1770641ac582 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:29.912806 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea3ab9-d48f-4cf6-a5c0-1770641ac582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:29.934355 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc404a7-0a2e-45bf-9e42-82e604e8a810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:29.935040 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc404a7-0a2e-45bf-9e42-82e604e8a810 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:29.935322 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc404a7-0a2e-45bf-9e42-82e604e8a810 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:29.935596 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc404a7-0a2e-45bf-9e42-82e604e8a810 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:29.935908 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b7ea3ab9-d48f-4cf6-a5c0-1770641ac582 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:29.936323 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc404a7-0a2e-45bf-9e42-82e604e8a810 None admin] RBAC: Adding query filter params (name=member) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:29.936629 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc404a7-0a2e-45bf-9e42-82e604e8a810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:29.937857 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b7ea3ab9-d48f-4cf6-a5c0-1770641ac582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:29.940044 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc404a7-0a2e-45bf-9e42-82e604e8a810 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:29.949305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 185/351] 10.222.0.94 () {56 vars in 1101 bytes} [Thu Sep 1 17:13:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:29.950922 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc404a7-0a2e-45bf-9e42-82e604e8a810 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:29.965538 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:30.013632 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 167/352] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:30.014852 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea3ab9-d48f-4cf6-a5c0-1770641ac582 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:30.058916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc404a7-0a2e-45bf-9e42-82e604e8a810 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:30.093499 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:30.097555 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0edbe81-15e7-4c40-8fae-06f2f85b202d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:30.097723 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edbe81-15e7-4c40-8fae-06f2f85b202d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:30.097915 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edbe81-15e7-4c40-8fae-06f2f85b202d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:30.098174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edbe81-15e7-4c40-8fae-06f2f85b202d None admin] PATH_INFO: `/v3/users/410ffbc7cfef4d249ec463f32cf0cea6` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:30.100377 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0edbe81-15e7-4c40-8fae-06f2f85b202d None admin] RBAC: Authorizing `identity:get_user(user_id=410ffbc7cfef4d249ec463f32cf0cea6)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:30.102146 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0edbe81-15e7-4c40-8fae-06f2f85b202d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:30.103769 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 186/353] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:13:29 2022] GET /identity/v3/users/410ffbc7cfef4d249ec463f32cf0cea6 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:30.104633 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0edbe81-15e7-4c40-8fae-06f2f85b202d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:30.131351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea3ab9-d48f-4cf6-a5c0-1770641ac582 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:30.168952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfe92d-8f67-4602-b402-204e1b85394f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:30.175822 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfe92d-8f67-4602-b402-204e1b85394f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:30.175822 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfe92d-8f67-4602-b402-204e1b85394f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:30.175822 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfe92d-8f67-4602-b402-204e1b85394f None admin] PATH_INFO: `/v3/groups/b3bcbc40f46e42dcbc4b06c7d682aaea` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:30.192018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfe92d-8f67-4602-b402-204e1b85394f None admin] RBAC: Authorizing `identity:get_group(group_id=b3bcbc40f46e42dcbc4b06c7d682aaea)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:30.193512 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfe92d-8f67-4602-b402-204e1b85394f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:30.195345 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 168/354] 10.222.0.94 () {56 vars in 1180 bytes} [Thu Sep 1 17:13:30 2022] GET /identity/v3/groups/b3bcbc40f46e42dcbc4b06c7d682aaea => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:30.195947 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfe92d-8f67-4602-b402-204e1b85394f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:30.216963 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0edbe81-15e7-4c40-8fae-06f2f85b202d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:30.231887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:30.256068 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e28fe-1802-40eb-89e9-38694b573992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:30.256688 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e28fe-1802-40eb-89e9-38694b573992 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:30.256969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e28fe-1802-40eb-89e9-38694b573992 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:30.257243 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e28fe-1802-40eb-89e9-38694b573992 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:30.304063 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:30.320136 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfe92d-8f67-4602-b402-204e1b85394f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:30.333951 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e28fe-1802-40eb-89e9-38694b573992 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:30.335523 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e28fe-1802-40eb-89e9-38694b573992 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:30.368249 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cc58e-8455-4b8d-92de-fbb7e23e2a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:30.369218 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cc58e-8455-4b8d-92de-fbb7e23e2a2b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:30.369679 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cc58e-8455-4b8d-92de-fbb7e23e2a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:30.369960 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cc58e-8455-4b8d-92de-fbb7e23e2a2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:30.383248 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121cc58e-8455-4b8d-92de-fbb7e23e2a2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:30.388868 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-121cc58e-8455-4b8d-92de-fbb7e23e2a2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:13:30.388868 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:30.388868 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:30.388868 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:30.388868 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:30.388868 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:30.388868 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:30.388868 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:30.388868 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:30.388868 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:30.388868 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:30.388868 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:30.388868 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:30.388868 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:30.388868 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:30.388868 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:30.391078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:30.391078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:30.391078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:30.391078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:30.391078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:30.391078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:30.391078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:30.391078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:30.391078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:30.391078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:30.391078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:30.391078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:30.391078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:30.391078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:30.391078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:30.391078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:30.393045 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:30.393045 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:30.393045 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:30.393045 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:30.393045 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:30.393045 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:30.393045 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:30.393045 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:30.393045 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:30.393045 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:30.393045 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:13:30.393045 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:30.393045 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 169/355] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:30.393045 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cc58e-8455-4b8d-92de-fbb7e23e2a2b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:30.459625 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 187/356] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:13:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:13:30.460396 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e28fe-1802-40eb-89e9-38694b573992 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:30.509670 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:30.538622 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cc58e-8455-4b8d-92de-fbb7e23e2a2b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:30.550138 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:30.578990 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec776eb-c250-4eb9-854e-cfb43d6b35e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:30.579364 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec776eb-c250-4eb9-854e-cfb43d6b35e2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:30.579644 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec776eb-c250-4eb9-854e-cfb43d6b35e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:30.579908 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec776eb-c250-4eb9-854e-cfb43d6b35e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:30.580623 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec776eb-c250-4eb9-854e-cfb43d6b35e2 None admin] RBAC: Adding query filter params (role.id=1052488681f94c6f8039fa871f46daa9, user.id=410ffbc7cfef4d249ec463f32cf0cea6, scope.system=all) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:30.580923 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec776eb-c250-4eb9-854e-cfb43d6b35e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:30.582400 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec776eb-c250-4eb9-854e-cfb43d6b35e2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:30.592973 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e28fe-1802-40eb-89e9-38694b573992 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:30.596401 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 170/357] 10.222.0.94 () {56 vars in 1308 bytes} [Thu Sep 1 17:13:30 2022] GET /identity/v3/role_assignments?user.id=410ffbc7cfef4d249ec463f32cf0cea6&scope.system=all&role.id=1052488681f94c6f8039fa871f46daa9 => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:30.599671 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec776eb-c250-4eb9-854e-cfb43d6b35e2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:30.647515 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908856e-3bcb-4176-9176-b12ebc9f177f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:30.648142 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908856e-3bcb-4176-9176-b12ebc9f177f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:30.648686 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908856e-3bcb-4176-9176-b12ebc9f177f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:30.648965 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908856e-3bcb-4176-9176-b12ebc9f177f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:30.649765 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908856e-3bcb-4176-9176-b12ebc9f177f None admin] RBAC: Adding query filter params (group.id=b3bcbc40f46e42dcbc4b06c7d682aaea, role.id=9131e2ca337e4d1286ef32a4ba63cafa, scope.project.id=09e5899a135840f3a8cdeb96945d5623) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:30.651128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908856e-3bcb-4176-9176-b12ebc9f177f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:30.652714 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908856e-3bcb-4176-9176-b12ebc9f177f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:30.663637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 188/358] 10.222.0.94 () {56 vars in 1376 bytes} [Thu Sep 1 17:13:30 2022] GET /identity/v3/role_assignments?group.id=b3bcbc40f46e42dcbc4b06c7d682aaea&scope.project.id=09e5899a135840f3a8cdeb96945d5623&role.id=9131e2ca337e4d1286ef32a4ba63cafa => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:30.664309 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908856e-3bcb-4176-9176-b12ebc9f177f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:30.746115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec776eb-c250-4eb9-854e-cfb43d6b35e2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:30.785838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f49e59-c661-4a7f-aaf1-f9598140ad42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:30.786848 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f49e59-c661-4a7f-aaf1-f9598140ad42 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:30.787352 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f49e59-c661-4a7f-aaf1-f9598140ad42 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:30.787828 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f49e59-c661-4a7f-aaf1-f9598140ad42 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:30.800683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f49e59-c661-4a7f-aaf1-f9598140ad42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:30.807720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-d5f49e59-c661-4a7f-aaf1-f9598140ad42 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:13:30.807720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:30.807720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:30.807720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:30.807720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:30.807720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:30.807720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:30.807720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:30.807720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:30.807720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:30.807720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:30.807720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:30.807720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:30.807720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:30.807720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:30.807720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:30.808733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:30.808733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:30.808733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:30.808733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:30.808733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:30.808733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:30.808733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:30.808733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:30.808733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:30.808733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:30.808733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:30.808733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:30.808733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:30.808733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:30.808733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:30.808733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:30.809638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:30.809638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:30.809638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:30.809638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:30.809638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:30.809638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:30.809638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:30.809638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:30.809638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:30.809638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:30.809638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:13:30.809638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:30.814220 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 171/359] 10.222.0.94 () {56 vars in 1114 bytes} [Thu Sep 1 17:13:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:30.814220 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056d3f6-e9f4-4966-920c-be50b4e2ff9d None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:30.814220 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056d3f6-e9f4-4966-920c-be50b4e2ff9d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:30.814220 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056d3f6-e9f4-4966-920c-be50b4e2ff9d None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:30.814462 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908856e-3bcb-4176-9176-b12ebc9f177f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:30.814534 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 172/360] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:30.814534 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056d3f6-e9f4-4966-920c-be50b4e2ff9d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:30.820039 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:30.863524 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf89ed4-89f5-41c3-ba95-3ff52ac306cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:30.864621 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf89ed4-89f5-41c3-ba95-3ff52ac306cf None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:30.865020 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf89ed4-89f5-41c3-ba95-3ff52ac306cf None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:30.865387 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf89ed4-89f5-41c3-ba95-3ff52ac306cf None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:30.866325 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf89ed4-89f5-41c3-ba95-3ff52ac306cf None admin] RBAC: Adding query filter params (name=member) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:30.866700 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf89ed4-89f5-41c3-ba95-3ff52ac306cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:30.868159 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf89ed4-89f5-41c3-ba95-3ff52ac306cf None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:30.879300 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:30.885427 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 189/361] 10.222.0.94 () {56 vars in 1101 bytes} [Thu Sep 1 17:13:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:30.885427 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf89ed4-89f5-41c3-ba95-3ff52ac306cf None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:30.964340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056d3f6-e9f4-4966-920c-be50b4e2ff9d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:31.005586 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66461c-2caa-425b-ad4a-92a8bb632d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:31.006147 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66461c-2caa-425b-ad4a-92a8bb632d8c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:31.006425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66461c-2caa-425b-ad4a-92a8bb632d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:31.006703 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66461c-2caa-425b-ad4a-92a8bb632d8c None admin] PATH_INFO: `/v3/projects/09e5899a135840f3a8cdeb96945d5623` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:31.007841 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea66461c-2caa-425b-ad4a-92a8bb632d8c None admin] RBAC: Authorizing `identity:get_project(project_id=09e5899a135840f3a8cdeb96945d5623)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:31.009293 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea66461c-2caa-425b-ad4a-92a8bb632d8c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:31.010638 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf89ed4-89f5-41c3-ba95-3ff52ac306cf None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:31.011139 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 173/362] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:30 2022] GET /identity/v3/projects/09e5899a135840f3a8cdeb96945d5623 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:31.015421 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ccef7-1021-44b5-8457-b2be4a001ce8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:31.015421 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ccef7-1021-44b5-8457-b2be4a001ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:31.015421 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ccef7-1021-44b5-8457-b2be4a001ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:31.037383 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-714ccef7-1021-44b5-8457-b2be4a001ce8 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:31.038924 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-714ccef7-1021-44b5-8457-b2be4a001ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:31.058182 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a1091-daa9-4ad1-b22f-d134e93c5850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:31.059111 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a1091-daa9-4ad1-b22f-d134e93c5850 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:31.059385 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a1091-daa9-4ad1-b22f-d134e93c5850 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:31.060182 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a1091-daa9-4ad1-b22f-d134e93c5850 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:31.060850 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a1091-daa9-4ad1-b22f-d134e93c5850 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:31.061150 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a1091-daa9-4ad1-b22f-d134e93c5850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:31.062574 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a1091-daa9-4ad1-b22f-d134e93c5850 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:31.074947 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 190/363] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:13:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:31.075644 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a1091-daa9-4ad1-b22f-d134e93c5850 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:31.118737 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:31.126982 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 174/364] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:31.128531 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ccef7-1021-44b5-8457-b2be4a001ce8 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:31.148267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:31.200689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a1091-daa9-4ad1-b22f-d134e93c5850 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:31.238953 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8cc8a-cf45-4550-9806-b58642876cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:31.239577 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8cc8a-cf45-4550-9806-b58642876cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:31.239818 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8cc8a-cf45-4550-9806-b58642876cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:31.240158 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8cc8a-cf45-4550-9806-b58642876cb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:31.267588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ccef7-1021-44b5-8457-b2be4a001ce8 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:31.315496 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8cc8a-cf45-4550-9806-b58642876cb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:31.316125 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2faf1e-c04d-4031-96e7-7c44f8cb2f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:31.316951 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2faf1e-c04d-4031-96e7-7c44f8cb2f7e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:31.317302 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8cc8a-cf45-4550-9806-b58642876cb9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:31.317546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2faf1e-c04d-4031-96e7-7c44f8cb2f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:31.317958 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2faf1e-c04d-4031-96e7-7c44f8cb2f7e None admin] PATH_INFO: `/v3/groups/b3bcbc40f46e42dcbc4b06c7d682aaea` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:31.319474 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2faf1e-c04d-4031-96e7-7c44f8cb2f7e None admin] RBAC: Authorizing `identity:get_group(group_id=b3bcbc40f46e42dcbc4b06c7d682aaea)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:31.322040 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2faf1e-c04d-4031-96e7-7c44f8cb2f7e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:31.324178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 175/365] 10.222.0.94 () {56 vars in 1180 bytes} [Thu Sep 1 17:13:31 2022] GET /identity/v3/groups/b3bcbc40f46e42dcbc4b06c7d682aaea => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:31.325733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2faf1e-c04d-4031-96e7-7c44f8cb2f7e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:31.384561 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:31.423000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:31.433555 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 191/366] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:13:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:13:31.434628 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8cc8a-cf45-4550-9806-b58642876cb9 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:31.469802 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2faf1e-c04d-4031-96e7-7c44f8cb2f7e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:31.515837 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26698a-8982-4ed4-8be5-72245cb774af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:31.516457 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26698a-8982-4ed4-8be5-72245cb774af None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:31.516733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26698a-8982-4ed4-8be5-72245cb774af None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:31.517231 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26698a-8982-4ed4-8be5-72245cb774af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:31.553509 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8cc8a-cf45-4550-9806-b58642876cb9 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:31.599404 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ab032-5105-4d90-bc58-f4859b76e2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:31.600210 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ab032-5105-4d90-bc58-f4859b76e2be None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:31.600492 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ab032-5105-4d90-bc58-f4859b76e2be None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:31.600760 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ab032-5105-4d90-bc58-f4859b76e2be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:31.601601 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ab032-5105-4d90-bc58-f4859b76e2be None admin] RBAC: Adding query filter params (group.id=b3bcbc40f46e42dcbc4b06c7d682aaea, role.id=a78fbf73b27d4781ac14690bbcb1cd9f, scope.project.id=09e5899a135840f3a8cdeb96945d5623) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:31.601908 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ab032-5105-4d90-bc58-f4859b76e2be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:31.603408 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ab032-5105-4d90-bc58-f4859b76e2be None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:31.610015 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 192/367] 10.222.0.94 () {56 vars in 1376 bytes} [Thu Sep 1 17:13:31 2022] GET /identity/v3/role_assignments?group.id=b3bcbc40f46e42dcbc4b06c7d682aaea&scope.project.id=09e5899a135840f3a8cdeb96945d5623&role.id=a78fbf73b27d4781ac14690bbcb1cd9f => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:31.610945 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ab032-5105-4d90-bc58-f4859b76e2be None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:31.619757 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be26698a-8982-4ed4-8be5-72245cb774af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:31.621254 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be26698a-8982-4ed4-8be5-72245cb774af None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:31.641828 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:31.726398 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:31.745682 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ab032-5105-4d90-bc58-f4859b76e2be None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:31.773556 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 176/368] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:13:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:13:31.774508 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26698a-8982-4ed4-8be5-72245cb774af None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:31.793301 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4ffff-97ad-4a83-86e3-7c237884e8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:31.794361 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4ffff-97ad-4a83-86e3-7c237884e8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:31.794802 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4ffff-97ad-4a83-86e3-7c237884e8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:31.795323 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4ffff-97ad-4a83-86e3-7c237884e8d9 None admin] PATH_INFO: `/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:31.796910 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c4ffff-97ad-4a83-86e3-7c237884e8d9 None admin] RBAC: Authorizing `identity:get_project(project_id=13936e7054f44ceebcd8d6dfa85eb8a7)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:31.798540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c4ffff-97ad-4a83-86e3-7c237884e8d9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:31.801733 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 193/369] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:31 2022] GET /identity/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:31.802858 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4ffff-97ad-4a83-86e3-7c237884e8d9 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:31.890888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26698a-8982-4ed4-8be5-72245cb774af None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:31.930986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:31.936360 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459c42a-581e-4aa7-bb7e-27036eb24422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:31.937339 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459c42a-581e-4aa7-bb7e-27036eb24422 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:31.937543 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459c42a-581e-4aa7-bb7e-27036eb24422 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:31.938124 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459c42a-581e-4aa7-bb7e-27036eb24422 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:31.944690 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4ffff-97ad-4a83-86e3-7c237884e8d9 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:31.953158 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459c42a-581e-4aa7-bb7e-27036eb24422 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:31.958909 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-6459c42a-581e-4aa7-bb7e-27036eb24422 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:13:31.958909 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:31.958909 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:31.958909 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:31.958909 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:31.958909 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:31.958909 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:31.958909 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:31.958909 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:31.958909 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:31.958909 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:31.958909 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:31.958909 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:31.958909 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:31.958909 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:31.958909 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:31.959988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:31.959988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:31.959988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:31.959988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:31.959988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:31.959988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:31.959988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:31.959988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:31.959988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:31.959988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:31.959988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:31.959988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:31.959988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:31.959988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:31.959988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:31.959988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:31.960932 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:31.960932 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:31.960932 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:31.960932 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:31.960932 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:31.960932 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:31.960932 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:31.960932 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:31.960932 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:31.960932 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:31.960932 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:13:31.960932 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:31.962678 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 177/370] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:13:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:31.963691 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459c42a-581e-4aa7-bb7e-27036eb24422 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:31.990106 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf547b-c04f-48ea-9257-7f9a4a3377b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:31.991039 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf547b-c04f-48ea-9257-7f9a4a3377b2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:31.991706 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf547b-c04f-48ea-9257-7f9a4a3377b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:31.992119 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf547b-c04f-48ea-9257-7f9a4a3377b2 None admin] PATH_INFO: `/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:31.994234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf547b-c04f-48ea-9257-7f9a4a3377b2 None admin] RBAC: Authorizing `identity:get_project(project_id=13936e7054f44ceebcd8d6dfa85eb8a7)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:31.996554 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf547b-c04f-48ea-9257-7f9a4a3377b2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:31.999769 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 194/371] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:31 2022] GET /identity/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:32.000741 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf547b-c04f-48ea-9257-7f9a4a3377b2 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:32.020689 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:32.110408 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459c42a-581e-4aa7-bb7e-27036eb24422 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:32.136247 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf547b-c04f-48ea-9257-7f9a4a3377b2 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:32.160628 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af29f0-d03f-48b6-a62f-d2d2ddaadae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:32.161656 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af29f0-d03f-48b6-a62f-d2d2ddaadae0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:32.162134 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af29f0-d03f-48b6-a62f-d2d2ddaadae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:32.162622 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af29f0-d03f-48b6-a62f-d2d2ddaadae0 None admin] PATH_INFO: `/v3/groups/b3bcbc40f46e42dcbc4b06c7d682aaea` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:32.164455 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af29f0-d03f-48b6-a62f-d2d2ddaadae0 None admin] RBAC: Authorizing `identity:get_group(group_id=b3bcbc40f46e42dcbc4b06c7d682aaea)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:32.166816 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af29f0-d03f-48b6-a62f-d2d2ddaadae0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:32.170433 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 178/372] 10.222.0.94 () {56 vars in 1180 bytes} [Thu Sep 1 17:13:31 2022] GET /identity/v3/groups/b3bcbc40f46e42dcbc4b06c7d682aaea => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:32.171382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af29f0-d03f-48b6-a62f-d2d2ddaadae0 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:32.179861 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641acadb-0e8c-4ef9-b4a6-94b038cedad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:32.181050 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641acadb-0e8c-4ef9-b4a6-94b038cedad1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:32.181050 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641acadb-0e8c-4ef9-b4a6-94b038cedad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:32.181220 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641acadb-0e8c-4ef9-b4a6-94b038cedad1 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:32.182024 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641acadb-0e8c-4ef9-b4a6-94b038cedad1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:32.182393 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641acadb-0e8c-4ef9-b4a6-94b038cedad1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:32.183942 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641acadb-0e8c-4ef9-b4a6-94b038cedad1 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:32.193361 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 195/373] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:32.194386 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641acadb-0e8c-4ef9-b4a6-94b038cedad1 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:32.224837 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:32.280752 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:32.288132 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af29f0-d03f-48b6-a62f-d2d2ddaadae0 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:32.309888 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641acadb-0e8c-4ef9-b4a6-94b038cedad1 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:32.325664 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ee9b2-477b-4d9e-b2f1-f5a4af6550e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:32.326724 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ee9b2-477b-4d9e-b2f1-f5a4af6550e2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:32.326980 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ee9b2-477b-4d9e-b2f1-f5a4af6550e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:32.327333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ee9b2-477b-4d9e-b2f1-f5a4af6550e2 None admin] PATH_INFO: `/v3/groups/b3bcbc40f46e42dcbc4b06c7d682aaea` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:32.328544 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ee9b2-477b-4d9e-b2f1-f5a4af6550e2 None admin] RBAC: Authorizing `identity:get_group(group_id=b3bcbc40f46e42dcbc4b06c7d682aaea)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:32.330082 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ee9b2-477b-4d9e-b2f1-f5a4af6550e2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:32.332036 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 179/374] 10.222.0.94 () {56 vars in 1180 bytes} [Thu Sep 1 17:13:32 2022] GET /identity/v3/groups/b3bcbc40f46e42dcbc4b06c7d682aaea => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:32.332941 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ee9b2-477b-4d9e-b2f1-f5a4af6550e2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:32.350335 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aacd268-5d36-44c8-bd3e-fd63554c6349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:32.351304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacd268-5d36-44c8-bd3e-fd63554c6349 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:32.351841 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacd268-5d36-44c8-bd3e-fd63554c6349 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:32.352371 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacd268-5d36-44c8-bd3e-fd63554c6349 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:32.353334 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aacd268-5d36-44c8-bd3e-fd63554c6349 None admin] RBAC: Adding query filter params (group.id=b3bcbc40f46e42dcbc4b06c7d682aaea, role.id=a78fbf73b27d4781ac14690bbcb1cd9f, scope.project.id=13936e7054f44ceebcd8d6dfa85eb8a7) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:32.353893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aacd268-5d36-44c8-bd3e-fd63554c6349 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:32.355596 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aacd268-5d36-44c8-bd3e-fd63554c6349 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:32.362883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 196/375] 10.222.0.94 () {56 vars in 1376 bytes} [Thu Sep 1 17:13:32 2022] GET /identity/v3/role_assignments?group.id=b3bcbc40f46e42dcbc4b06c7d682aaea&scope.project.id=13936e7054f44ceebcd8d6dfa85eb8a7&role.id=a78fbf73b27d4781ac14690bbcb1cd9f => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:32.364001 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aacd268-5d36-44c8-bd3e-fd63554c6349 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:32.458406 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:32.475869 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aacd268-5d36-44c8-bd3e-fd63554c6349 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:32.480091 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ee9b2-477b-4d9e-b2f1-f5a4af6550e2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:32.514259 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393ab44-b890-41aa-a6a8-909e304f4bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:32.515257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393ab44-b890-41aa-a6a8-909e304f4bdb None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:32.515766 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393ab44-b890-41aa-a6a8-909e304f4bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:32.516250 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393ab44-b890-41aa-a6a8-909e304f4bdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:32.517195 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393ab44-b890-41aa-a6a8-909e304f4bdb None admin] RBAC: Adding query filter params (group.id=b3bcbc40f46e42dcbc4b06c7d682aaea, role.id=9131e2ca337e4d1286ef32a4ba63cafa, scope.project.id=13936e7054f44ceebcd8d6dfa85eb8a7) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:32.517877 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393ab44-b890-41aa-a6a8-909e304f4bdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:32.519545 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393ab44-b890-41aa-a6a8-909e304f4bdb None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:32.525960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 197/376] 10.222.0.94 () {56 vars in 1376 bytes} [Thu Sep 1 17:13:32 2022] GET /identity/v3/role_assignments?group.id=b3bcbc40f46e42dcbc4b06c7d682aaea&scope.project.id=13936e7054f44ceebcd8d6dfa85eb8a7&role.id=9131e2ca337e4d1286ef32a4ba63cafa => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:32.539903 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0c7f4-2e03-4586-ae59-84934cf18039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:32.540902 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0c7f4-2e03-4586-ae59-84934cf18039 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:32.541386 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0c7f4-2e03-4586-ae59-84934cf18039 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:32.541907 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0c7f4-2e03-4586-ae59-84934cf18039 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:32.594622 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:32.646660 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac0c7f4-2e03-4586-ae59-84934cf18039 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:32.648497 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac0c7f4-2e03-4586-ae59-84934cf18039 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:32.772868 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 180/377] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:13:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:13:32.779529 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393ab44-b890-41aa-a6a8-909e304f4bdb None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:32.800289 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa044e02-814c-427b-b381-97619e3dc3ea None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:32.802648 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa044e02-814c-427b-b381-97619e3dc3ea None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:32.803286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa044e02-814c-427b-b381-97619e3dc3ea None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:32.805970 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 181/378] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:13:32.812939 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60f14b-4998-419a-b9ff-97b92e5797e3 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:32.813224 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60f14b-4998-419a-b9ff-97b92e5797e3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:32.813569 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60f14b-4998-419a-b9ff-97b92e5797e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:32.840806 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-df60f14b-4998-419a-b9ff-97b92e5797e3 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:32.842054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-df60f14b-4998-419a-b9ff-97b92e5797e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:32.924585 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:32.935645 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393ab44-b890-41aa-a6a8-909e304f4bdb None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:32.937968 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 182/379] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:13:32.996470 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0d568-69fe-4670-911c-717e22937643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:32.997721 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0d568-69fe-4670-911c-717e22937643 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:32.998006 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0d568-69fe-4670-911c-717e22937643 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:32.998352 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0d568-69fe-4670-911c-717e22937643 None admin] PATH_INFO: `/v3/projects/cf6314541ceb40a5aa90aa5d595b2262` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:33.002114 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a0d568-69fe-4670-911c-717e22937643 None admin] RBAC: Authorizing `identity:get_project(project_id=cf6314541ceb40a5aa90aa5d595b2262)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:33.003566 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a0d568-69fe-4670-911c-717e22937643 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:33.005539 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 198/380] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:32 2022] GET /identity/v3/projects/cf6314541ceb40a5aa90aa5d595b2262 => generated 344 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:33.011170 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df60f14b-4998-419a-b9ff-97b92e5797e3 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:33.148274 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df60f14b-4998-419a-b9ff-97b92e5797e3 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:33.188007 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098df1f5-7c67-4fd6-8b59-505023622a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:33.188967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098df1f5-7c67-4fd6-8b59-505023622a2b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:33.189473 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098df1f5-7c67-4fd6-8b59-505023622a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:33.189943 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098df1f5-7c67-4fd6-8b59-505023622a2b None admin] PATH_INFO: `/v3/groups/b44d5aadce1d4852acbc2fe7a54ad900` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:33.198028 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098df1f5-7c67-4fd6-8b59-505023622a2b None admin] RBAC: Authorizing `identity:get_group(group_id=b44d5aadce1d4852acbc2fe7a54ad900)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:33.199713 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098df1f5-7c67-4fd6-8b59-505023622a2b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:33.202956 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 183/381] 10.222.0.94 () {56 vars in 1180 bytes} [Thu Sep 1 17:13:33 2022] GET /identity/v3/groups/b44d5aadce1d4852acbc2fe7a54ad900 => generated 229 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:33.208940 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0d568-69fe-4670-911c-717e22937643 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:33.242836 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:33.344787 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0d568-69fe-4670-911c-717e22937643 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:33.379463 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098df1f5-7c67-4fd6-8b59-505023622a2b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:33.399546 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426c12a-1bf1-40ff-94d8-919c7292c497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:33.400672 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426c12a-1bf1-40ff-94d8-919c7292c497 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:33.401863 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426c12a-1bf1-40ff-94d8-919c7292c497 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:33.402549 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426c12a-1bf1-40ff-94d8-919c7292c497 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:33.404451 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426c12a-1bf1-40ff-94d8-919c7292c497 None admin] RBAC: Adding query filter params (group.id=b44d5aadce1d4852acbc2fe7a54ad900, role.id=70f911a75b7b40a19f65857b9d19cfad, scope.project.id=cf6314541ceb40a5aa90aa5d595b2262) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:33.406403 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426c12a-1bf1-40ff-94d8-919c7292c497 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:33.408077 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426c12a-1bf1-40ff-94d8-919c7292c497 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:33.415340 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 199/382] 10.222.0.94 () {56 vars in 1376 bytes} [Thu Sep 1 17:13:33 2022] GET /identity/v3/role_assignments?group.id=b44d5aadce1d4852acbc2fe7a54ad900&scope.project.id=cf6314541ceb40a5aa90aa5d595b2262&role.id=70f911a75b7b40a19f65857b9d19cfad => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:33.471774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:33.528564 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098df1f5-7c67-4fd6-8b59-505023622a2b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:33.581089 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338354d1-62ca-424c-a4d6-136ec5c785b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:33.582111 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338354d1-62ca-424c-a4d6-136ec5c785b7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:33.582614 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338354d1-62ca-424c-a4d6-136ec5c785b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:33.583108 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338354d1-62ca-424c-a4d6-136ec5c785b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:33.606085 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338354d1-62ca-424c-a4d6-136ec5c785b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:33.612518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-338354d1-62ca-424c-a4d6-136ec5c785b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:13:33.612518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:33.612518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:33.612518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:33.612518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:33.612518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:33.612518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:33.612518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:33.612518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:33.612518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:33.612518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:33.612518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:33.612518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:33.612518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:33.612518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:33.612518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:33.613676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:33.613676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:33.613676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:33.613676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:33.613676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:33.613676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:33.613676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:33.613676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:33.613676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:33.613676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:33.613676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:33.613676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:33.613676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:33.613676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:33.613676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:33.613676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:33.614540 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:33.614540 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:33.614540 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:33.614540 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:33.614540 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:33.614540 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:33.614540 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:33.614540 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:33.614540 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:33.614540 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:33.614540 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:13:33.614540 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:33.616650 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 184/383] 10.222.0.94 () {56 vars in 1114 bytes} [Thu Sep 1 17:13:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:33.623243 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426c12a-1bf1-40ff-94d8-919c7292c497 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:33.735199 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:33.760807 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426c12a-1bf1-40ff-94d8-919c7292c497 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:33.801236 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93bdf5-bb48-481c-9283-2e0b387c0bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:33.802340 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93bdf5-bb48-481c-9283-2e0b387c0bdd None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:33.802840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93bdf5-bb48-481c-9283-2e0b387c0bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:33.803335 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93bdf5-bb48-481c-9283-2e0b387c0bdd None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:33.804197 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93bdf5-bb48-481c-9283-2e0b387c0bdd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:33.804700 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93bdf5-bb48-481c-9283-2e0b387c0bdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:33.806760 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93bdf5-bb48-481c-9283-2e0b387c0bdd None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:33.819365 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 200/384] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:13:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:33.824649 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338354d1-62ca-424c-a4d6-136ec5c785b7 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:33.873824 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82158b-bfe0-4b9d-b63c-fc79f207a02f None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:33.874459 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82158b-bfe0-4b9d-b63c-fc79f207a02f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:33.874962 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82158b-bfe0-4b9d-b63c-fc79f207a02f None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:33.876596 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 201/385] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:33.882454 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fa715-8c05-48ee-b575-208d9f2f3913 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:33.883177 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fa715-8c05-48ee-b575-208d9f2f3913 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:33.883177 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fa715-8c05-48ee-b575-208d9f2f3913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:33.915696 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d77fa715-8c05-48ee-b575-208d9f2f3913 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:33.916879 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d77fa715-8c05-48ee-b575-208d9f2f3913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:33.949662 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338354d1-62ca-424c-a4d6-136ec5c785b7 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:33.971508 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:33.991870 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87842bc0-567b-4e44-8390-8306d9022d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:33.992488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87842bc0-567b-4e44-8390-8306d9022d41 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:33.992771 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87842bc0-567b-4e44-8390-8306d9022d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:33.993042 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87842bc0-567b-4e44-8390-8306d9022d41 None admin] PATH_INFO: `/v3/groups/b3bcbc40f46e42dcbc4b06c7d682aaea` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:33.994255 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87842bc0-567b-4e44-8390-8306d9022d41 None admin] RBAC: Authorizing `identity:get_group(group_id=b3bcbc40f46e42dcbc4b06c7d682aaea)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:33.995726 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87842bc0-567b-4e44-8390-8306d9022d41 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:33.998135 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 185/386] 10.222.0.94 () {56 vars in 1180 bytes} [Thu Sep 1 17:13:33 2022] GET /identity/v3/groups/b3bcbc40f46e42dcbc4b06c7d682aaea => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:34.004710 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87842bc0-567b-4e44-8390-8306d9022d41 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:34.108120 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 202/387] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:13:34.117943 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87842bc0-567b-4e44-8390-8306d9022d41 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:34.156460 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe173bc5-613c-45fd-ac28-fb9bdbe09dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:34.157172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe173bc5-613c-45fd-ac28-fb9bdbe09dce None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:34.157477 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe173bc5-613c-45fd-ac28-fb9bdbe09dce None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:34.157749 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe173bc5-613c-45fd-ac28-fb9bdbe09dce None admin] PATH_INFO: `/v3/projects/09e5899a135840f3a8cdeb96945d5623` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:34.162076 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe173bc5-613c-45fd-ac28-fb9bdbe09dce None admin] RBAC: Authorizing `identity:get_project(project_id=09e5899a135840f3a8cdeb96945d5623)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:34.163518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe173bc5-613c-45fd-ac28-fb9bdbe09dce None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:34.165156 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 186/388] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:34 2022] GET /identity/v3/projects/09e5899a135840f3a8cdeb96945d5623 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:34.171540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fa715-8c05-48ee-b575-208d9f2f3913 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:34.282314 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:34.312214 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fa715-8c05-48ee-b575-208d9f2f3913 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:34.357704 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60a0c2-89e5-460e-acd8-33742d6efdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:34.358453 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60a0c2-89e5-460e-acd8-33742d6efdbb None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:34.358641 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60a0c2-89e5-460e-acd8-33742d6efdbb None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:34.358912 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60a0c2-89e5-460e-acd8-33742d6efdbb None admin] PATH_INFO: `/v3/projects/09e5899a135840f3a8cdeb96945d5623/groups/b3bcbc40f46e42dcbc4b06c7d682aaea/roles/9131e2ca337e4d1286ef32a4ba63cafa` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:34.361042 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60a0c2-89e5-460e-acd8-33742d6efdbb None admin] RBAC: Authorizing `identity:create_grant(project_id=09e5899a135840f3a8cdeb96945d5623, group_id=b3bcbc40f46e42dcbc4b06c7d682aaea, role_id=9131e2ca337e4d1286ef32a4ba63cafa)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:34.362536 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60a0c2-89e5-460e-acd8-33742d6efdbb None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:34.382146 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 203/389] 10.222.0.94 () {58 vars in 1442 bytes} [Thu Sep 1 17:13:34 2022] PUT /identity/v3/projects/09e5899a135840f3a8cdeb96945d5623/groups/b3bcbc40f46e42dcbc4b06c7d682aaea/roles/9131e2ca337e4d1286ef32a4ba63cafa => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:13:34.521238 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe173bc5-613c-45fd-ac28-fb9bdbe09dce None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:34.590032 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:34.643258 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe173bc5-613c-45fd-ac28-fb9bdbe09dce None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:34.682592 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b44432-b75a-4902-9ae3-f4793f28f3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:34.683287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b44432-b75a-4902-9ae3-f4793f28f3ab None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:34.683561 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b44432-b75a-4902-9ae3-f4793f28f3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:34.683823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b44432-b75a-4902-9ae3-f4793f28f3ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:34.694390 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b44432-b75a-4902-9ae3-f4793f28f3ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:34.699627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-05b44432-b75a-4902-9ae3-f4793f28f3ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:13:34.699627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:34.699627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:34.699627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:34.699627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:34.699627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:34.699627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:34.699627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:34.699627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:34.699627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:34.699627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:34.699627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:34.699627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:34.699627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:34.699627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:34.699627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:34.700572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:34.700572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:34.700572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:34.700572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:34.700572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:34.700572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:34.700572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:34.700572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:34.700572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:34.700572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:34.700572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:34.700572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:34.700572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:34.700572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:34.700572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:34.700572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:34.701379 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:34.701379 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:34.701379 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:34.701379 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:34.701379 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:34.701379 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:34.701379 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:34.701379 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:34.701379 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:34.701379 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:34.701379 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:13:34.701379 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:34.701379 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 187/390] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:34.710523 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60a0c2-89e5-460e-acd8-33742d6efdbb None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:34.839140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60a0c2-89e5-460e-acd8-33742d6efdbb None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:34.880838 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb158d-f6a7-455a-96a4-0540c84a0cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:34.881502 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb158d-f6a7-455a-96a4-0540c84a0cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:34.881783 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb158d-f6a7-455a-96a4-0540c84a0cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:34.882051 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb158d-f6a7-455a-96a4-0540c84a0cf7 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:34.882722 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb158d-f6a7-455a-96a4-0540c84a0cf7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:34.883022 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb158d-f6a7-455a-96a4-0540c84a0cf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:34.884400 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb158d-f6a7-455a-96a4-0540c84a0cf7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:34.886012 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:34.887305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccc70c-f03f-4669-b53a-53217cd27bd8 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:34.887569 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccc70c-f03f-4669-b53a-53217cd27bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:34.888765 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccc70c-f03f-4669-b53a-53217cd27bd8 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:34.893633 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 188/391] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:34.895088 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 204/392] 10.222.0.94 () {56 vars in 1101 bytes} [Thu Sep 1 17:13:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:34.895796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca623492-c577-4073-b017-c1d75b58e627 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:34.896187 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca623492-c577-4073-b017-c1d75b58e627 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:34.896459 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca623492-c577-4073-b017-c1d75b58e627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:34.900688 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb158d-f6a7-455a-96a4-0540c84a0cf7 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:34.919109 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ca623492-c577-4073-b017-c1d75b58e627 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:34.920286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ca623492-c577-4073-b017-c1d75b58e627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:35.004462 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 189/393] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:13:35.032350 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb158d-f6a7-455a-96a4-0540c84a0cf7 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:35.068569 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5f183-c10d-445b-a04d-dbf5a1a30d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:35.069579 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5f183-c10d-445b-a04d-dbf5a1a30d40 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:35.070071 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5f183-c10d-445b-a04d-dbf5a1a30d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:35.070541 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5f183-c10d-445b-a04d-dbf5a1a30d40 None admin] PATH_INFO: `/v3/groups/b3bcbc40f46e42dcbc4b06c7d682aaea` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:35.071816 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a5f183-c10d-445b-a04d-dbf5a1a30d40 None admin] RBAC: Authorizing `identity:get_group(group_id=b3bcbc40f46e42dcbc4b06c7d682aaea)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:35.073447 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a5f183-c10d-445b-a04d-dbf5a1a30d40 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:35.076025 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 205/394] 10.222.0.94 () {56 vars in 1180 bytes} [Thu Sep 1 17:13:34 2022] GET /identity/v3/groups/b3bcbc40f46e42dcbc4b06c7d682aaea => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:13:35.081478 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca623492-c577-4073-b017-c1d75b58e627 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:35.149756 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:35.218443 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca623492-c577-4073-b017-c1d75b58e627 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:35.259470 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878a46e-f5e8-481d-ba28-7bd8c90c125a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:35.260105 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878a46e-f5e8-481d-ba28-7bd8c90c125a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:35.260386 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878a46e-f5e8-481d-ba28-7bd8c90c125a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:35.260656 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878a46e-f5e8-481d-ba28-7bd8c90c125a None admin] PATH_INFO: `/v3/projects/09e5899a135840f3a8cdeb96945d5623` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:35.261806 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878a46e-f5e8-481d-ba28-7bd8c90c125a None admin] RBAC: Authorizing `identity:get_project(project_id=09e5899a135840f3a8cdeb96945d5623)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:35.263276 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878a46e-f5e8-481d-ba28-7bd8c90c125a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:35.264907 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 190/395] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:35 2022] GET /identity/v3/projects/09e5899a135840f3a8cdeb96945d5623 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:35.270861 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5f183-c10d-445b-a04d-dbf5a1a30d40 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:35.347258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:35.379548 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d41d1-8e85-4134-b7c4-2329240389df None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:35.379866 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d41d1-8e85-4134-b7c4-2329240389df None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:35.380107 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d41d1-8e85-4134-b7c4-2329240389df None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:35.381753 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 191/396] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:35.386778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d98f4-50f9-4401-9282-010959678c8f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:35.386926 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d98f4-50f9-4401-9282-010959678c8f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:35.387173 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d98f4-50f9-4401-9282-010959678c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:35.396877 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5f183-c10d-445b-a04d-dbf5a1a30d40 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:35.418632 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-709d98f4-50f9-4401-9282-010959678c8f None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:35.419890 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-709d98f4-50f9-4401-9282-010959678c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:35.437788 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea5cf8-7dba-4dac-8f0d-e8ffd8a7ad92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:35.438755 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea5cf8-7dba-4dac-8f0d-e8ffd8a7ad92 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:35.439345 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea5cf8-7dba-4dac-8f0d-e8ffd8a7ad92 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:35.439816 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea5cf8-7dba-4dac-8f0d-e8ffd8a7ad92 None admin] PATH_INFO: `/v3/projects/09e5899a135840f3a8cdeb96945d5623/groups/b3bcbc40f46e42dcbc4b06c7d682aaea/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:35.441968 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea5cf8-7dba-4dac-8f0d-e8ffd8a7ad92 None admin] RBAC: Authorizing `identity:create_grant(project_id=09e5899a135840f3a8cdeb96945d5623, group_id=b3bcbc40f46e42dcbc4b06c7d682aaea, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:35.450024 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea5cf8-7dba-4dac-8f0d-e8ffd8a7ad92 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:35.473499 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 206/397] 10.222.0.94 () {58 vars in 1442 bytes} [Thu Sep 1 17:13:35 2022] PUT /identity/v3/projects/09e5899a135840f3a8cdeb96945d5623/groups/b3bcbc40f46e42dcbc4b06c7d682aaea/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:13:35.474416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea5cf8-7dba-4dac-8f0d-e8ffd8a7ad92 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:35.560329 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 192/398] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:35.719383 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea5cf8-7dba-4dac-8f0d-e8ffd8a7ad92 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:35.756834 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:35.771800 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9de24-9782-40b7-8957-b9c770f14d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:35.772786 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9de24-9782-40b7-8957-b9c770f14d1f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:35.773269 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9de24-9782-40b7-8957-b9c770f14d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:35.773791 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9de24-9782-40b7-8957-b9c770f14d1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:35.790619 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9de24-9782-40b7-8957-b9c770f14d1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:35.796307 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-32b9de24-9782-40b7-8957-b9c770f14d1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:13:35.796307 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:35.796307 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:35.796307 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:35.796307 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:35.796307 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:35.796307 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:35.796307 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:35.796307 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:35.796307 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:35.796307 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:35.796307 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:35.796307 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:35.796307 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:35.796307 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:35.796307 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:35.797227 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:35.797227 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:35.797227 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:35.797227 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:35.797227 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:35.797227 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:35.797227 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:35.797227 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:35.797227 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:35.797227 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:35.797227 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:35.797227 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:35.797227 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:35.797227 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:35.797227 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:35.797227 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:35.798061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:35.798061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:35.798061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:35.798061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:35.798061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:35.798061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:35.798061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:35.798061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:35.798061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:35.798061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:35.798061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:13:35.798061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:35.800290 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 207/399] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:35.806212 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d98f4-50f9-4401-9282-010959678c8f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:35.882950 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:35.885283 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9de24-9782-40b7-8957-b9c770f14d1f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:35.964488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d98f4-50f9-4401-9282-010959678c8f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:36.006825 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ae9ec-83f4-4d49-9cc7-d5145d55d698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:36.007363 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ae9ec-83f4-4d49-9cc7-d5145d55d698 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:36.007644 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ae9ec-83f4-4d49-9cc7-d5145d55d698 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:36.007918 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ae9ec-83f4-4d49-9cc7-d5145d55d698 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:36.008594 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ae9ec-83f4-4d49-9cc7-d5145d55d698 None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:36.008900 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ae9ec-83f4-4d49-9cc7-d5145d55d698 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:36.010311 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ae9ec-83f4-4d49-9cc7-d5145d55d698 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:36.020875 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 193/400] 10.222.0.94 () {56 vars in 1101 bytes} [Thu Sep 1 17:13:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:36.027206 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ae9ec-83f4-4d49-9cc7-d5145d55d698 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:36.095459 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9de24-9782-40b7-8957-b9c770f14d1f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:36.144123 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ae9ec-83f4-4d49-9cc7-d5145d55d698 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:36.146505 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:36.161887 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bfe5f-2fe4-4fee-98a7-c096fd06bd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:36.162526 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bfe5f-2fe4-4fee-98a7-c096fd06bd9f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:36.162804 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bfe5f-2fe4-4fee-98a7-c096fd06bd9f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:36.163073 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bfe5f-2fe4-4fee-98a7-c096fd06bd9f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:36.174714 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595bfe5f-2fe4-4fee-98a7-c096fd06bd9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:36.179558 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-595bfe5f-2fe4-4fee-98a7-c096fd06bd9f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:13:36.179558 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:36.179558 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:36.179558 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:36.179558 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:36.179558 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:36.179558 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:36.179558 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:36.179558 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:36.179558 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:36.179558 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:36.179558 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:36.179558 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:36.179558 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:36.179558 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:36.179558 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:36.180639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:36.180639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:36.180639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:36.180639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:36.180639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:36.180639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:36.180639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:36.180639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:36.180639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:36.180639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:36.180639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:36.180639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:36.180639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:36.180639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:36.180639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:36.180639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:36.181546 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:36.181546 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:36.181546 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:36.181546 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:36.181546 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:36.181546 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:36.181546 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:36.181546 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:36.181546 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:36.181546 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:36.181546 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:13:36.181546 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:36.181546 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 208/401] 10.222.0.94 () {56 vars in 1114 bytes} [Thu Sep 1 17:13:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:36.182202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c9756-9595-4134-81ef-12e150d7066e None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:36.182202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c9756-9595-4134-81ef-12e150d7066e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:36.182952 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c9756-9595-4134-81ef-12e150d7066e None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:36.188641 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 209/402] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:36.189804 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d954f2-d733-4ab5-8430-077c4e06fc4d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:36.190059 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636a534-407f-4520-a508-2352129e5f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:36.190181 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d954f2-d733-4ab5-8430-077c4e06fc4d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:36.190373 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d954f2-d733-4ab5-8430-077c4e06fc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:36.190692 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636a534-407f-4520-a508-2352129e5f60 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:36.190973 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636a534-407f-4520-a508-2352129e5f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:36.191244 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636a534-407f-4520-a508-2352129e5f60 None admin] PATH_INFO: `/v3/groups/b3bcbc40f46e42dcbc4b06c7d682aaea` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:36.192374 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636a534-407f-4520-a508-2352129e5f60 None admin] RBAC: Authorizing `identity:get_group(group_id=b3bcbc40f46e42dcbc4b06c7d682aaea)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:36.194131 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636a534-407f-4520-a508-2352129e5f60 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:36.197015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 194/403] 10.222.0.94 () {56 vars in 1180 bytes} [Thu Sep 1 17:13:36 2022] GET /identity/v3/groups/b3bcbc40f46e42dcbc4b06c7d682aaea => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:13:36.202125 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636a534-407f-4520-a508-2352129e5f60 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:36.213610 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-07d954f2-d733-4ab5-8430-077c4e06fc4d None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:36.214799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-07d954f2-d733-4ab5-8430-077c4e06fc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:36.253786 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:36.293168 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 210/404] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:36.294582 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d954f2-d733-4ab5-8430-077c4e06fc4d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:36.360385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636a534-407f-4520-a508-2352129e5f60 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:36.408328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d954f2-d733-4ab5-8430-077c4e06fc4d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:36.439257 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9040326-09d9-4aa6-9876-c369fc31a7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:36.440018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9040326-09d9-4aa6-9876-c369fc31a7fc None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:36.440228 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9040326-09d9-4aa6-9876-c369fc31a7fc None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:36.440501 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9040326-09d9-4aa6-9876-c369fc31a7fc None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:36.441165 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9040326-09d9-4aa6-9876-c369fc31a7fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:36.441544 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9040326-09d9-4aa6-9876-c369fc31a7fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:36.442840 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9040326-09d9-4aa6-9876-c369fc31a7fc None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:36.448906 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4394361-e061-4cac-ba74-a54b5ace6c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:36.450048 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4394361-e061-4cac-ba74-a54b5ace6c9d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:36.451046 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4394361-e061-4cac-ba74-a54b5ace6c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:36.452164 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4394361-e061-4cac-ba74-a54b5ace6c9d None admin] PATH_INFO: `/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:36.453515 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4394361-e061-4cac-ba74-a54b5ace6c9d None admin] RBAC: Authorizing `identity:get_project(project_id=13936e7054f44ceebcd8d6dfa85eb8a7)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:36.455201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4394361-e061-4cac-ba74-a54b5ace6c9d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:36.457362 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 211/405] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:36 2022] GET /identity/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:36.463873 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4394361-e061-4cac-ba74-a54b5ace6c9d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:36.468304 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 195/406] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:13:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:36.474862 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9040326-09d9-4aa6-9876-c369fc31a7fc None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:36.514408 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:36.566037 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:36.612683 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4394361-e061-4cac-ba74-a54b5ace6c9d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:36.650895 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985c0ac-51a7-4666-b4c9-a636e27183a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:36.651946 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985c0ac-51a7-4666-b4c9-a636e27183a8 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:36.652525 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985c0ac-51a7-4666-b4c9-a636e27183a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:36.653009 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985c0ac-51a7-4666-b4c9-a636e27183a8 None admin] PATH_INFO: `/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7/groups/b3bcbc40f46e42dcbc4b06c7d682aaea/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:36.655736 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985c0ac-51a7-4666-b4c9-a636e27183a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=13936e7054f44ceebcd8d6dfa85eb8a7, group_id=b3bcbc40f46e42dcbc4b06c7d682aaea, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:36.657686 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985c0ac-51a7-4666-b4c9-a636e27183a8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:36.683940 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 212/407] 10.222.0.94 () {58 vars in 1442 bytes} [Thu Sep 1 17:13:36 2022] PUT /identity/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7/groups/b3bcbc40f46e42dcbc4b06c7d682aaea/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:13:36.691612 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985c0ac-51a7-4666-b4c9-a636e27183a8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:36.726375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9040326-09d9-4aa6-9876-c369fc31a7fc None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:36.770099 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca655b45-b9d4-4e85-9afd-8d5aed7fe171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:36.770751 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca655b45-b9d4-4e85-9afd-8d5aed7fe171 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:36.771026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca655b45-b9d4-4e85-9afd-8d5aed7fe171 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:36.771295 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca655b45-b9d4-4e85-9afd-8d5aed7fe171 None admin] PATH_INFO: `/v3/groups/b3bcbc40f46e42dcbc4b06c7d682aaea` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:36.772846 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca655b45-b9d4-4e85-9afd-8d5aed7fe171 None admin] RBAC: Authorizing `identity:get_group(group_id=b3bcbc40f46e42dcbc4b06c7d682aaea)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:36.775866 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca655b45-b9d4-4e85-9afd-8d5aed7fe171 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:36.777588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 196/408] 10.222.0.94 () {56 vars in 1180 bytes} [Thu Sep 1 17:13:36 2022] GET /identity/v3/groups/b3bcbc40f46e42dcbc4b06c7d682aaea => generated 226 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:13:36.783589 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca655b45-b9d4-4e85-9afd-8d5aed7fe171 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:36.922295 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985c0ac-51a7-4666-b4c9-a636e27183a8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:36.924360 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:36.942661 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca655b45-b9d4-4e85-9afd-8d5aed7fe171 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:36.944888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:36.964386 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2dc5f-20d8-4478-a2c6-b86db6f26c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:36.965021 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2dc5f-20d8-4478-a2c6-b86db6f26c18 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:36.965294 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2dc5f-20d8-4478-a2c6-b86db6f26c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:36.965585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2dc5f-20d8-4478-a2c6-b86db6f26c18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:36.976077 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2dc5f-20d8-4478-a2c6-b86db6f26c18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:36.981247 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-b2e2dc5f-20d8-4478-a2c6-b86db6f26c18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:13:36.981247 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:36.981247 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:36.981247 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:36.981247 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:36.981247 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:36.981247 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:36.981247 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:36.981247 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:36.981247 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:36.981247 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:36.981247 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:36.981247 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:36.981247 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:36.981247 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:36.981247 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:36.982262 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:36.982262 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:36.982262 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:36.982262 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:36.982262 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:36.982262 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:36.982262 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:36.982262 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:36.982262 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:36.982262 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:36.982262 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:36.982262 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:36.982262 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:36.982262 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:36.982262 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:36.982262 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:36.983112 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:36.983112 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:36.983112 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:36.983112 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:36.983112 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:36.983112 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:36.983112 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:36.983112 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:36.983112 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:36.983112 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:36.983112 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:13:36.983112 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:36.983112 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 213/409] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:13:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:36.984611 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e753ae9-7289-41ba-82dd-c5936f4055c8 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:36.984611 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e753ae9-7289-41ba-82dd-c5936f4055c8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:36.984611 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e753ae9-7289-41ba-82dd-c5936f4055c8 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:36.990312 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 214/410] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:36.991734 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e753ae9-7289-41ba-82dd-c5936f4055c8 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:36.994548 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6219e-e225-40e3-8493-84b58af7d301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:36.996373 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6219e-e225-40e3-8493-84b58af7d301 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:36.996839 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6219e-e225-40e3-8493-84b58af7d301 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:37.001196 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6219e-e225-40e3-8493-84b58af7d301 None admin] PATH_INFO: `/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:37.002683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6219e-e225-40e3-8493-84b58af7d301 None admin] RBAC: Authorizing `identity:get_project(project_id=13936e7054f44ceebcd8d6dfa85eb8a7)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:37.005191 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6219e-e225-40e3-8493-84b58af7d301 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:37.012724 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 197/411] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:36 2022] GET /identity/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:37.015071 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715befe-798c-493f-8ba6-c1bf2a9335d5 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:37.015573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715befe-798c-493f-8ba6-c1bf2a9335d5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:37.016247 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715befe-798c-493f-8ba6-c1bf2a9335d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:37.039398 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a715befe-798c-493f-8ba6-c1bf2a9335d5 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:37.041355 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a715befe-798c-493f-8ba6-c1bf2a9335d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:37.108486 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e753ae9-7289-41ba-82dd-c5936f4055c8 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:37.137286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 198/412] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:37.138372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715befe-798c-493f-8ba6-c1bf2a9335d5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:37.148892 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed0cbe-8a36-46b7-804a-39334d4e2434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:37.149841 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed0cbe-8a36-46b7-804a-39334d4e2434 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:37.150358 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed0cbe-8a36-46b7-804a-39334d4e2434 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:37.150789 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed0cbe-8a36-46b7-804a-39334d4e2434 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:37.151662 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed0cbe-8a36-46b7-804a-39334d4e2434 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:37.152115 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed0cbe-8a36-46b7-804a-39334d4e2434 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:37.153884 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed0cbe-8a36-46b7-804a-39334d4e2434 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:37.164079 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 215/413] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:37.170590 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed0cbe-8a36-46b7-804a-39334d4e2434 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:37.225250 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:37.313379 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed0cbe-8a36-46b7-804a-39334d4e2434 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:37.348732 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc271bf-c03a-405b-9e09-4f1745c4c805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:37.349761 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc271bf-c03a-405b-9e09-4f1745c4c805 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:37.350324 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc271bf-c03a-405b-9e09-4f1745c4c805 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:37.350912 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc271bf-c03a-405b-9e09-4f1745c4c805 None admin] PATH_INFO: `/v3/groups/b44d5aadce1d4852acbc2fe7a54ad900` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:37.352238 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc271bf-c03a-405b-9e09-4f1745c4c805 None admin] RBAC: Authorizing `identity:get_group(group_id=b44d5aadce1d4852acbc2fe7a54ad900)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:37.353928 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc271bf-c03a-405b-9e09-4f1745c4c805 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:37.356189 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 216/414] 10.222.0.94 () {56 vars in 1180 bytes} [Thu Sep 1 17:13:37 2022] GET /identity/v3/groups/b44d5aadce1d4852acbc2fe7a54ad900 => generated 229 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:13:37.366368 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc271bf-c03a-405b-9e09-4f1745c4c805 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:37.373733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:37.379487 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715befe-798c-493f-8ba6-c1bf2a9335d5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:37.449935 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3077c9-64ba-4749-a317-0988540bf284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:37.450655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3077c9-64ba-4749-a317-0988540bf284 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:37.450955 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3077c9-64ba-4749-a317-0988540bf284 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:37.451188 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3077c9-64ba-4749-a317-0988540bf284 None admin] PATH_INFO: `/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7/groups/b3bcbc40f46e42dcbc4b06c7d682aaea/roles/9131e2ca337e4d1286ef32a4ba63cafa` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:37.456507 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3077c9-64ba-4749-a317-0988540bf284 None admin] RBAC: Authorizing `identity:create_grant(project_id=13936e7054f44ceebcd8d6dfa85eb8a7, group_id=b3bcbc40f46e42dcbc4b06c7d682aaea, role_id=9131e2ca337e4d1286ef32a4ba63cafa)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:37.457976 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3077c9-64ba-4749-a317-0988540bf284 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:37.481121 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 199/415] 10.222.0.94 () {58 vars in 1442 bytes} [Thu Sep 1 17:13:37 2022] PUT /identity/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7/groups/b3bcbc40f46e42dcbc4b06c7d682aaea/roles/9131e2ca337e4d1286ef32a4ba63cafa => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:13:37.482270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3077c9-64ba-4749-a317-0988540bf284 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:37.548107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:37.570209 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc271bf-c03a-405b-9e09-4f1745c4c805 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:37.636340 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07488bf3-b147-486e-b0ea-eab5836b07b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:37.637361 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07488bf3-b147-486e-b0ea-eab5836b07b2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:37.637950 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07488bf3-b147-486e-b0ea-eab5836b07b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:37.638423 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07488bf3-b147-486e-b0ea-eab5836b07b2 None admin] PATH_INFO: `/v3/projects/cf6314541ceb40a5aa90aa5d595b2262` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:37.639945 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07488bf3-b147-486e-b0ea-eab5836b07b2 None admin] RBAC: Authorizing `identity:get_project(project_id=cf6314541ceb40a5aa90aa5d595b2262)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:37.641638 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07488bf3-b147-486e-b0ea-eab5836b07b2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:37.643687 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 217/416] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:37 2022] GET /identity/v3/projects/cf6314541ceb40a5aa90aa5d595b2262 => generated 344 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:37.651323 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07488bf3-b147-486e-b0ea-eab5836b07b2 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:37.667685 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3077c9-64ba-4749-a317-0988540bf284 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:37.702772 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d86a5e-3ecc-4735-a8e5-c9680bb91db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:37.703441 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d86a5e-3ecc-4735-a8e5-c9680bb91db0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:37.703691 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d86a5e-3ecc-4735-a8e5-c9680bb91db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:37.703944 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d86a5e-3ecc-4735-a8e5-c9680bb91db0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:37.718049 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d86a5e-3ecc-4735-a8e5-c9680bb91db0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:37.722823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-48d86a5e-3ecc-4735-a8e5-c9680bb91db0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:13:37.722823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:37.722823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:37.722823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:37.722823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:37.722823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:37.722823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:37.722823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:37.722823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:37.722823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:37.722823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:37.722823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:37.722823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:37.722823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:37.722823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:37.722823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:37.723747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:37.723747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:37.723747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:37.723747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:37.723747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:37.723747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:37.723747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:37.723747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:37.723747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:37.723747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:37.723747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:37.723747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:37.723747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:37.723747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:37.723747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:37.723747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:37.724552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:37.724552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:37.724552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:37.724552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:37.724552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:37.724552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:37.724552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:37.724552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:37.724552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:37.724552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:37.724552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:13:37.724552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:37.724552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 200/417] 10.222.0.94 () {56 vars in 1114 bytes} [Thu Sep 1 17:13:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:37.725218 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b785885-13c1-4ce2-a369-331d36f9e4bf None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:37.725833 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b785885-13c1-4ce2-a369-331d36f9e4bf None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:37.725945 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b785885-13c1-4ce2-a369-331d36f9e4bf None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:37.727279 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 201/418] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:37.731255 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b785885-13c1-4ce2-a369-331d36f9e4bf None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:37.757799 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:37.796236 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07488bf3-b147-486e-b0ea-eab5836b07b2 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:37.834828 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0bdaf-e5d7-4e9f-a7c3-f7623684c41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:37.836695 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0bdaf-e5d7-4e9f-a7c3-f7623684c41d None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:37.836974 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0bdaf-e5d7-4e9f-a7c3-f7623684c41d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:37.837243 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0bdaf-e5d7-4e9f-a7c3-f7623684c41d None admin] PATH_INFO: `/v3/projects/cf6314541ceb40a5aa90aa5d595b2262/groups/b44d5aadce1d4852acbc2fe7a54ad900/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:37.840630 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a0bdaf-e5d7-4e9f-a7c3-f7623684c41d None admin] RBAC: Authorizing `identity:create_grant(project_id=cf6314541ceb40a5aa90aa5d595b2262, group_id=b44d5aadce1d4852acbc2fe7a54ad900, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:37.844031 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a0bdaf-e5d7-4e9f-a7c3-f7623684c41d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:37.862744 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 218/419] 10.222.0.94 () {58 vars in 1442 bytes} [Thu Sep 1 17:13:37 2022] PUT /identity/v3/projects/cf6314541ceb40a5aa90aa5d595b2262/groups/b44d5aadce1d4852acbc2fe7a54ad900/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:13:37.864730 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c9de3-9ee3-494d-87b0-d037b4f1e398 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:37.865046 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b785885-13c1-4ce2-a369-331d36f9e4bf None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:37.865595 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c9de3-9ee3-494d-87b0-d037b4f1e398 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:37.866087 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c9de3-9ee3-494d-87b0-d037b4f1e398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:37.898114 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-af5c9de3-9ee3-494d-87b0-d037b4f1e398 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:37.902931 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-af5c9de3-9ee3-494d-87b0-d037b4f1e398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:37.938631 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51772eee-addd-4a0a-927c-527d0967c4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:37.939263 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51772eee-addd-4a0a-927c-527d0967c4c4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:37.939540 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51772eee-addd-4a0a-927c-527d0967c4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:37.939770 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:37.939870 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51772eee-addd-4a0a-927c-527d0967c4c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:37.943975 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51772eee-addd-4a0a-927c-527d0967c4c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:37.944318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51772eee-addd-4a0a-927c-527d0967c4c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:37.948053 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51772eee-addd-4a0a-927c-527d0967c4c4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:37.971377 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 202/420] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:13:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:37.976609 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51772eee-addd-4a0a-927c-527d0967c4c4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:38.053634 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 219/421] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:38.096305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:38.116203 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51772eee-addd-4a0a-927c-527d0967c4c4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:38.150762 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbb694-bbb9-42e8-a572-36e72fbf5efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:38.151717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbb694-bbb9-42e8-a572-36e72fbf5efc None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:38.152193 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbb694-bbb9-42e8-a572-36e72fbf5efc None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:38.152678 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbb694-bbb9-42e8-a572-36e72fbf5efc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:38.221389 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbb694-bbb9-42e8-a572-36e72fbf5efc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:38.223237 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbb694-bbb9-42e8-a572-36e72fbf5efc None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:38.306223 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:38.324477 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 203/422] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:13:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:13:38.330215 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c9de3-9ee3-494d-87b0-d037b4f1e398 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:38.407650 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbb694-bbb9-42e8-a572-36e72fbf5efc None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:38.468901 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c9de3-9ee3-494d-87b0-d037b4f1e398 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:38.515177 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef658ef2-e7d0-4d4d-b7cb-a99af6b3af7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:38.516946 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef658ef2-e7d0-4d4d-b7cb-a99af6b3af7f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:38.518638 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef658ef2-e7d0-4d4d-b7cb-a99af6b3af7f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:38.519134 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef658ef2-e7d0-4d4d-b7cb-a99af6b3af7f None admin] PATH_INFO: `/v3/projects/09e5899a135840f3a8cdeb96945d5623` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:38.521327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef658ef2-e7d0-4d4d-b7cb-a99af6b3af7f None admin] RBAC: Authorizing `identity:get_project(project_id=09e5899a135840f3a8cdeb96945d5623)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:38.523971 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef658ef2-e7d0-4d4d-b7cb-a99af6b3af7f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:38.529767 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 220/423] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:38 2022] GET /identity/v3/projects/09e5899a135840f3a8cdeb96945d5623 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:38.533194 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef658ef2-e7d0-4d4d-b7cb-a99af6b3af7f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:38.585864 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:38.617914 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbb694-bbb9-42e8-a572-36e72fbf5efc None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:38.685125 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e959220-c7e8-4c15-a700-b71f6a086be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:38.685925 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e959220-c7e8-4c15-a700-b71f6a086be6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:38.686103 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e959220-c7e8-4c15-a700-b71f6a086be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:38.686354 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e959220-c7e8-4c15-a700-b71f6a086be6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:38.693922 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef658ef2-e7d0-4d4d-b7cb-a99af6b3af7f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:38.706139 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e959220-c7e8-4c15-a700-b71f6a086be6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:38.712385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-2e959220-c7e8-4c15-a700-b71f6a086be6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:13:38.712385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:38.712385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:38.712385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:38.712385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:38.712385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:38.712385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:38.712385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:38.712385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:38.712385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:38.712385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:38.712385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:38.712385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:38.712385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:38.712385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:38.712385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:38.713290 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:38.713290 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:38.713290 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:38.713290 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:38.713290 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:38.713290 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:38.713290 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:38.713290 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:38.713290 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:38.713290 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:38.713290 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:38.713290 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:38.713290 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:38.713290 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:38.713290 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:38.713290 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:38.714126 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:38.714126 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:38.714126 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:38.714126 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:38.714126 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:38.714126 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:38.714126 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:38.714126 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:38.714126 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:38.714126 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:38.714126 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:13:38.714126 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:38.714126 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 204/424] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:38.717689 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e959220-c7e8-4c15-a700-b71f6a086be6 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:38.759760 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1349283-28c3-4826-8052-4bd0e50ce1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:38.760747 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1349283-28c3-4826-8052-4bd0e50ce1de None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:38.761230 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1349283-28c3-4826-8052-4bd0e50ce1de None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:38.761702 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1349283-28c3-4826-8052-4bd0e50ce1de None admin] PATH_INFO: `/v3/groups/b3bcbc40f46e42dcbc4b06c7d682aaea` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:38.763699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1349283-28c3-4826-8052-4bd0e50ce1de None admin] RBAC: Authorizing `identity:get_group(group_id=b3bcbc40f46e42dcbc4b06c7d682aaea)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:38.765350 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1349283-28c3-4826-8052-4bd0e50ce1de None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:38.767489 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 221/425] 10.222.0.94 () {56 vars in 1180 bytes} [Thu Sep 1 17:13:38 2022] GET /identity/v3/groups/b3bcbc40f46e42dcbc4b06c7d682aaea => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:38.773346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1349283-28c3-4826-8052-4bd0e50ce1de None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:38.795926 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:38.882729 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e959220-c7e8-4c15-a700-b71f6a086be6 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:38.889314 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:38.907160 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1349283-28c3-4826-8052-4bd0e50ce1de None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:38.917183 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275b8f6-90dc-4b4d-b75e-8528f706c092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:38.917828 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275b8f6-90dc-4b4d-b75e-8528f706c092 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:38.918102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275b8f6-90dc-4b4d-b75e-8528f706c092 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:38.918368 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275b8f6-90dc-4b4d-b75e-8528f706c092 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:38.919048 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275b8f6-90dc-4b4d-b75e-8528f706c092 None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:38.919858 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275b8f6-90dc-4b4d-b75e-8528f706c092 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:38.921221 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275b8f6-90dc-4b4d-b75e-8528f706c092 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:38.934192 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 205/426] 10.222.0.94 () {56 vars in 1101 bytes} [Thu Sep 1 17:13:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:38.934192 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee1f02-30e8-47e3-b8ff-81c72d8218e9 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:38.934192 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee1f02-30e8-47e3-b8ff-81c72d8218e9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:38.934192 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee1f02-30e8-47e3-b8ff-81c72d8218e9 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:38.934192 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 206/427] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:38.942992 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee1f02-30e8-47e3-b8ff-81c72d8218e9 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:38.955792 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f762fc-9375-4fea-8e2c-3702445a8f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:38.957087 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f762fc-9375-4fea-8e2c-3702445a8f39 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:38.957572 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f762fc-9375-4fea-8e2c-3702445a8f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:38.958048 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f762fc-9375-4fea-8e2c-3702445a8f39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:38.959637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f762fc-9375-4fea-8e2c-3702445a8f39 None admin] RBAC: Adding query filter params (group.id=b3bcbc40f46e42dcbc4b06c7d682aaea, role.id=9131e2ca337e4d1286ef32a4ba63cafa, scope.project.id=09e5899a135840f3a8cdeb96945d5623) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:38.960123 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f762fc-9375-4fea-8e2c-3702445a8f39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:38.962530 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f762fc-9375-4fea-8e2c-3702445a8f39 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:38.970882 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 222/428] 10.222.0.94 () {56 vars in 1376 bytes} [Thu Sep 1 17:13:38 2022] GET /identity/v3/role_assignments?group.id=b3bcbc40f46e42dcbc4b06c7d682aaea&scope.project.id=09e5899a135840f3a8cdeb96945d5623&role.id=9131e2ca337e4d1286ef32a4ba63cafa => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:13:38.972803 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5130e8-9955-4249-9c35-3639236651cb None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:38.973267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5130e8-9955-4249-9c35-3639236651cb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:38.973744 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5130e8-9955-4249-9c35-3639236651cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:38.993268 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-eb5130e8-9955-4249-9c35-3639236651cb None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:38.994816 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-eb5130e8-9955-4249-9c35-3639236651cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:39.083987 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee1f02-30e8-47e3-b8ff-81c72d8218e9 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:39.087219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:39.092942 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 223/429] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:39.146278 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af1c0f-38f4-484e-8a99-07e4f8c9a8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:39.146826 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af1c0f-38f4-484e-8a99-07e4f8c9a8ea None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:39.147108 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af1c0f-38f4-484e-8a99-07e4f8c9a8ea None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:39.147379 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af1c0f-38f4-484e-8a99-07e4f8c9a8ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:39.228837 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af1c0f-38f4-484e-8a99-07e4f8c9a8ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:39.230678 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af1c0f-38f4-484e-8a99-07e4f8c9a8ea None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:39.336646 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 207/430] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:13:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:13:39.343097 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5130e8-9955-4249-9c35-3639236651cb None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:39.441134 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:39.466597 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af1c0f-38f4-484e-8a99-07e4f8c9a8ea None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:39.469378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5130e8-9955-4249-9c35-3639236651cb None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:39.471180 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:39.520733 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6862df6-58d4-45a9-beba-f5b97c8a9240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:39.521684 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6862df6-58d4-45a9-beba-f5b97c8a9240 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:39.522053 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6862df6-58d4-45a9-beba-f5b97c8a9240 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:39.522414 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6862df6-58d4-45a9-beba-f5b97c8a9240 None admin] PATH_INFO: `/v3/projects/09e5899a135840f3a8cdeb96945d5623` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:39.523650 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6862df6-58d4-45a9-beba-f5b97c8a9240 None admin] RBAC: Authorizing `identity:get_project(project_id=09e5899a135840f3a8cdeb96945d5623)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:39.525385 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6862df6-58d4-45a9-beba-f5b97c8a9240 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:39.527470 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 224/431] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:39 2022] GET /identity/v3/projects/09e5899a135840f3a8cdeb96945d5623 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:39.533135 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6862df6-58d4-45a9-beba-f5b97c8a9240 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:39.594579 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af1c0f-38f4-484e-8a99-07e4f8c9a8ea None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:39.638078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b05a50-7df7-43a7-b9f9-9ee802cc22fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:39.638783 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b05a50-7df7-43a7-b9f9-9ee802cc22fe None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:39.639357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b05a50-7df7-43a7-b9f9-9ee802cc22fe None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:39.639629 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b05a50-7df7-43a7-b9f9-9ee802cc22fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:39.647728 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6862df6-58d4-45a9-beba-f5b97c8a9240 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:39.652400 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b05a50-7df7-43a7-b9f9-9ee802cc22fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:39.658489 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-10b05a50-7df7-43a7-b9f9-9ee802cc22fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:13:39.658489 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:39.658489 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:39.658489 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:39.658489 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:39.658489 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:39.658489 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:39.658489 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:39.658489 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:39.658489 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:39.658489 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:39.658489 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:39.658489 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:39.658489 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:39.658489 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:39.658489 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:39.659590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:39.659590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:39.659590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:39.659590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:39.659590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:39.659590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:39.659590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:39.659590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:39.659590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:39.659590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:39.659590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:39.659590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:39.659590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:39.659590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:39.659590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:39.659590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:39.660595 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:39.660595 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:39.660595 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:39.660595 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:39.660595 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:39.660595 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:39.660595 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:39.660595 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:39.660595 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:39.660595 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:39.660595 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 17:13:39.660595 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:39.664744 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 208/432] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:13:39.665757 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b05a50-7df7-43a7-b9f9-9ee802cc22fe None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:39.690741 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e19fd0-f05a-4f6c-b19d-0c682c0c6f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:39.691786 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e19fd0-f05a-4f6c-b19d-0c682c0c6f86 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:39.692332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e19fd0-f05a-4f6c-b19d-0c682c0c6f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:39.692614 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e19fd0-f05a-4f6c-b19d-0c682c0c6f86 None admin] PATH_INFO: `/v3/groups/b3bcbc40f46e42dcbc4b06c7d682aaea` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:39.693773 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e19fd0-f05a-4f6c-b19d-0c682c0c6f86 None admin] RBAC: Authorizing `identity:get_group(group_id=b3bcbc40f46e42dcbc4b06c7d682aaea)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:39.695459 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e19fd0-f05a-4f6c-b19d-0c682c0c6f86 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:39.697436 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 225/433] 10.222.0.94 () {56 vars in 1180 bytes} [Thu Sep 1 17:13:39 2022] GET /identity/v3/groups/b3bcbc40f46e42dcbc4b06c7d682aaea => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:13:39.698635 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63525b64-3add-4e0e-bbb2-192450c530a4 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:39.698748 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63525b64-3add-4e0e-bbb2-192450c530a4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:39.699005 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63525b64-3add-4e0e-bbb2-192450c530a4 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:39.700562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 226/434] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:39.703054 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63525b64-3add-4e0e-bbb2-192450c530a4 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:39.726356 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:39.739427 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:39.780551 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b05a50-7df7-43a7-b9f9-9ee802cc22fe None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:39.813233 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63525b64-3add-4e0e-bbb2-192450c530a4 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:39.816678 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4465e00-5a02-4a4d-95e3-0b38dfd89780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:39.817285 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4465e00-5a02-4a4d-95e3-0b38dfd89780 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:39.817604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4465e00-5a02-4a4d-95e3-0b38dfd89780 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:39.817876 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4465e00-5a02-4a4d-95e3-0b38dfd89780 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:39.818545 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4465e00-5a02-4a4d-95e3-0b38dfd89780 None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:39.818850 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4465e00-5a02-4a4d-95e3-0b38dfd89780 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:39.820227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4465e00-5a02-4a4d-95e3-0b38dfd89780 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:39.833967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 209/435] 10.222.0.94 () {56 vars in 1101 bytes} [Thu Sep 1 17:13:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:39.833967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd3450-0612-4fcc-bee5-fb125cf4ea33 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:39.833967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd3450-0612-4fcc-bee5-fb125cf4ea33 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:39.833967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd3450-0612-4fcc-bee5-fb125cf4ea33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:39.849689 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-fcbd3450-0612-4fcc-bee5-fb125cf4ea33 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:39.851090 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fcbd3450-0612-4fcc-bee5-fb125cf4ea33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:39.856752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dffe9a-6ad6-437f-818c-f34de5e6653e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:39.857359 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dffe9a-6ad6-437f-818c-f34de5e6653e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:39.857664 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dffe9a-6ad6-437f-818c-f34de5e6653e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:39.857931 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dffe9a-6ad6-437f-818c-f34de5e6653e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:39.859059 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dffe9a-6ad6-437f-818c-f34de5e6653e None admin] RBAC: Adding query filter params (group.id=b3bcbc40f46e42dcbc4b06c7d682aaea, role.id=a78fbf73b27d4781ac14690bbcb1cd9f, scope.project.id=09e5899a135840f3a8cdeb96945d5623) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:39.859367 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dffe9a-6ad6-437f-818c-f34de5e6653e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:39.861263 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dffe9a-6ad6-437f-818c-f34de5e6653e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:39.873943 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 227/436] 10.222.0.94 () {56 vars in 1376 bytes} [Thu Sep 1 17:13:39 2022] GET /identity/v3/role_assignments?group.id=b3bcbc40f46e42dcbc4b06c7d682aaea&scope.project.id=09e5899a135840f3a8cdeb96945d5623&role.id=a78fbf73b27d4781ac14690bbcb1cd9f => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:13:39.873943 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dffe9a-6ad6-437f-818c-f34de5e6653e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:39.934572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 210/437] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:39.974218 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:39.995159 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dffe9a-6ad6-437f-818c-f34de5e6653e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:40.033595 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8dd35-66a9-435b-85a4-38b52e925b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:40.034209 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8dd35-66a9-435b-85a4-38b52e925b26 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:40.034485 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8dd35-66a9-435b-85a4-38b52e925b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:40.034751 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8dd35-66a9-435b-85a4-38b52e925b26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:40.106110 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8dd35-66a9-435b-85a4-38b52e925b26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:40.108260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8dd35-66a9-435b-85a4-38b52e925b26 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:40.190253 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:40.212802 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 228/438] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:13:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:13:40.218508 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd3450-0612-4fcc-bee5-fb125cf4ea33 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:40.233243 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8dd35-66a9-435b-85a4-38b52e925b26 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:40.297227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:40.347244 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8dd35-66a9-435b-85a4-38b52e925b26 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:40.352458 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd3450-0612-4fcc-bee5-fb125cf4ea33 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:40.390496 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f8ef5-b10e-41a6-b8f0-c0f70b4d2caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:40.391141 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f8ef5-b10e-41a6-b8f0-c0f70b4d2caa None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:40.391418 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f8ef5-b10e-41a6-b8f0-c0f70b4d2caa None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:40.391847 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f8ef5-b10e-41a6-b8f0-c0f70b4d2caa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:40.391988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2584e-5f2a-4454-b8a1-9e8e1ca6ede4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:40.392590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2584e-5f2a-4454-b8a1-9e8e1ca6ede4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:40.392869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2584e-5f2a-4454-b8a1-9e8e1ca6ede4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:40.393137 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2584e-5f2a-4454-b8a1-9e8e1ca6ede4 None admin] PATH_INFO: `/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:40.394285 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2584e-5f2a-4454-b8a1-9e8e1ca6ede4 None admin] RBAC: Authorizing `identity:get_project(project_id=13936e7054f44ceebcd8d6dfa85eb8a7)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:40.395717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2584e-5f2a-4454-b8a1-9e8e1ca6ede4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:40.398296 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 211/439] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:40 2022] GET /identity/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:40.398974 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db02f0-2a39-4608-9e07-d3d2371e895a None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:40.399512 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db02f0-2a39-4608-9e07-d3d2371e895a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:40.399840 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db02f0-2a39-4608-9e07-d3d2371e895a None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:40.401028 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 212/440] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:40.402975 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db02f0-2a39-4608-9e07-d3d2371e895a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:40.410343 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f8ef5-b10e-41a6-b8f0-c0f70b4d2caa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:40.416257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-ac4f8ef5-b10e-41a6-b8f0-c0f70b4d2caa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:13:40.416257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:40.416257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:40.416257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:40.416257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:40.416257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:40.416257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:40.416257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:40.416257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:40.416257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:40.416257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:40.416257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:40.416257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:40.416257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:40.416257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:40.416257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:40.417160 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:40.417160 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:40.417160 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:40.417160 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:40.417160 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:40.417160 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:40.417160 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:40.417160 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:40.417160 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:40.417160 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:40.417160 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:40.417160 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:40.417160 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:40.417160 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:40.417160 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:40.417160 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:40.418305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:40.418305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:40.418305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:40.418305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:40.418305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:40.418305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:40.418305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:40.418305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:40.418305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:40.418305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:40.418305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:13:40.418305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:40.418305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 229/441] 10.222.0.94 () {56 vars in 1114 bytes} [Thu Sep 1 17:13:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:13:40.418305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cb59c-54c3-4836-a454-19dc9786c4b5 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:40.419688 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cb59c-54c3-4836-a454-19dc9786c4b5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:40.419688 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cb59c-54c3-4836-a454-19dc9786c4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:40.438287 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-330cb59c-54c3-4836-a454-19dc9786c4b5 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:40.439699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-330cb59c-54c3-4836-a454-19dc9786c4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:40.483458 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:40.517239 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 230/442] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:40.518128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cb59c-54c3-4836-a454-19dc9786c4b5 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:40.520780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db02f0-2a39-4608-9e07-d3d2371e895a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:40.547115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:40.561666 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87aba42-fd82-41ab-9fb8-45380831d812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:40.562298 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87aba42-fd82-41ab-9fb8-45380831d812 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:40.562604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87aba42-fd82-41ab-9fb8-45380831d812 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:40.562876 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87aba42-fd82-41ab-9fb8-45380831d812 None admin] PATH_INFO: `/v3/groups/b3bcbc40f46e42dcbc4b06c7d682aaea` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:40.563981 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87aba42-fd82-41ab-9fb8-45380831d812 None admin] RBAC: Authorizing `identity:get_group(group_id=b3bcbc40f46e42dcbc4b06c7d682aaea)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:40.565483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87aba42-fd82-41ab-9fb8-45380831d812 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:40.567235 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 213/443] 10.222.0.94 () {56 vars in 1180 bytes} [Thu Sep 1 17:13:40 2022] GET /identity/v3/groups/b3bcbc40f46e42dcbc4b06c7d682aaea => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:13:40.572706 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87aba42-fd82-41ab-9fb8-45380831d812 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:40.629312 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cb59c-54c3-4836-a454-19dc9786c4b5 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:40.664954 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661de4a0-f024-4882-a462-36f06f8e2050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:40.665650 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661de4a0-f024-4882-a462-36f06f8e2050 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:40.665858 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661de4a0-f024-4882-a462-36f06f8e2050 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:40.666226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661de4a0-f024-4882-a462-36f06f8e2050 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:40.666883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661de4a0-f024-4882-a462-36f06f8e2050 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:40.667190 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661de4a0-f024-4882-a462-36f06f8e2050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:40.668787 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661de4a0-f024-4882-a462-36f06f8e2050 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:40.671149 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87aba42-fd82-41ab-9fb8-45380831d812 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:40.677096 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 231/444] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:13:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:40.682471 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661de4a0-f024-4882-a462-36f06f8e2050 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:40.707491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f7b73-c5f1-43ba-abe1-9772376f4671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:40.708139 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f7b73-c5f1-43ba-abe1-9772376f4671 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:40.708358 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f7b73-c5f1-43ba-abe1-9772376f4671 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:40.708642 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f7b73-c5f1-43ba-abe1-9772376f4671 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:40.709337 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f7b73-c5f1-43ba-abe1-9772376f4671 None admin] RBAC: Adding query filter params (group.id=b3bcbc40f46e42dcbc4b06c7d682aaea, role.id=a78fbf73b27d4781ac14690bbcb1cd9f, scope.project.id=13936e7054f44ceebcd8d6dfa85eb8a7) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:40.709672 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f7b73-c5f1-43ba-abe1-9772376f4671 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:40.711152 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f7b73-c5f1-43ba-abe1-9772376f4671 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:40.715150 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:40.718608 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 214/445] 10.222.0.94 () {56 vars in 1376 bytes} [Thu Sep 1 17:13:40 2022] GET /identity/v3/role_assignments?group.id=b3bcbc40f46e42dcbc4b06c7d682aaea&scope.project.id=13936e7054f44ceebcd8d6dfa85eb8a7&role.id=a78fbf73b27d4781ac14690bbcb1cd9f => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:13:40.787308 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f7b73-c5f1-43ba-abe1-9772376f4671 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:40.803811 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661de4a0-f024-4882-a462-36f06f8e2050 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:40.840358 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9d40d-ee36-4c02-b222-0774b9e3adc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:40.841179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9d40d-ee36-4c02-b222-0774b9e3adc5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:40.841687 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9d40d-ee36-4c02-b222-0774b9e3adc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:40.842083 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9d40d-ee36-4c02-b222-0774b9e3adc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:40.857727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:40.909670 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f7b73-c5f1-43ba-abe1-9772376f4671 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:40.920447 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9d40d-ee36-4c02-b222-0774b9e3adc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:40.922113 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9d40d-ee36-4c02-b222-0774b9e3adc5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:40.951381 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2417c4-b297-44d5-a76c-3b5df255af44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:40.952725 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2417c4-b297-44d5-a76c-3b5df255af44 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:40.952725 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2417c4-b297-44d5-a76c-3b5df255af44 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:40.952926 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2417c4-b297-44d5-a76c-3b5df255af44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:40.956015 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:40.967269 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2417c4-b297-44d5-a76c-3b5df255af44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:40.973415 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-2a2417c4-b297-44d5-a76c-3b5df255af44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:13:40.973415 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:40.973415 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:40.973415 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:40.973415 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:40.973415 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:40.973415 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:40.973415 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:40.973415 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:40.973415 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:40.973415 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:40.973415 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:40.973415 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:40.973415 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:40.973415 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:40.973415 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:40.974482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:40.974482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:40.974482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:40.974482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:40.974482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:40.974482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:40.974482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:40.974482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:40.974482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:40.974482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:40.974482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:40.974482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:40.974482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:40.974482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:40.974482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:40.974482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:40.975426 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:40.975426 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:40.975426 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:40.975426 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:40.975426 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:40.975426 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:40.975426 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:40.975426 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:40.975426 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:40.975426 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:40.975426 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:13:40.975426 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:40.976558 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 215/446] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:13:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:13:40.981721 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2417c4-b297-44d5-a76c-3b5df255af44 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:41.041574 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 232/447] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:13:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 17:13:41.048177 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9d40d-ee36-4c02-b222-0774b9e3adc5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:41.100563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2417c4-b297-44d5-a76c-3b5df255af44 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:41.116997 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:41.134543 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b37c1-c79f-45df-bfaa-38cd7223ed4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:41.135142 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b37c1-c79f-45df-bfaa-38cd7223ed4d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:41.135418 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b37c1-c79f-45df-bfaa-38cd7223ed4d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:41.135682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b37c1-c79f-45df-bfaa-38cd7223ed4d None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:41.136338 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b37c1-c79f-45df-bfaa-38cd7223ed4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:41.136633 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b37c1-c79f-45df-bfaa-38cd7223ed4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:41.138083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b37c1-c79f-45df-bfaa-38cd7223ed4d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:41.146048 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 216/448] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:13:41.150322 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9d40d-ee36-4c02-b222-0774b9e3adc5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:41.151274 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b37c1-c79f-45df-bfaa-38cd7223ed4d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:41.181006 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:41.187466 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67c681-747e-4f7d-8e57-80897f21f33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:41.188195 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67c681-747e-4f7d-8e57-80897f21f33a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:41.188473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67c681-747e-4f7d-8e57-80897f21f33a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:41.188739 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67c681-747e-4f7d-8e57-80897f21f33a None admin] PATH_INFO: `/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:41.189870 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67c681-747e-4f7d-8e57-80897f21f33a None admin] RBAC: Authorizing `identity:get_project(project_id=13936e7054f44ceebcd8d6dfa85eb8a7)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:41.191311 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67c681-747e-4f7d-8e57-80897f21f33a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:41.192902 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 233/449] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:41 2022] GET /identity/v3/projects/13936e7054f44ceebcd8d6dfa85eb8a7 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:13:41.198309 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67c681-747e-4f7d-8e57-80897f21f33a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:41.249027 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b37c1-c79f-45df-bfaa-38cd7223ed4d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:41.281762 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25a8e8-f6d7-4e62-94b4-4ac547b83a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:41.282371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25a8e8-f6d7-4e62-94b4-4ac547b83a2f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:41.282648 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25a8e8-f6d7-4e62-94b4-4ac547b83a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:41.282916 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25a8e8-f6d7-4e62-94b4-4ac547b83a2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:41.303328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67c681-747e-4f7d-8e57-80897f21f33a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:41.326529 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:41.336496 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdab6dc-c2ee-4f82-8787-b5b640c08d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:41.337126 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdab6dc-c2ee-4f82-8787-b5b640c08d68 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:41.337429 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdab6dc-c2ee-4f82-8787-b5b640c08d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:41.337702 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdab6dc-c2ee-4f82-8787-b5b640c08d68 None admin] PATH_INFO: `/v3/groups/b3bcbc40f46e42dcbc4b06c7d682aaea` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:41.338808 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdab6dc-c2ee-4f82-8787-b5b640c08d68 None admin] RBAC: Authorizing `identity:get_group(group_id=b3bcbc40f46e42dcbc4b06c7d682aaea)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:41.340235 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdab6dc-c2ee-4f82-8787-b5b640c08d68 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:41.342339 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 234/450] 10.222.0.94 () {56 vars in 1180 bytes} [Thu Sep 1 17:13:41 2022] GET /identity/v3/groups/b3bcbc40f46e42dcbc4b06c7d682aaea => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:41.348960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdab6dc-c2ee-4f82-8787-b5b640c08d68 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:41.349081 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25a8e8-f6d7-4e62-94b4-4ac547b83a2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:41.350561 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25a8e8-f6d7-4e62-94b4-4ac547b83a2f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:41.414170 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:41.447311 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 217/451] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:13:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 17:13:41.448943 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdab6dc-c2ee-4f82-8787-b5b640c08d68 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:41.453303 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25a8e8-f6d7-4e62-94b4-4ac547b83a2f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:41.483066 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14313ea8-c6d9-4059-b509-8d0e9d2d1948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:41.483663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14313ea8-c6d9-4059-b509-8d0e9d2d1948 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:41.483940 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14313ea8-c6d9-4059-b509-8d0e9d2d1948 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:41.484210 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14313ea8-c6d9-4059-b509-8d0e9d2d1948 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:41.484925 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14313ea8-c6d9-4059-b509-8d0e9d2d1948 None admin] RBAC: Adding query filter params (group.id=b3bcbc40f46e42dcbc4b06c7d682aaea, role.id=9131e2ca337e4d1286ef32a4ba63cafa, scope.project.id=13936e7054f44ceebcd8d6dfa85eb8a7) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:41.485228 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14313ea8-c6d9-4059-b509-8d0e9d2d1948 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:41.486679 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14313ea8-c6d9-4059-b509-8d0e9d2d1948 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:41.492318 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 235/452] 10.222.0.94 () {56 vars in 1376 bytes} [Thu Sep 1 17:13:41 2022] GET /identity/v3/role_assignments?group.id=b3bcbc40f46e42dcbc4b06c7d682aaea&scope.project.id=13936e7054f44ceebcd8d6dfa85eb8a7&role.id=9131e2ca337e4d1286ef32a4ba63cafa => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:41.532516 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:41.558397 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25a8e8-f6d7-4e62-94b4-4ac547b83a2f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:41.600428 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f419e-8b1f-476c-a0b5-4cfe69ebe316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:41.601065 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f419e-8b1f-476c-a0b5-4cfe69ebe316 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:41.601336 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f419e-8b1f-476c-a0b5-4cfe69ebe316 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:41.601633 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f419e-8b1f-476c-a0b5-4cfe69ebe316 None admin] PATH_INFO: `/v3/projects/cf6314541ceb40a5aa90aa5d595b2262` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:41.602828 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f419e-8b1f-476c-a0b5-4cfe69ebe316 None admin] RBAC: Authorizing `identity:get_project(project_id=cf6314541ceb40a5aa90aa5d595b2262)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:41.604310 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f419e-8b1f-476c-a0b5-4cfe69ebe316 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:41.606059 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 218/453] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:13:41 2022] GET /identity/v3/projects/cf6314541ceb40a5aa90aa5d595b2262 => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:13:41.611966 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14313ea8-c6d9-4059-b509-8d0e9d2d1948 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:41.717103 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14313ea8-c6d9-4059-b509-8d0e9d2d1948 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:41.749144 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:41.754235 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a2362-20af-4cf7-bfc1-2d588c9657a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:41.754870 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a2362-20af-4cf7-bfc1-2d588c9657a5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:41.755155 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a2362-20af-4cf7-bfc1-2d588c9657a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:41.755426 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a2362-20af-4cf7-bfc1-2d588c9657a5 None admin] PATH_INFO: `/v3/groups/b44d5aadce1d4852acbc2fe7a54ad900` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:41.756536 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a2362-20af-4cf7-bfc1-2d588c9657a5 None admin] RBAC: Authorizing `identity:get_group(group_id=b44d5aadce1d4852acbc2fe7a54ad900)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:41.758030 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a2362-20af-4cf7-bfc1-2d588c9657a5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:41.759905 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 236/454] 10.222.0.94 () {56 vars in 1180 bytes} [Thu Sep 1 17:13:41 2022] GET /identity/v3/groups/b44d5aadce1d4852acbc2fe7a54ad900 => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:41.765916 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f419e-8b1f-476c-a0b5-4cfe69ebe316 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:41.871504 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f419e-8b1f-476c-a0b5-4cfe69ebe316 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:41.906856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ee8d0-4df8-49b3-abe1-407f41b264dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:41.907453 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ee8d0-4df8-49b3-abe1-407f41b264dc None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:41.907731 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ee8d0-4df8-49b3-abe1-407f41b264dc None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:41.908001 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ee8d0-4df8-49b3-abe1-407f41b264dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:41.908722 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ee8d0-4df8-49b3-abe1-407f41b264dc None admin] RBAC: Adding query filter params (group.id=b44d5aadce1d4852acbc2fe7a54ad900, role.id=70f911a75b7b40a19f65857b9d19cfad, scope.project.id=cf6314541ceb40a5aa90aa5d595b2262) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:41.909030 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ee8d0-4df8-49b3-abe1-407f41b264dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:41.910480 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ee8d0-4df8-49b3-abe1-407f41b264dc None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:41.916032 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 219/455] 10.222.0.94 () {56 vars in 1376 bytes} [Thu Sep 1 17:13:41 2022] GET /identity/v3/role_assignments?group.id=b44d5aadce1d4852acbc2fe7a54ad900&scope.project.id=cf6314541ceb40a5aa90aa5d595b2262&role.id=70f911a75b7b40a19f65857b9d19cfad => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:44.360991 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46462f-c6d2-4bf0-b0c4-073b0587c6ef None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:44.362059 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46462f-c6d2-4bf0-b0c4-073b0587c6ef None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:44.362549 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46462f-c6d2-4bf0-b0c4-073b0587c6ef None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:44.364331 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 237/456] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:44.370943 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de5690-4a5a-4a4e-86b7-73f80a241f1a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:44.371425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de5690-4a5a-4a4e-86b7-73f80a241f1a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:44.372111 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de5690-4a5a-4a4e-86b7-73f80a241f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:44.392587 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabf11d-664b-4581-a650-23650d47c685 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:44.392959 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabf11d-664b-4581-a650-23650d47c685 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:44.393195 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabf11d-664b-4581-a650-23650d47c685 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:44.394818 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 238/457] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:44.399781 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b5de5690-4a5a-4a4e-86b7-73f80a241f1a None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:44.400980 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b5de5690-4a5a-4a4e-86b7-73f80a241f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:44.401564 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02891b0-13d7-494b-9d51-943617a34ab3 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:44.402308 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02891b0-13d7-494b-9d51-943617a34ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:44.403047 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02891b0-13d7-494b-9d51-943617a34ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:44.404536 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:44.452600 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e02891b0-13d7-494b-9d51-943617a34ab3 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:44.457236 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e02891b0-13d7-494b-9d51-943617a34ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:44.608539 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 220/458] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:44.609998 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23236afd-1e7b-4f89-8e1b-55a8a9cba257 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:44.610286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23236afd-1e7b-4f89-8e1b-55a8a9cba257 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:44.610863 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23236afd-1e7b-4f89-8e1b-55a8a9cba257 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:44.616212 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 221/459] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:44.619342 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5991f-15ab-41d1-9a20-af38857cff33 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:44.619841 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5991f-15ab-41d1-9a20-af38857cff33 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:44.620332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5991f-15ab-41d1-9a20-af38857cff33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:44.637451 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 239/460] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:44.649785 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f4d5991f-15ab-41d1-9a20-af38857cff33 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:44.651135 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f4d5991f-15ab-41d1-9a20-af38857cff33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:44.720494 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 222/461] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:44.950949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02891b0-13d7-494b-9d51-943617a34ab3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:45.010145 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5991f-15ab-41d1-9a20-af38857cff33 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:45.086724 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02891b0-13d7-494b-9d51-943617a34ab3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:45.145149 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:45.153055 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dcb79-b2b9-4c39-9234-e40538e5d83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:45.154592 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dcb79-b2b9-4c39-9234-e40538e5d83f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:45.154939 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dcb79-b2b9-4c39-9234-e40538e5d83f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:45.155707 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:45.155817 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dcb79-b2b9-4c39-9234-e40538e5d83f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:45.170188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343dcb79-b2b9-4c39-9234-e40538e5d83f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:45.172481 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343dcb79-b2b9-4c39-9234-e40538e5d83f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:45.193686 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5991f-15ab-41d1-9a20-af38857cff33 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:45.193981 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-343dcb79-b2b9-4c39-9234-e40538e5d83f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:45.193981 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:45.193981 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:45.193981 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:45.193981 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:45.193981 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:45.193981 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:45.193981 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:45.193981 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:45.193981 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:45.193981 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:45.193981 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:45.193981 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:13:45.193981 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:13:45.193981 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:13:45.193981 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:13:45.194853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:45.194853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:45.194853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:45.194853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:45.194853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:45.194853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:45.194853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:45.194853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:45.194853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:45.194853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:45.194853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:45.194853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:45.194853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:45.194853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:45.194853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:45.194853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:45.194853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:13:45.195918 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:13:45.195918 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:45.195918 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:45.195918 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 240/462] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:13:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:45.197120 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dcb79-b2b9-4c39-9234-e40538e5d83f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:45.239780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d6f60-8028-4030-9e6c-494722369f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:45.240480 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d6f60-8028-4030-9e6c-494722369f4b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:45.241117 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d6f60-8028-4030-9e6c-494722369f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:45.242387 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d6f60-8028-4030-9e6c-494722369f4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:45.255112 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d6f60-8028-4030-9e6c-494722369f4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:45.257476 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d6f60-8028-4030-9e6c-494722369f4b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:45.277222 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-632d6f60-8028-4030-9e6c-494722369f4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:45.277222 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:45.277222 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:45.277222 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:45.277222 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:45.277222 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:45.277222 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:45.277222 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:45.277222 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:45.277222 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:45.277222 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:45.277222 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:45.277222 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:13:45.277222 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:13:45.277222 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:13:45.277222 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:13:45.279035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:45.279035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:45.279035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:45.279035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:45.279035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:45.279035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:45.279035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:45.279035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:45.279035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:45.279035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:45.279035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:45.279035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:45.279035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:45.279035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:45.279035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:45.279035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:45.279035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:13:45.280629 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:13:45.280629 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:45.280629 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:45.280629 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 223/463] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:13:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:45.280629 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d6f60-8028-4030-9e6c-494722369f4b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:45.319992 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dcb79-b2b9-4c39-9234-e40538e5d83f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:45.355678 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061bae97-f5cb-41f0-b368-fd03def87755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:45.356313 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bae97-f5cb-41f0-b368-fd03def87755 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:45.357106 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bae97-f5cb-41f0-b368-fd03def87755 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:45.357388 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bae97-f5cb-41f0-b368-fd03def87755 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:45.368036 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061bae97-f5cb-41f0-b368-fd03def87755 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:45.369552 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061bae97-f5cb-41f0-b368-fd03def87755 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:45.383699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-061bae97-f5cb-41f0-b368-fd03def87755 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:45.383699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:45.383699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:45.383699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:45.383699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:45.383699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:45.383699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:45.383699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:45.383699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:45.383699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:45.383699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:45.383699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:45.383699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:13:45.383699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:13:45.383699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:13:45.383699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:13:45.384798 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:45.384798 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:45.384798 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:45.384798 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:45.384798 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:45.384798 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:45.384798 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:45.384798 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:45.384798 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:45.384798 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:45.384798 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:45.384798 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:45.384798 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:45.384798 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:45.384798 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:45.384798 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:45.384798 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:13:45.385686 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:13:45.385686 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:45.385686 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:45.385686 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 241/464] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:13:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:45.385686 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061bae97-f5cb-41f0-b368-fd03def87755 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:45.395153 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d6f60-8028-4030-9e6c-494722369f4b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:45.419738 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:45.427414 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:45.432920 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231473c-593d-4be7-9927-b877b4753612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:45.433773 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231473c-593d-4be7-9927-b877b4753612 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:45.434201 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231473c-593d-4be7-9927-b877b4753612 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:45.434651 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231473c-593d-4be7-9927-b877b4753612 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:45.435478 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231473c-593d-4be7-9927-b877b4753612 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:45.435930 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231473c-593d-4be7-9927-b877b4753612 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:45.437534 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231473c-593d-4be7-9927-b877b4753612 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:45.453992 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 224/465] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:45.455801 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ac27a-3cc3-45e4-a787-225e8c7f536c None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:45.456241 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ac27a-3cc3-45e4-a787-225e8c7f536c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:45.456950 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ac27a-3cc3-45e4-a787-225e8c7f536c None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:45.458874 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 225/466] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:45.459713 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ac27a-3cc3-45e4-a787-225e8c7f536c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:45.500425 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061bae97-f5cb-41f0-b368-fd03def87755 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:45.537051 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48caaed-83b9-4f87-9951-d5248feb59f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:45.537698 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48caaed-83b9-4f87-9951-d5248feb59f6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:45.537975 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48caaed-83b9-4f87-9951-d5248feb59f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:45.538268 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48caaed-83b9-4f87-9951-d5248feb59f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:45.538919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48caaed-83b9-4f87-9951-d5248feb59f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:45.539222 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48caaed-83b9-4f87-9951-d5248feb59f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:45.540602 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48caaed-83b9-4f87-9951-d5248feb59f6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:45.557608 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 242/467] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:45.557608 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48caaed-83b9-4f87-9951-d5248feb59f6 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:45.577523 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ac27a-3cc3-45e4-a787-225e8c7f536c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:45.622408 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183db995-00a2-4eea-9754-7bec2373445d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:45.623012 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183db995-00a2-4eea-9754-7bec2373445d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:45.623284 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183db995-00a2-4eea-9754-7bec2373445d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:45.623548 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183db995-00a2-4eea-9754-7bec2373445d None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:45.624184 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183db995-00a2-4eea-9754-7bec2373445d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:45.624483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183db995-00a2-4eea-9754-7bec2373445d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:45.625870 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183db995-00a2-4eea-9754-7bec2373445d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:45.638609 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 226/468] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:45.639909 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769c569-b848-4ed4-ace5-873306f450b3 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:45.640198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769c569-b848-4ed4-ace5-873306f450b3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:45.640473 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769c569-b848-4ed4-ace5-873306f450b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:45.658848 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b769c569-b848-4ed4-ace5-873306f450b3 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:45.660276 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b769c569-b848-4ed4-ace5-873306f450b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:45.663403 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:45.671716 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48caaed-83b9-4f87-9951-d5248feb59f6 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:45.698705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:45.710313 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64eda5-f666-4e33-ae1a-f0386503065c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:45.711038 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64eda5-f666-4e33-ae1a-f0386503065c None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:45.711321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64eda5-f666-4e33-ae1a-f0386503065c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:45.711595 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64eda5-f666-4e33-ae1a-f0386503065c None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:45.712240 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64eda5-f666-4e33-ae1a-f0386503065c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:45.713863 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64eda5-f666-4e33-ae1a-f0386503065c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:45.737461 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 227/469] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:45.737461 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769c569-b848-4ed4-ace5-873306f450b3 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:45.738859 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 243/470] 10.222.0.94 () {60 vars in 1132 bytes} [Thu Sep 1 17:13:45 2022] POST /identity/v3/users => generated 248 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:13:45.739832 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64eda5-f666-4e33-ae1a-f0386503065c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:45.857984 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64eda5-f666-4e33-ae1a-f0386503065c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:45.896930 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5196ff0-2a05-4f4a-9ca5-03bec7a775e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:45.897585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5196ff0-2a05-4f4a-9ca5-03bec7a775e4 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:45.897867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5196ff0-2a05-4f4a-9ca5-03bec7a775e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:45.898138 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5196ff0-2a05-4f4a-9ca5-03bec7a775e4 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:45.899050 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5196ff0-2a05-4f4a-9ca5-03bec7a775e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:45.900579 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5196ff0-2a05-4f4a-9ca5-03bec7a775e4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:45.924910 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 244/471] 10.222.0.94 () {60 vars in 1132 bytes} [Thu Sep 1 17:13:45 2022] POST /identity/v3/users => generated 248 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:13:45.944435 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769c569-b848-4ed4-ace5-873306f450b3 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:45.984886 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1214fe-491b-4280-a166-693798b7ed5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:45.985935 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1214fe-491b-4280-a166-693798b7ed5e None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:45.986416 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1214fe-491b-4280-a166-693798b7ed5e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:45.986912 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1214fe-491b-4280-a166-693798b7ed5e None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:45.987771 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1214fe-491b-4280-a166-693798b7ed5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:45.989456 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1214fe-491b-4280-a166-693798b7ed5e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:46.016443 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 228/472] 10.222.0.94 () {60 vars in 1132 bytes} [Thu Sep 1 17:13:45 2022] POST /identity/v3/users => generated 246 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:13:46.016643 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46902e-7e85-4803-922d-776c65497259 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:46.016898 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46902e-7e85-4803-922d-776c65497259 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:46.017235 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46902e-7e85-4803-922d-776c65497259 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:46.020038 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 245/473] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:13:46.024725 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c73958-1e3b-4ec2-a5a0-19f16b2e9794 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:46.025354 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c73958-1e3b-4ec2-a5a0-19f16b2e9794 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:46.025868 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c73958-1e3b-4ec2-a5a0-19f16b2e9794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:46.046935 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a1c73958-1e3b-4ec2-a5a0-19f16b2e9794 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:46.048504 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a1c73958-1e3b-4ec2-a5a0-19f16b2e9794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:46.084590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:46.121764 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46902e-7e85-4803-922d-776c65497259 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:46.134946 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 229/474] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:46.137181 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:46.248811 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46902e-7e85-4803-922d-776c65497259 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:46.286455 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea298d-af96-4e87-a237-55366e6b26c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:46.287094 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea298d-af96-4e87-a237-55366e6b26c4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:46.287372 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea298d-af96-4e87-a237-55366e6b26c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:46.287641 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea298d-af96-4e87-a237-55366e6b26c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:46.298519 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea298d-af96-4e87-a237-55366e6b26c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:46.299966 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea298d-af96-4e87-a237-55366e6b26c4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:46.318919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-1fea298d-af96-4e87-a237-55366e6b26c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:46.318919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:46.318919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:46.318919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:46.318919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:46.318919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:46.318919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:46.318919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:46.318919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:46.318919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:46.318919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:46.318919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:46.318919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:13:46.318919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:13:46.318919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:13:46.318919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:13:46.319880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:46.319880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:46.319880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:46.319880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:46.319880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:46.319880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:46.319880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:46.319880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:46.319880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:46.319880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:46.319880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:46.319880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:46.319880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:46.319880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:46.319880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:46.319880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:46.319880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:13:46.321147 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:13:46.321147 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:46.321147 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:46.321147 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 246/475] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:13:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:46.326262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c73958-1e3b-4ec2-a5a0-19f16b2e9794 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:46.428885 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea298d-af96-4e87-a237-55366e6b26c4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:46.434107 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c73958-1e3b-4ec2-a5a0-19f16b2e9794 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:46.481880 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998aa223-a607-4702-ab5e-0631c174628f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:46.482502 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998aa223-a607-4702-ab5e-0631c174628f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:46.482777 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998aa223-a607-4702-ab5e-0631c174628f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:46.483047 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998aa223-a607-4702-ab5e-0631c174628f None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:46.483696 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998aa223-a607-4702-ab5e-0631c174628f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:46.483995 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998aa223-a607-4702-ab5e-0631c174628f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:46.485364 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998aa223-a607-4702-ab5e-0631c174628f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:46.503677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 230/476] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:13:46.514787 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998aa223-a607-4702-ab5e-0631c174628f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:46.547086 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:46.567105 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:46.572601 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea298d-af96-4e87-a237-55366e6b26c4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:46.608514 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9936cd8-3597-4979-b20f-0912e5a0c46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:46.609134 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9936cd8-3597-4979-b20f-0912e5a0c46c None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:46.609430 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9936cd8-3597-4979-b20f-0912e5a0c46c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:46.609725 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9936cd8-3597-4979-b20f-0912e5a0c46c None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:46.610474 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9936cd8-3597-4979-b20f-0912e5a0c46c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:46.611921 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9936cd8-3597-4979-b20f-0912e5a0c46c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:46.625441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.sql.core [None req-a9936cd8-3597-4979-b20f-0912e5a0c46c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 17:13:46.625441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 17:13:46.625441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [parameters: {'id': '49f6aa1b98e24f508ae8e74297ee73e1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 17:13:46.625441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81458) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 17:13:46.637979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-a9936cd8-3597-4979-b20f-0912e5a0c46c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 17:13:46.637979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:46.637979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 17:13:46.637979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 17:13:46.637979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 17:13:46.637979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 17:13:46.637979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 17:13:46.637979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 17:13:46.637979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 17:13:46.637979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application conn.query(q) Sep 01 17:13:46.637979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 17:13:46.637979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 17:13:46.637979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 17:13:46.637979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result.read() Sep 01 17:13:46.637979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 17:13:46.638916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 17:13:46.638916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 17:13:46.638916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 17:13:46.638916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 17:13:46.638916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 17:13:46.638916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 17:13:46.638916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 17:13:46.638916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 17:13:46.638916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:46.638916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 17:13:46.638916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:46.638916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:46.638916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 17:13:46.638916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 17:13:46.638916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 01 17:13:46.638916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return ref.to_dict() Sep 01 17:13:46.638916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 17:13:46.638916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application next(self.gen) Sep 01 17:13:46.639839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 17:13:46.639839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application yield resource Sep 01 17:13:46.639839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 17:13:46.639839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application next(self.gen) Sep 01 17:13:46.639839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 17:13:46.639839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 17:13:46.639839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 17:13:46.639839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 17:13:46.639839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 17:13:46.639839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise self.value Sep 01 17:13:46.639839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 17:13:46.639839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 17:13:46.639839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 17:13:46.639839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application session.commit() Sep 01 17:13:46.639839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 17:13:46.639839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 17:13:46.639839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 17:13:46.640735 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 17:13:46.640735 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 17:13:46.640735 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.session.flush() Sep 01 17:13:46.640735 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 17:13:46.640735 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 17:13:46.640735 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 17:13:46.640735 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 17:13:46.640735 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 17:13:46.640735 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application compat.raise_( Sep 01 17:13:46.640735 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 17:13:46.640735 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception Sep 01 17:13:46.640735 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 17:13:46.640735 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 17:13:46.640735 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 17:13:46.640735 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 17:13:46.640735 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 17:13:46.640735 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 17:13:46.641675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 17:13:46.641675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 17:13:46.641675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 17:13:46.641675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 17:13:46.641675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 17:13:46.641675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 17:13:46.641675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 17:13:46.641675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 17:13:46.641675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 17:13:46.641675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 17:13:46.641675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 17:13:46.641675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 17:13:46.641675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 17:13:46.641675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 17:13:46.641675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 17:13:46.641675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception Sep 01 17:13:46.642534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 17:13:46.642534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 17:13:46.642534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 17:13:46.642534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 17:13:46.642534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 17:13:46.642534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 17:13:46.642534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 17:13:46.642534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application conn.query(q) Sep 01 17:13:46.642534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 17:13:46.642534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 17:13:46.642534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 17:13:46.642534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result.read() Sep 01 17:13:46.642534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 17:13:46.642534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 17:13:46.642534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 17:13:46.642534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 17:13:46.643327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 17:13:46.643327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 17:13:46.643327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 17:13:46.643327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 17:13:46.643327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 17:13:46.643327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 17:13:46.643327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [parameters: {'id': '49f6aa1b98e24f508ae8e74297ee73e1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 17:13:46.643327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 17:13:46.643327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:46.643327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:13:46.643327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:46.643327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:46.643327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:46.643327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:46.643327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:46.643327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:46.644128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:46.644128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:46.644128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:46.644128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:46.644128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:46.644128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:46.644128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 01 17:13:46.644128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 01 17:13:46.644128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:46.644128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:46.644128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 01 17:13:46.644128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 01 17:13:46.644128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 17:13:46.644128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 17:13:46.644128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 17:13:46.644128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:46.644966 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 247/477] 10.222.0.94 () {60 vars in 1131 bytes} [Thu Sep 1 17:13:46 2022] POST /identity/v3/roles => generated 144 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:13:46.646383 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9936cd8-3597-4979-b20f-0912e5a0c46c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:46.753744 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9936cd8-3597-4979-b20f-0912e5a0c46c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:46.771340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998aa223-a607-4702-ab5e-0631c174628f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:46.782445 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:46.789570 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c6077-c1b6-4979-8c1f-87a27db21576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:46.790214 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c6077-c1b6-4979-8c1f-87a27db21576 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:46.790491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c6077-c1b6-4979-8c1f-87a27db21576 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:46.790763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c6077-c1b6-4979-8c1f-87a27db21576 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:46.802500 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c6077-c1b6-4979-8c1f-87a27db21576 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:46.807624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-462c6077-c1b6-4979-8c1f-87a27db21576 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:13:46.807624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:46.807624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:46.807624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:46.807624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:46.807624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:46.807624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:46.807624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:46.807624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:46.807624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:46.807624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:46.807624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:46.807624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:46.807624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:46.807624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:46.807624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:46.808528 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:46.808528 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:46.808528 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:46.808528 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:46.808528 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:46.808528 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:46.808528 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:46.808528 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:46.808528 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:46.808528 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:46.808528 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:46.808528 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:46.808528 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:46.808528 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:46.808528 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:46.808528 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:46.809328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:46.809328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:46.809328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:46.809328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:46.809328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:46.809328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:46.809328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:46.809328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:46.809328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:46.809328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:46.809328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 17:13:46.809328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:46.812318 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 248/478] 10.222.0.94 () {56 vars in 1114 bytes} [Thu Sep 1 17:13:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:13:46.816148 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c6077-c1b6-4979-8c1f-87a27db21576 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:46.839083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25351e06-debf-44c5-a980-5d89ec0e818e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:46.839688 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25351e06-debf-44c5-a980-5d89ec0e818e None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:46.839959 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25351e06-debf-44c5-a980-5d89ec0e818e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:46.840225 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25351e06-debf-44c5-a980-5d89ec0e818e None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:46.840990 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25351e06-debf-44c5-a980-5d89ec0e818e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:46.842471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25351e06-debf-44c5-a980-5d89ec0e818e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:46.904091 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 231/479] 10.222.0.94 () {60 vars in 1132 bytes} [Thu Sep 1 17:13:46 2022] POST /identity/v3/users => generated 249 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:13:46.928589 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c6077-c1b6-4979-8c1f-87a27db21576 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:46.965768 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa43fa-cc9f-4fa3-9249-4117deff3d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:46.966491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa43fa-cc9f-4fa3-9249-4117deff3d5b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:46.966769 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa43fa-cc9f-4fa3-9249-4117deff3d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:46.967037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa43fa-cc9f-4fa3-9249-4117deff3d5b None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:46.967715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa43fa-cc9f-4fa3-9249-4117deff3d5b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:46.968015 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa43fa-cc9f-4fa3-9249-4117deff3d5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:46.969443 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa43fa-cc9f-4fa3-9249-4117deff3d5b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:46.984228 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 249/480] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:13:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:13:48.406638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccb848-09fd-4087-b275-4e76254ce2eb None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:48.407200 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccb848-09fd-4087-b275-4e76254ce2eb None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:48.407200 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccb848-09fd-4087-b275-4e76254ce2eb None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:48.408764 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 232/481] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:48.414433 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ff80e-6a27-4c16-b1a3-9016c85fd872 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:48.414956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ff80e-6a27-4c16-b1a3-9016c85fd872 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:48.414956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ff80e-6a27-4c16-b1a3-9016c85fd872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:48.440246 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-196ff80e-6a27-4c16-b1a3-9016c85fd872 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:48.441455 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-196ff80e-6a27-4c16-b1a3-9016c85fd872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:48.454320 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f97033-9a85-483b-857d-03757defe99e None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:48.454601 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f97033-9a85-483b-857d-03757defe99e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:48.454870 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f97033-9a85-483b-857d-03757defe99e None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:48.456562 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 233/482] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:48.461019 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba1d8f-b04f-4fbf-a484-c316428d72c1 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:48.461301 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba1d8f-b04f-4fbf-a484-c316428d72c1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:48.461635 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba1d8f-b04f-4fbf-a484-c316428d72c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:48.488167 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:48.496483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-dcba1d8f-b04f-4fbf-a484-c316428d72c1 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:48.500405 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dcba1d8f-b04f-4fbf-a484-c316428d72c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:48.566690 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 250/483] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:48.577891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 234/484] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:13:48.771093 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1cd07-d85e-4d9a-ae88-93c53713e9b3 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:48.771434 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1cd07-d85e-4d9a-ae88-93c53713e9b3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:48.771537 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1cd07-d85e-4d9a-ae88-93c53713e9b3 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:48.773127 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 251/485] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:48.778430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a9bb0-2f5e-4f10-a870-c8535fe4fae6 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:48.779241 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a9bb0-2f5e-4f10-a870-c8535fe4fae6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:48.779514 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a9bb0-2f5e-4f10-a870-c8535fe4fae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:48.792124 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:48.804496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-4b7a9bb0-2f5e-4f10-a870-c8535fe4fae6 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:48.806308 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4b7a9bb0-2f5e-4f10-a870-c8535fe4fae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:48.895187 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 235/486] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:13:48.908397 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1cd07-d85e-4d9a-ae88-93c53713e9b3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:48.957049 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a9bb0-2f5e-4f10-a870-c8535fe4fae6 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:49.096503 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1cd07-d85e-4d9a-ae88-93c53713e9b3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:49.141673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a9bb0-2f5e-4f10-a870-c8535fe4fae6 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:49.163978 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ff68a-a346-46e4-a792-30c35223e98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:49.164671 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ff68a-a346-46e4-a792-30c35223e98e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:49.164952 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ff68a-a346-46e4-a792-30c35223e98e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:49.165220 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ff68a-a346-46e4-a792-30c35223e98e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:49.188824 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ff68a-a346-46e4-a792-30c35223e98e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:49.194857 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-8d7ff68a-a346-46e4-a792-30c35223e98e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:13:49.194857 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:49.194857 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:49.194857 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:49.194857 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:49.194857 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:49.194857 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:49.194857 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:49.194857 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:49.194857 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:49.194857 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:49.194857 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:49.194857 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:49.194857 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:49.194857 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:49.194857 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:49.195763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:49.195763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:49.195763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:49.195763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:49.195763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:49.195763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:49.195763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:49.195763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:49.195763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:49.195763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:49.195763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:49.195763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:49.195763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:49.195763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:49.195763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:49.195763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:49.196572 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:49.196572 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:49.196572 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:49.196572 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:49.196572 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:49.196572 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:49.196572 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:49.196572 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:49.196572 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:49.196572 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:49.196572 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:13:49.196572 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:49.201690 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 252/487] 10.222.0.94 () {56 vars in 1102 bytes} [Thu Sep 1 17:13:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:49.203362 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ff68a-a346-46e4-a792-30c35223e98e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:49.214256 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f2039-aa7f-4ac2-aba1-a84befef015c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:49.214955 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f2039-aa7f-4ac2-aba1-a84befef015c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:49.215235 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f2039-aa7f-4ac2-aba1-a84befef015c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:49.215611 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f2039-aa7f-4ac2-aba1-a84befef015c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:49.217752 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:49.228533 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f2039-aa7f-4ac2-aba1-a84befef015c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:49.234298 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-781f2039-aa7f-4ac2-aba1-a84befef015c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:13:49.234298 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:49.234298 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:49.234298 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:49.234298 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:49.234298 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:49.234298 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:49.234298 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:49.234298 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:49.234298 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:49.234298 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:49.234298 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:49.234298 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:49.234298 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:49.234298 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:49.234298 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:49.236367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:49.236367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:49.236367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:49.236367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:49.236367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:49.236367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:49.236367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:49.236367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:49.236367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:49.236367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:49.236367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:49.236367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:49.236367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:49.236367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:49.236367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:49.236367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:49.238351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:49.238351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:49.238351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:49.238351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:49.238351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:49.238351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:49.238351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:49.238351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:49.238351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:49.238351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:49.238351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:13:49.238351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:49.238351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 236/488] 10.222.0.94 () {56 vars in 1102 bytes} [Thu Sep 1 17:13:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:13:49.238351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f2039-aa7f-4ac2-aba1-a84befef015c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:49.249268 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:49.321610 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ff68a-a346-46e4-a792-30c35223e98e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:49.346056 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f2039-aa7f-4ac2-aba1-a84befef015c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:49.356577 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c60306-2025-4128-ac8c-957cad8f42c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:49.357727 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c60306-2025-4128-ac8c-957cad8f42c6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:49.358008 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c60306-2025-4128-ac8c-957cad8f42c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:49.358282 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c60306-2025-4128-ac8c-957cad8f42c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:49.359072 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c60306-2025-4128-ac8c-957cad8f42c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:49.359374 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c60306-2025-4128-ac8c-957cad8f42c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:49.360739 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c60306-2025-4128-ac8c-957cad8f42c6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:49.368753 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 253/489] 10.222.0.94 () {56 vars in 1103 bytes} [Thu Sep 1 17:13:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:13:49.369594 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c60306-2025-4128-ac8c-957cad8f42c6 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:49.386256 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70f2d8-d684-4edc-8c40-5be4331fbc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:49.386893 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70f2d8-d684-4edc-8c40-5be4331fbc2e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:49.387170 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70f2d8-d684-4edc-8c40-5be4331fbc2e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:49.387441 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70f2d8-d684-4edc-8c40-5be4331fbc2e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:49.397609 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70f2d8-d684-4edc-8c40-5be4331fbc2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:49.402479 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-2d70f2d8-d684-4edc-8c40-5be4331fbc2e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:13:49.402479 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:49.402479 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:49.402479 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:49.402479 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:49.402479 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:49.402479 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:49.402479 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:49.402479 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:49.402479 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:49.402479 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:49.402479 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:49.402479 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:49.402479 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:49.402479 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:49.402479 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:49.403394 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:49.403394 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:49.403394 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:49.403394 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:49.403394 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:49.403394 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:49.403394 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:49.403394 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:49.403394 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:49.403394 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:49.403394 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:49.403394 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:49.403394 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:49.403394 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:49.403394 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:49.403394 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:49.404219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:49.404219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:49.404219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:49.404219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:49.404219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:49.404219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:49.404219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:49.404219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:49.404219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:49.404219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:49.404219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:13:49.404219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:49.404219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 237/490] 10.222.0.94 () {56 vars in 1102 bytes} [Thu Sep 1 17:13:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:49.404891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30dd23-b11c-488e-bc79-cb95d0217db6 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:49.405075 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30dd23-b11c-488e-bc79-cb95d0217db6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:49.405350 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30dd23-b11c-488e-bc79-cb95d0217db6 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:49.407185 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 238/491] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:49.409303 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b47ed-3736-4f76-8139-e31f3ea8d8a6 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:49.409627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b47ed-3736-4f76-8139-e31f3ea8d8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:49.409905 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b47ed-3736-4f76-8139-e31f3ea8d8a6 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:49.411117 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 239/492] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:49.412533 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b47ed-3736-4f76-8139-e31f3ea8d8a6 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:49.471757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:49.473026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:49.477957 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c60306-2025-4128-ac8c-957cad8f42c6 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:49.511257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b1aee-74f1-4223-b815-326454c60c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:49.511856 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b1aee-74f1-4223-b815-326454c60c67 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:49.512134 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b1aee-74f1-4223-b815-326454c60c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:49.512409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b1aee-74f1-4223-b815-326454c60c67 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:49.513135 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b1aee-74f1-4223-b815-326454c60c67 None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:49.513652 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b1aee-74f1-4223-b815-326454c60c67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:49.516024 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b1aee-74f1-4223-b815-326454c60c67 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:49.522540 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b47ed-3736-4f76-8139-e31f3ea8d8a6 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:49.525131 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 254/493] 10.222.0.94 () {56 vars in 1103 bytes} [Thu Sep 1 17:13:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:49.525971 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b1aee-74f1-4223-b815-326454c60c67 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:49.559966 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd792fd-4820-4312-9588-14a44ab97add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:49.560590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd792fd-4820-4312-9588-14a44ab97add None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:49.560863 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd792fd-4820-4312-9588-14a44ab97add None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:49.561129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd792fd-4820-4312-9588-14a44ab97add None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:49.571197 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd792fd-4820-4312-9588-14a44ab97add None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:49.572614 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd792fd-4820-4312-9588-14a44ab97add None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:49.587728 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-ecd792fd-4820-4312-9588-14a44ab97add None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:49.587728 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:49.587728 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:49.587728 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:49.587728 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:49.587728 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:49.587728 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:49.587728 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:49.587728 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:49.587728 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:49.587728 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:49.587728 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:49.587728 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:13:49.587728 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:13:49.587728 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:13:49.587728 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:13:49.588624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:49.588624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:49.588624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:49.588624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:49.588624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:49.588624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:49.588624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:49.588624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:49.588624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:49.588624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:49.588624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:49.588624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:49.588624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:49.588624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:49.588624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:49.588624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:49.588624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:13:49.589784 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:13:49.589784 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:49.589784 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:49.589784 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 240/494] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:13:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:49.590144 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766d420-37ca-4eae-a0d1-4db896b9953f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:49.590324 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766d420-37ca-4eae-a0d1-4db896b9953f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:49.590597 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766d420-37ca-4eae-a0d1-4db896b9953f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:49.608788 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e766d420-37ca-4eae-a0d1-4db896b9953f None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:49.609926 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e766d420-37ca-4eae-a0d1-4db896b9953f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:49.631057 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b1aee-74f1-4223-b815-326454c60c67 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:49.668571 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1586c4-46d3-47fe-b83a-4b8f17539a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:49.669201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1586c4-46d3-47fe-b83a-4b8f17539a6d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:49.669532 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1586c4-46d3-47fe-b83a-4b8f17539a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:49.669794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1586c4-46d3-47fe-b83a-4b8f17539a6d None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:49.670450 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1586c4-46d3-47fe-b83a-4b8f17539a6d None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:49.670751 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1586c4-46d3-47fe-b83a-4b8f17539a6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:49.672134 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1586c4-46d3-47fe-b83a-4b8f17539a6d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:49.676844 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 241/495] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:49.678110 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14783d72-c246-4d20-877b-4940b558c294 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:49.678396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14783d72-c246-4d20-877b-4940b558c294 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:49.678694 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14783d72-c246-4d20-877b-4940b558c294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:49.680074 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 255/496] 10.222.0.94 () {56 vars in 1103 bytes} [Thu Sep 1 17:13:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:49.680682 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1586c4-46d3-47fe-b83a-4b8f17539a6d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:49.704271 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:49.711942 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-14783d72-c246-4d20-877b-4940b558c294 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:49.713305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-14783d72-c246-4d20-877b-4940b558c294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:49.744033 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:49.786028 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 242/497] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:49.786979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1586c4-46d3-47fe-b83a-4b8f17539a6d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:49.795339 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14783d72-c246-4d20-877b-4940b558c294 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:49.822619 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a4068-24e4-495d-a4f9-6015e5ea8b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:49.823243 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a4068-24e4-495d-a4f9-6015e5ea8b1a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:49.823515 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a4068-24e4-495d-a4f9-6015e5ea8b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:49.823782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a4068-24e4-495d-a4f9-6015e5ea8b1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:49.835256 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a4068-24e4-495d-a4f9-6015e5ea8b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:49.836756 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a4068-24e4-495d-a4f9-6015e5ea8b1a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:49.851212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-e90a4068-24e4-495d-a4f9-6015e5ea8b1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:49.851212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:49.851212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:49.851212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:49.851212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:49.851212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:49.851212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:49.851212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:49.851212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:49.851212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:49.851212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:49.851212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:49.851212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:13:49.851212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:13:49.851212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:13:49.851212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:13:49.852140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:49.852140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:49.852140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:49.852140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:49.852140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:49.852140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:49.852140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:49.852140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:49.852140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:49.852140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:49.852140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:49.852140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:49.852140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:49.852140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:49.852140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:49.852140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:49.852140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:13:49.853013 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:13:49.853013 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:49.853013 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:49.853013 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 256/498] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:13:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:49.853239 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a4068-24e4-495d-a4f9-6015e5ea8b1a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:49.932376 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:49.943789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14783d72-c246-4d20-877b-4940b558c294 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:49.965377 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a4068-24e4-495d-a4f9-6015e5ea8b1a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:49.982324 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f648c-4a4c-4a8f-a73e-65e19afb9cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:49.982980 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f648c-4a4c-4a8f-a73e-65e19afb9cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:49.983267 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f648c-4a4c-4a8f-a73e-65e19afb9cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:49.983538 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f648c-4a4c-4a8f-a73e-65e19afb9cc6 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:49.984184 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f648c-4a4c-4a8f-a73e-65e19afb9cc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:49.984494 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f648c-4a4c-4a8f-a73e-65e19afb9cc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:49.985923 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f648c-4a4c-4a8f-a73e-65e19afb9cc6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:49.997261 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 243/499] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:49.998231 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f648c-4a4c-4a8f-a73e-65e19afb9cc6 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:50.006895 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e141e-aaab-4f05-af8a-9ce5fd5cc315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:50.007802 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e141e-aaab-4f05-af8a-9ce5fd5cc315 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:50.008299 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e141e-aaab-4f05-af8a-9ce5fd5cc315 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:50.008638 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e141e-aaab-4f05-af8a-9ce5fd5cc315 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:50.020659 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e141e-aaab-4f05-af8a-9ce5fd5cc315 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:50.022137 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e141e-aaab-4f05-af8a-9ce5fd5cc315 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:50.028192 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:50.038189 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-ce0e141e-aaab-4f05-af8a-9ce5fd5cc315 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:50.038189 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:50.038189 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:50.038189 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:50.038189 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:50.038189 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:50.038189 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:50.038189 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:50.038189 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:50.038189 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:50.038189 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:50.038189 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:50.038189 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:13:50.038189 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:13:50.038189 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:13:50.038189 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:13:50.039098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:50.039098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:50.039098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:50.039098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:50.039098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:50.039098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:50.039098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:50.039098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:50.039098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:50.039098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:50.039098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:50.039098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:50.039098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:50.039098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:50.039098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:50.039098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:50.039098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:13:50.039957 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:13:50.039957 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:50.039957 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:50.043952 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 257/500] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:13:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:50.044921 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e141e-aaab-4f05-af8a-9ce5fd5cc315 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:50.104221 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f648c-4a4c-4a8f-a73e-65e19afb9cc6 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:50.138063 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97464f-3f76-4769-906f-feb20f25ad05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:50.138660 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97464f-3f76-4769-906f-feb20f25ad05 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:50.138938 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97464f-3f76-4769-906f-feb20f25ad05 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:50.139209 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97464f-3f76-4769-906f-feb20f25ad05 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:50.139848 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97464f-3f76-4769-906f-feb20f25ad05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:50.140400 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97464f-3f76-4769-906f-feb20f25ad05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:50.141530 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97464f-3f76-4769-906f-feb20f25ad05 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:50.142923 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e141e-aaab-4f05-af8a-9ce5fd5cc315 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:50.153017 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 244/501] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:50.153864 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97464f-3f76-4769-906f-feb20f25ad05 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:50.167029 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:50.179035 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf3e54-6051-45ff-972a-82b8f8604b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:50.179664 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf3e54-6051-45ff-972a-82b8f8604b0d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:50.179945 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf3e54-6051-45ff-972a-82b8f8604b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:50.180220 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf3e54-6051-45ff-972a-82b8f8604b0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:50.190699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf3e54-6051-45ff-972a-82b8f8604b0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:50.195840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-38cf3e54-6051-45ff-972a-82b8f8604b0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:13:50.195840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:50.195840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:50.195840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:50.195840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:50.195840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:50.195840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:50.195840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:50.195840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:50.195840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:50.195840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:50.195840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:50.195840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:50.195840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:50.195840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:50.195840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:50.196809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:50.196809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:50.196809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:50.196809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:50.196809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:50.196809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:50.196809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:50.196809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:50.196809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:50.196809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:50.196809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:50.196809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:50.196809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:50.196809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:50.196809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:50.196809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:50.198289 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:50.198289 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:50.198289 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:50.198289 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:50.198289 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:50.198289 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:50.198289 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:50.198289 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:50.198289 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:50.198289 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:50.198289 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:13:50.198289 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:50.198289 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 258/502] 10.222.0.94 () {56 vars in 1102 bytes} [Thu Sep 1 17:13:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:50.198289 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf3e54-6051-45ff-972a-82b8f8604b0d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:50.239761 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:50.254720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97464f-3f76-4769-906f-feb20f25ad05 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:50.288118 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ade89-7dba-4c4b-9274-11b2a4f23605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:50.288740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ade89-7dba-4c4b-9274-11b2a4f23605 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:50.289017 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ade89-7dba-4c4b-9274-11b2a4f23605 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:50.289290 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ade89-7dba-4c4b-9274-11b2a4f23605 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:50.296365 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ade89-7dba-4c4b-9274-11b2a4f23605 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:50.296504 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf3e54-6051-45ff-972a-82b8f8604b0d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:50.297865 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ade89-7dba-4c4b-9274-11b2a4f23605 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:50.311863 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-d28ade89-7dba-4c4b-9274-11b2a4f23605 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 17:13:50.311863 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:50.311863 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:50.311863 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:50.311863 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:50.311863 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:50.311863 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:50.311863 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:50.311863 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:50.311863 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:50.311863 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:50.311863 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:50.311863 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:13:50.311863 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:13:50.311863 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:13:50.311863 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:13:50.312819 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:50.312819 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:50.312819 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:13:50.312819 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:13:50.312819 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:13:50.312819 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:13:50.312819 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:50.312819 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:50.312819 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:50.312819 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:50.312819 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:50.312819 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:50.312819 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:50.312819 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:50.312819 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:50.312819 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:50.312819 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:50.312819 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:50.314255 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:50.314255 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:50.314255 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:13:50.314255 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:13:50.314255 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:13:50.314255 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:13:50.314255 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:13:50.314255 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:13:50.314255 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 17:13:50.314255 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:50.314255 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 245/503] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:50.314255 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ade89-7dba-4c4b-9274-11b2a4f23605 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:50.331658 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807684b-56c2-47db-8953-919e8a21b591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:50.332256 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807684b-56c2-47db-8953-919e8a21b591 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:50.332534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807684b-56c2-47db-8953-919e8a21b591 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:50.332805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807684b-56c2-47db-8953-919e8a21b591 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:50.333472 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807684b-56c2-47db-8953-919e8a21b591 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:50.333778 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807684b-56c2-47db-8953-919e8a21b591 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:50.335142 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807684b-56c2-47db-8953-919e8a21b591 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:50.347036 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 259/504] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:50.347810 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807684b-56c2-47db-8953-919e8a21b591 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:50.392992 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:50.414964 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ade89-7dba-4c4b-9274-11b2a4f23605 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:50.446427 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807684b-56c2-47db-8953-919e8a21b591 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:50.448299 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b804c-2827-4fc4-be72-9fcc27401cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:50.448927 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b804c-2827-4fc4-be72-9fcc27401cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:50.449210 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b804c-2827-4fc4-be72-9fcc27401cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:50.449630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b804c-2827-4fc4-be72-9fcc27401cf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:50.460107 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b804c-2827-4fc4-be72-9fcc27401cf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:50.461599 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b804c-2827-4fc4-be72-9fcc27401cf9 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:50.468285 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:50.477236 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-3e5b804c-2827-4fc4-be72-9fcc27401cf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:50.477236 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:50.477236 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:50.477236 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:50.477236 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:50.477236 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:50.477236 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:50.477236 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:50.477236 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:50.477236 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:50.477236 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:50.477236 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:50.477236 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:13:50.477236 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:13:50.477236 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:13:50.477236 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:13:50.478322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:50.478322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:50.478322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:50.478322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:50.478322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:50.478322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:50.478322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:50.478322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:50.478322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:50.478322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:50.478322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:50.478322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:50.478322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:50.478322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:50.478322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:50.478322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:50.478322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:13:50.479397 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:13:50.479397 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:50.479397 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:50.479397 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 246/505] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:13:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:50.479397 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b804c-2827-4fc4-be72-9fcc27401cf9 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:50.483735 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d99c8a-9d3d-4a4a-b136-9a8cae41a7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:50.484448 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d99c8a-9d3d-4a4a-b136-9a8cae41a7b5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:50.484801 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d99c8a-9d3d-4a4a-b136-9a8cae41a7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:50.485138 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d99c8a-9d3d-4a4a-b136-9a8cae41a7b5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:50.492492 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d99c8a-9d3d-4a4a-b136-9a8cae41a7b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:50.493978 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d99c8a-9d3d-4a4a-b136-9a8cae41a7b5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:50.507058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-54d99c8a-9d3d-4a4a-b136-9a8cae41a7b5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 17:13:50.507058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:50.507058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:50.507058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:50.507058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:50.507058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:50.507058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:50.507058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:50.507058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:50.507058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:50.507058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:50.507058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:50.507058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:13:50.507058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:13:50.507058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:13:50.507058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:13:50.508107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:50.508107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:50.508107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:13:50.508107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:13:50.508107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:13:50.508107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:13:50.508107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:50.508107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:50.508107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:50.508107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:50.508107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:50.508107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:50.508107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:50.508107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:50.508107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:50.508107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:50.508107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:50.508107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:50.508992 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:50.508992 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:50.508992 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:13:50.508992 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:13:50.508992 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:13:50.508992 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:13:50.508992 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:13:50.508992 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:13:50.508992 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 17:13:50.508992 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:50.508992 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 260/506] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:50.508992 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d99c8a-9d3d-4a4a-b136-9a8cae41a7b5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:50.585234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b804c-2827-4fc4-be72-9fcc27401cf9 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:50.608416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d99c8a-9d3d-4a4a-b136-9a8cae41a7b5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:50.610823 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:50.618568 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622af97c-3a1d-4324-87f4-f331ca6f3833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:50.619165 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622af97c-3a1d-4324-87f4-f331ca6f3833 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:50.619437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622af97c-3a1d-4324-87f4-f331ca6f3833 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:50.619703 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622af97c-3a1d-4324-87f4-f331ca6f3833 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:50.620362 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622af97c-3a1d-4324-87f4-f331ca6f3833 None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:50.620654 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622af97c-3a1d-4324-87f4-f331ca6f3833 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:50.622042 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622af97c-3a1d-4324-87f4-f331ca6f3833 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:50.629895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 247/507] 10.222.0.94 () {56 vars in 1103 bytes} [Thu Sep 1 17:13:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:50.630801 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622af97c-3a1d-4324-87f4-f331ca6f3833 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:50.643969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad570ca-e8d2-4975-9301-3fd2a97531e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:50.644567 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad570ca-e8d2-4975-9301-3fd2a97531e6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:50.644844 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad570ca-e8d2-4975-9301-3fd2a97531e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:50.645110 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad570ca-e8d2-4975-9301-3fd2a97531e6 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:50.645865 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad570ca-e8d2-4975-9301-3fd2a97531e6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:50.646164 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad570ca-e8d2-4975-9301-3fd2a97531e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:50.647579 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad570ca-e8d2-4975-9301-3fd2a97531e6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:50.683917 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 261/508] 10.222.0.94 () {56 vars in 1137 bytes} [Thu Sep 1 17:13:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:50.684770 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad570ca-e8d2-4975-9301-3fd2a97531e6 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:50.693055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:50.741569 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622af97c-3a1d-4324-87f4-f331ca6f3833 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:50.774415 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6871d-cfb8-49c9-8a40-c2aeb6ab9396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:50.775034 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6871d-cfb8-49c9-8a40-c2aeb6ab9396 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:50.775310 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6871d-cfb8-49c9-8a40-c2aeb6ab9396 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:50.775582 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6871d-cfb8-49c9-8a40-c2aeb6ab9396 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:50.782836 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6871d-cfb8-49c9-8a40-c2aeb6ab9396 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:50.784262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6871d-cfb8-49c9-8a40-c2aeb6ab9396 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:50.789665 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad570ca-e8d2-4975-9301-3fd2a97531e6 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:50.795705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-43f6871d-cfb8-49c9-8a40-c2aeb6ab9396 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:13:50.795705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:50.795705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:50.795705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:50.795705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:50.795705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:50.795705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:50.795705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:50.795705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:50.795705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:50.795705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:50.795705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:50.795705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:13:50.795705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:13:50.795705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:13:50.795705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:13:50.796588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:50.796588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:50.796588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:13:50.796588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:13:50.796588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:13:50.796588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:13:50.796588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:50.796588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:50.796588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:50.796588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:50.796588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:50.796588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:50.796588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:50.796588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:50.796588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:50.796588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:50.796588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:50.796588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:50.797563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:50.797563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:50.797563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:13:50.797563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:13:50.797563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:13:50.797563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:13:50.797563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:13:50.797563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:13:50.797563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:13:50.797563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:50.797563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 248/509] 10.222.0.94 () {56 vars in 1093 bytes} [Thu Sep 1 17:13:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:50.797563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6871d-cfb8-49c9-8a40-c2aeb6ab9396 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:50.829135 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8562a1-2768-4191-9f75-78bfd3c83fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:50.829759 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8562a1-2768-4191-9f75-78bfd3c83fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:50.830041 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8562a1-2768-4191-9f75-78bfd3c83fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:50.830458 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8562a1-2768-4191-9f75-78bfd3c83fa9 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:50.830947 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8562a1-2768-4191-9f75-78bfd3c83fa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:50.831252 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8562a1-2768-4191-9f75-78bfd3c83fa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:50.832631 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8562a1-2768-4191-9f75-78bfd3c83fa9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:50.843611 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 262/510] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:50.844389 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8562a1-2768-4191-9f75-78bfd3c83fa9 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:50.869974 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:50.899821 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6871d-cfb8-49c9-8a40-c2aeb6ab9396 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:50.918803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:50.934000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a219465-4a47-4612-bb52-188b82dd19e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:50.934601 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a219465-4a47-4612-bb52-188b82dd19e9 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:50.934939 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a219465-4a47-4612-bb52-188b82dd19e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:50.935214 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a219465-4a47-4612-bb52-188b82dd19e9 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:50.935937 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a219465-4a47-4612-bb52-188b82dd19e9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:50.936238 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a219465-4a47-4612-bb52-188b82dd19e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:50.937678 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a219465-4a47-4612-bb52-188b82dd19e9 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:50.942709 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8562a1-2768-4191-9f75-78bfd3c83fa9 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:50.974613 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 249/511] 10.222.0.94 () {56 vars in 1137 bytes} [Thu Sep 1 17:13:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:50.975438 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a219465-4a47-4612-bb52-188b82dd19e9 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:50.976345 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7485ad-cf90-4644-8ff8-11685b6c83bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:50.976975 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7485ad-cf90-4644-8ff8-11685b6c83bd None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:50.977255 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7485ad-cf90-4644-8ff8-11685b6c83bd None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:50.977560 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7485ad-cf90-4644-8ff8-11685b6c83bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:50.988063 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7485ad-cf90-4644-8ff8-11685b6c83bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:50.989542 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7485ad-cf90-4644-8ff8-11685b6c83bd None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:51.004430 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-4f7485ad-cf90-4644-8ff8-11685b6c83bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:51.004430 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:51.004430 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:51.004430 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:51.004430 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:51.004430 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:51.004430 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:51.004430 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:51.004430 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:51.004430 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:51.004430 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:51.004430 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:51.004430 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:13:51.004430 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:13:51.004430 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:13:51.004430 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:13:51.005433 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:51.005433 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:51.005433 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:51.005433 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:51.005433 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:51.005433 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:51.005433 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:51.005433 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:51.005433 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:51.005433 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:51.005433 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:51.005433 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:51.005433 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:51.005433 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:51.005433 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:51.005433 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:51.005433 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:13:51.006280 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:13:51.006280 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:51.006280 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:51.006280 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 263/512] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:13:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:51.006513 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7485ad-cf90-4644-8ff8-11685b6c83bd None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:51.081371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a219465-4a47-4612-bb52-188b82dd19e9 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:51.082803 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:51.107099 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7485ad-cf90-4644-8ff8-11685b6c83bd None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:51.114397 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa7fa5-5fdb-4b47-bec8-6c1716691813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:51.115004 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa7fa5-5fdb-4b47-bec8-6c1716691813 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:51.115285 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa7fa5-5fdb-4b47-bec8-6c1716691813 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:51.115564 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa7fa5-5fdb-4b47-bec8-6c1716691813 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:51.139964 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cae8e-7b85-429d-aef7-a90f5621856a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:51.140599 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cae8e-7b85-429d-aef7-a90f5621856a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:51.140877 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cae8e-7b85-429d-aef7-a90f5621856a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:51.141148 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cae8e-7b85-429d-aef7-a90f5621856a None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:51.141910 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cae8e-7b85-429d-aef7-a90f5621856a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:51.142216 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cae8e-7b85-429d-aef7-a90f5621856a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:51.143640 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cae8e-7b85-429d-aef7-a90f5621856a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:51.160410 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 264/513] 10.222.0.94 () {56 vars in 1133 bytes} [Thu Sep 1 17:13:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:51.161194 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cae8e-7b85-429d-aef7-a90f5621856a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:51.161613 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:51.183841 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa7fa5-5fdb-4b47-bec8-6c1716691813 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:51.185819 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa7fa5-5fdb-4b47-bec8-6c1716691813 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:51.262621 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cae8e-7b85-429d-aef7-a90f5621856a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:51.280270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 250/514] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:13:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:13:51.281176 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa7fa5-5fdb-4b47-bec8-6c1716691813 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:51.292207 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:51.297565 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4a4dc-d7db-490a-aadd-908ad22734b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:51.298166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4a4dc-d7db-490a-aadd-908ad22734b7 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:51.298439 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4a4dc-d7db-490a-aadd-908ad22734b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:51.298705 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4a4dc-d7db-490a-aadd-908ad22734b7 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:51.299407 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4a4dc-d7db-490a-aadd-908ad22734b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:51.300832 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4a4dc-d7db-490a-aadd-908ad22734b7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:51.321772 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 265/515] 10.222.0.94 () {60 vars in 1132 bytes} [Thu Sep 1 17:13:51 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:13:51.322854 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4a4dc-d7db-490a-aadd-908ad22734b7 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:51.363389 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:51.389685 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa7fa5-5fdb-4b47-bec8-6c1716691813 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:51.428869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa99bc9-95a3-43ac-ad34-c662a461b0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:51.429589 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa99bc9-95a3-43ac-ad34-c662a461b0f0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:51.429788 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa99bc9-95a3-43ac-ad34-c662a461b0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:51.430053 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa99bc9-95a3-43ac-ad34-c662a461b0f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:51.451520 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4a4dc-d7db-490a-aadd-908ad22734b7 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:51.494023 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968d4f5-a382-4541-a93f-1fd1b82ae0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:51.494668 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968d4f5-a382-4541-a93f-1fd1b82ae0e8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:51.494886 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968d4f5-a382-4541-a93f-1fd1b82ae0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:51.495144 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968d4f5-a382-4541-a93f-1fd1b82ae0e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:51.495978 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968d4f5-a382-4541-a93f-1fd1b82ae0e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:51.496079 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968d4f5-a382-4541-a93f-1fd1b82ae0e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:51.498020 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968d4f5-a382-4541-a93f-1fd1b82ae0e8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:51.515801 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 266/516] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:51.516111 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa99bc9-95a3-43ac-ad34-c662a461b0f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:51.516486 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968d4f5-a382-4541-a93f-1fd1b82ae0e8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:51.517658 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa99bc9-95a3-43ac-ad34-c662a461b0f0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:51.571413 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:51.602156 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:51.624426 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968d4f5-a382-4541-a93f-1fd1b82ae0e8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:51.627755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 251/517] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:13:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:13:51.628628 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa99bc9-95a3-43ac-ad34-c662a461b0f0 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:51.670267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35dfcc-5d49-4dec-9cf8-59302d23ca76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:51.670879 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35dfcc-5d49-4dec-9cf8-59302d23ca76 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:51.671517 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35dfcc-5d49-4dec-9cf8-59302d23ca76 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:51.671797 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35dfcc-5d49-4dec-9cf8-59302d23ca76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:51.734318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa99bc9-95a3-43ac-ad34-c662a461b0f0 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:51.740414 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35dfcc-5d49-4dec-9cf8-59302d23ca76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:51.741931 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35dfcc-5d49-4dec-9cf8-59302d23ca76 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:51.771774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b5d21-75a8-4f63-8e67-6bef2ab6702e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:51.772330 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b5d21-75a8-4f63-8e67-6bef2ab6702e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:51.772607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b5d21-75a8-4f63-8e67-6bef2ab6702e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:51.772877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b5d21-75a8-4f63-8e67-6bef2ab6702e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:51.783513 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b5d21-75a8-4f63-8e67-6bef2ab6702e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:51.784960 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b5d21-75a8-4f63-8e67-6bef2ab6702e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:51.794741 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:51.800049 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-619b5d21-75a8-4f63-8e67-6bef2ab6702e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:51.800049 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:51.800049 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:51.800049 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:51.800049 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:51.800049 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:51.800049 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:51.800049 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:51.800049 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:51.800049 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:51.800049 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:51.800049 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:51.800049 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:13:51.800049 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:13:51.800049 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:13:51.800049 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:13:51.800962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:51.800962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:51.800962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:51.800962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:51.800962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:51.800962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:51.800962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:51.800962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:51.800962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:51.800962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:51.800962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:51.800962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:51.800962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:51.800962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:51.800962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:51.800962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:51.800962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:13:51.801852 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:13:51.801852 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:51.801852 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:51.801852 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 252/518] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:13:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:51.802068 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b5d21-75a8-4f63-8e67-6bef2ab6702e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:51.836755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:51.865570 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 267/519] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:13:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:13:51.866457 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35dfcc-5d49-4dec-9cf8-59302d23ca76 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:51.917022 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b5d21-75a8-4f63-8e67-6bef2ab6702e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:51.950941 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d58780-596c-4dc8-a6cd-547d9f28b742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:51.951560 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d58780-596c-4dc8-a6cd-547d9f28b742 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:51.951830 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d58780-596c-4dc8-a6cd-547d9f28b742 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:51.952097 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d58780-596c-4dc8-a6cd-547d9f28b742 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:51.959637 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d58780-596c-4dc8-a6cd-547d9f28b742 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:51.961070 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d58780-596c-4dc8-a6cd-547d9f28b742 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:51.971900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35dfcc-5d49-4dec-9cf8-59302d23ca76 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:51.972618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-22d58780-596c-4dc8-a6cd-547d9f28b742 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 17:13:51.972618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:51.972618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:51.972618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:51.972618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:51.972618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:51.972618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:51.972618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:51.972618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:51.972618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:51.972618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:51.972618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:51.972618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:13:51.972618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:13:51.972618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:13:51.972618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:13:51.973526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:51.973526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:51.973526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:13:51.973526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:13:51.973526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:13:51.973526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:13:51.973526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:51.973526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:51.973526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:51.973526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:51.973526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:51.973526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:51.973526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:51.973526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:51.973526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:51.973526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:51.973526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:51.973526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:51.974422 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:51.974422 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:51.974422 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:13:51.974422 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:13:51.974422 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:13:51.974422 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:13:51.974422 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:13:51.974422 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:13:51.974422 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 17:13:51.974422 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:51.974422 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 253/520] 10.222.0.94 () {56 vars in 1102 bytes} [Thu Sep 1 17:13:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:51.974978 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d58780-596c-4dc8-a6cd-547d9f28b742 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:52.011649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08671405-ad2b-465e-9007-d6f341e26566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:52.012274 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08671405-ad2b-465e-9007-d6f341e26566 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:52.012549 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08671405-ad2b-465e-9007-d6f341e26566 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:52.012815 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08671405-ad2b-465e-9007-d6f341e26566 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:52.025540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08671405-ad2b-465e-9007-d6f341e26566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:52.026917 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08671405-ad2b-465e-9007-d6f341e26566 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:52.036019 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:52.044292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-08671405-ad2b-465e-9007-d6f341e26566 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:52.044292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:52.044292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:52.044292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:52.044292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:52.044292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:52.044292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:52.044292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:52.044292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:52.044292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:52.044292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:52.044292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:52.044292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:13:52.044292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:13:52.044292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:13:52.044292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:13:52.045380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:52.045380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:52.045380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:52.045380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:52.045380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:52.045380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:52.045380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:52.045380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:52.045380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:52.045380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:52.045380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:52.045380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:52.045380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:52.045380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:52.045380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:52.045380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:52.045380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:13:52.046484 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:13:52.046484 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:52.046484 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:52.048498 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 268/521] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:13:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:52.049552 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08671405-ad2b-465e-9007-d6f341e26566 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:52.065785 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:52.076964 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d58780-596c-4dc8-a6cd-547d9f28b742 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:52.112906 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f577af3-a2e8-493a-99b9-390fba03ef90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:52.113562 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f577af3-a2e8-493a-99b9-390fba03ef90 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:52.113838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f577af3-a2e8-493a-99b9-390fba03ef90 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:52.114106 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f577af3-a2e8-493a-99b9-390fba03ef90 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:52.114735 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f577af3-a2e8-493a-99b9-390fba03ef90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:52.115036 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f577af3-a2e8-493a-99b9-390fba03ef90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:52.116503 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f577af3-a2e8-493a-99b9-390fba03ef90 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:52.132686 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 254/522] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:52.132686 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f577af3-a2e8-493a-99b9-390fba03ef90 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:52.158983 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08671405-ad2b-465e-9007-d6f341e26566 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:52.192198 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f0d63-3a7e-4825-a0dc-a41a3c30b89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:52.192842 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f0d63-3a7e-4825-a0dc-a41a3c30b89d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:52.193127 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f0d63-3a7e-4825-a0dc-a41a3c30b89d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:52.193421 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f0d63-3a7e-4825-a0dc-a41a3c30b89d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:52.204777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f0d63-3a7e-4825-a0dc-a41a3c30b89d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:52.206327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f0d63-3a7e-4825-a0dc-a41a3c30b89d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:52.220478 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-cd6f0d63-3a7e-4825-a0dc-a41a3c30b89d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:52.220478 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:52.220478 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:52.220478 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:52.220478 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:52.220478 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:52.220478 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:52.220478 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:52.220478 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:52.220478 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:52.220478 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:52.220478 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:52.220478 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:13:52.220478 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:13:52.220478 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:13:52.220478 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:13:52.221601 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:52.221601 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:52.221601 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:52.221601 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:52.221601 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:52.221601 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:52.221601 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:52.221601 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:52.221601 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:52.221601 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:52.221601 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:52.221601 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:52.221601 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:52.221601 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:52.221601 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:52.221601 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:52.221601 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:13:52.222591 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:13:52.222591 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:52.222591 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:52.222591 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 269/523] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:13:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:52.222814 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f0d63-3a7e-4825-a0dc-a41a3c30b89d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:52.231366 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f577af3-a2e8-493a-99b9-390fba03ef90 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:52.266493 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47e32a-f4d7-469d-9833-367d78cb1732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:52.267386 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47e32a-f4d7-469d-9833-367d78cb1732 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:52.267813 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47e32a-f4d7-469d-9833-367d78cb1732 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:52.268087 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47e32a-f4d7-469d-9833-367d78cb1732 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:52.268805 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47e32a-f4d7-469d-9833-367d78cb1732 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:52.269122 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47e32a-f4d7-469d-9833-367d78cb1732 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:52.270616 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47e32a-f4d7-469d-9833-367d78cb1732 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:52.278718 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:52.292345 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 255/524] 10.222.0.94 () {56 vars in 1139 bytes} [Thu Sep 1 17:13:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:52.292345 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47e32a-f4d7-469d-9833-367d78cb1732 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:52.301165 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:52.334583 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f0d63-3a7e-4825-a0dc-a41a3c30b89d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:52.369392 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d9813-327f-46f9-a676-d219944eed4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:52.370024 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d9813-327f-46f9-a676-d219944eed4b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:52.370300 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d9813-327f-46f9-a676-d219944eed4b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:52.370569 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d9813-327f-46f9-a676-d219944eed4b None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:52.371201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d9813-327f-46f9-a676-d219944eed4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:52.371497 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d9813-327f-46f9-a676-d219944eed4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:52.373320 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d9813-327f-46f9-a676-d219944eed4b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:52.385496 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 270/525] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:52.386314 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d9813-327f-46f9-a676-d219944eed4b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:52.407925 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47e32a-f4d7-469d-9833-367d78cb1732 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:52.454135 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38f11c-425f-4a48-86ed-e6a5642cf804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:52.456109 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38f11c-425f-4a48-86ed-e6a5642cf804 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:52.456750 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38f11c-425f-4a48-86ed-e6a5642cf804 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:52.457195 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38f11c-425f-4a48-86ed-e6a5642cf804 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:52.466593 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c38f11c-425f-4a48-86ed-e6a5642cf804 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:52.468354 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c38f11c-425f-4a48-86ed-e6a5642cf804 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:52.483559 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-5c38f11c-425f-4a48-86ed-e6a5642cf804 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:13:52.483559 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:52.483559 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:52.483559 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:52.483559 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:52.483559 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:52.483559 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:52.483559 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:52.483559 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:52.483559 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:52.483559 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:52.483559 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:52.483559 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:13:52.483559 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:13:52.483559 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:13:52.484484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:13:52.484484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:52.484484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:52.484484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:52.484484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:52.484484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:52.484484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:52.484484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:52.484484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:52.484484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:52.484484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:52.484484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:52.484484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:52.484484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:52.484484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:52.484484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:52.484484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:52.485481 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:13:52.485481 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:13:52.485481 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:13:52.485481 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:13:52.485481 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:13:52.485481 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:13:52.485481 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:13:52.485481 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:52.487802 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 256/526] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:13:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:52.488207 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d9813-327f-46f9-a676-d219944eed4b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:52.489234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38f11c-425f-4a48-86ed-e6a5642cf804 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:52.505254 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:52.530875 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f78f29-897d-45da-80c3-2cbc6b1fc76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:52.530875 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f78f29-897d-45da-80c3-2cbc6b1fc76b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:52.531132 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f78f29-897d-45da-80c3-2cbc6b1fc76b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:52.531218 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f78f29-897d-45da-80c3-2cbc6b1fc76b None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:52.532233 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f78f29-897d-45da-80c3-2cbc6b1fc76b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:52.532233 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f78f29-897d-45da-80c3-2cbc6b1fc76b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:52.533994 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f78f29-897d-45da-80c3-2cbc6b1fc76b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:52.546240 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 271/527] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:52.546881 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f78f29-897d-45da-80c3-2cbc6b1fc76b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:52.566120 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:52.601649 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38f11c-425f-4a48-86ed-e6a5642cf804 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:52.636893 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6253d3-0304-4a9b-8c7e-58b051248270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:52.637587 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6253d3-0304-4a9b-8c7e-58b051248270 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:52.637885 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6253d3-0304-4a9b-8c7e-58b051248270 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:52.638238 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6253d3-0304-4a9b-8c7e-58b051248270 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:52.651802 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f78f29-897d-45da-80c3-2cbc6b1fc76b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:52.687506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5313e-d99b-4bb4-8bf7-3c7756cb153b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:52.688129 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5313e-d99b-4bb4-8bf7-3c7756cb153b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:52.688402 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5313e-d99b-4bb4-8bf7-3c7756cb153b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:52.688669 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5313e-d99b-4bb4-8bf7-3c7756cb153b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:52.695239 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5313e-d99b-4bb4-8bf7-3c7756cb153b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:52.696885 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5313e-d99b-4bb4-8bf7-3c7756cb153b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:52.708749 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-21b5313e-d99b-4bb4-8bf7-3c7756cb153b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:13:52.708749 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:52.708749 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:52.708749 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:52.708749 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:52.708749 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:52.708749 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:52.708749 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:52.708749 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:52.708749 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:52.708749 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:52.708749 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:52.708749 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:13:52.708749 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:13:52.708749 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:13:52.709662 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:13:52.709662 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:52.709662 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:52.709662 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:52.709662 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:52.709662 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:52.709662 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:52.709662 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:52.709662 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:52.709662 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:52.709662 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:52.709662 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:52.709662 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:52.709662 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:52.709662 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:52.709662 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:52.709662 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:52.710517 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:13:52.710517 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:13:52.710517 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:13:52.710517 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:13:52.710517 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:13:52.710517 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:13:52.710517 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:13:52.710517 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:52.710517 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 272/528] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:13:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:52.710986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5313e-d99b-4bb4-8bf7-3c7756cb153b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:52.715492 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6253d3-0304-4a9b-8c7e-58b051248270 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:52.717502 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6253d3-0304-4a9b-8c7e-58b051248270 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:52.745024 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:52.787165 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:52.826121 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5313e-d99b-4bb4-8bf7-3c7756cb153b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:52.828970 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 257/529] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:13:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:13:52.829947 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6253d3-0304-4a9b-8c7e-58b051248270 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:52.869662 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a826723-5f2d-427c-a17f-9a3d33cb2937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:52.870275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a826723-5f2d-427c-a17f-9a3d33cb2937 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:52.870558 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a826723-5f2d-427c-a17f-9a3d33cb2937 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:52.870832 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a826723-5f2d-427c-a17f-9a3d33cb2937 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:52.871529 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a826723-5f2d-427c-a17f-9a3d33cb2937 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:52.871838 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a826723-5f2d-427c-a17f-9a3d33cb2937 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:52.873866 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a826723-5f2d-427c-a17f-9a3d33cb2937 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:52.892974 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 273/530] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:13:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:52.893699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a826723-5f2d-427c-a17f-9a3d33cb2937 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:52.939696 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6253d3-0304-4a9b-8c7e-58b051248270 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:52.974807 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b2922-2197-41ae-8204-bdc49db138c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:52.975431 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b2922-2197-41ae-8204-bdc49db138c5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:52.975705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b2922-2197-41ae-8204-bdc49db138c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:52.975980 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b2922-2197-41ae-8204-bdc49db138c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:52.983177 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b2922-2197-41ae-8204-bdc49db138c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:52.984615 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b2922-2197-41ae-8204-bdc49db138c5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:52.992554 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:52.996167 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-328b2922-2197-41ae-8204-bdc49db138c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:13:52.996167 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:52.996167 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:52.996167 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:52.996167 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:52.996167 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:52.996167 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:52.996167 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:52.996167 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:52.996167 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:52.996167 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:52.996167 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:52.996167 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:13:52.996167 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:13:52.996167 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:13:52.997011 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:13:52.997011 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:52.997011 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:52.997011 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:52.997011 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:52.997011 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:52.997011 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:52.997011 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:52.997011 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:52.997011 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:52.997011 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:52.997011 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:52.997011 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:52.997011 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:52.997011 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:52.997011 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:52.997011 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:52.997988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:13:52.997988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:13:52.997988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:13:52.997988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:13:52.997988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:13:52.997988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:13:52.997988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:13:52.997988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:52.997988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 258/531] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:13:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:52.998465 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b2922-2197-41ae-8204-bdc49db138c5 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:53.007585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a826723-5f2d-427c-a17f-9a3d33cb2937 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:53.032998 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:53.047565 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb6a63-cf8a-4969-947a-52b7f2d3c90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:53.048745 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb6a63-cf8a-4969-947a-52b7f2d3c90a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:53.049428 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb6a63-cf8a-4969-947a-52b7f2d3c90a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:53.049789 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb6a63-cf8a-4969-947a-52b7f2d3c90a None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:53.050779 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb6a63-cf8a-4969-947a-52b7f2d3c90a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:53.051141 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb6a63-cf8a-4969-947a-52b7f2d3c90a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:53.053194 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb6a63-cf8a-4969-947a-52b7f2d3c90a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:53.071806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 274/532] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:13:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:53.071806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb6a63-cf8a-4969-947a-52b7f2d3c90a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:53.114485 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b2922-2197-41ae-8204-bdc49db138c5 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:53.149818 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614b247-915b-4d2b-80af-1cdd4bbf5af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:53.150446 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614b247-915b-4d2b-80af-1cdd4bbf5af1 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:53.150720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614b247-915b-4d2b-80af-1cdd4bbf5af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:53.150988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614b247-915b-4d2b-80af-1cdd4bbf5af1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:53.163768 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614b247-915b-4d2b-80af-1cdd4bbf5af1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:53.165201 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614b247-915b-4d2b-80af-1cdd4bbf5af1 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:53.180083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-1614b247-915b-4d2b-80af-1cdd4bbf5af1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:53.180083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:53.180083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:53.180083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:53.180083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:53.180083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:53.180083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:53.180083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:53.180083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:53.180083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:53.180083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:53.180083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:53.180083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:13:53.180083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:13:53.180083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:13:53.180083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:13:53.181031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:53.181031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:53.181031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:53.181031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:53.181031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:53.181031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:53.181031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:53.181031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:53.181031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:53.181031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:53.181031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:53.181031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:53.181031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:53.181031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:53.181031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:53.181031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:53.181031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:13:53.181934 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:13:53.181934 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:53.181934 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:53.181934 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 259/533] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:13:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:53.182160 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614b247-915b-4d2b-80af-1cdd4bbf5af1 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:53.192553 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb6a63-cf8a-4969-947a-52b7f2d3c90a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:53.233145 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532c469-1dab-49a1-a1c6-0f2bbe6d7c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:53.233779 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532c469-1dab-49a1-a1c6-0f2bbe6d7c29 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:53.234055 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532c469-1dab-49a1-a1c6-0f2bbe6d7c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:53.234325 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532c469-1dab-49a1-a1c6-0f2bbe6d7c29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:53.235066 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532c469-1dab-49a1-a1c6-0f2bbe6d7c29 None admin] RBAC: Adding query filter params (role.id=e903cb11e2bf466fa1b3fae894847c3e, scope.project.id=c8f9428f37354c82ac52b6b8eccc424a, user.id=eee371754d7d43b4987084db58f44957) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:53.235355 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532c469-1dab-49a1-a1c6-0f2bbe6d7c29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:53.236788 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532c469-1dab-49a1-a1c6-0f2bbe6d7c29 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:53.242485 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 275/534] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:13:53 2022] GET /identity/v3/role_assignments?user.id=eee371754d7d43b4987084db58f44957&scope.project.id=c8f9428f37354c82ac52b6b8eccc424a&role.id=e903cb11e2bf466fa1b3fae894847c3e => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:53.243185 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532c469-1dab-49a1-a1c6-0f2bbe6d7c29 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:53.271419 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:53.287553 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:53.318082 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614b247-915b-4d2b-80af-1cdd4bbf5af1 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:53.359710 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b856ffe-0f4f-495c-aeed-2416f80a3d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:53.360321 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b856ffe-0f4f-495c-aeed-2416f80a3d48 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:53.360602 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b856ffe-0f4f-495c-aeed-2416f80a3d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:53.360869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b856ffe-0f4f-495c-aeed-2416f80a3d48 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:53.361603 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b856ffe-0f4f-495c-aeed-2416f80a3d48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:53.361894 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b856ffe-0f4f-495c-aeed-2416f80a3d48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:53.363320 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b856ffe-0f4f-495c-aeed-2416f80a3d48 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:53.368563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532c469-1dab-49a1-a1c6-0f2bbe6d7c29 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:53.381483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 260/535] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:13:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:53.382467 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b856ffe-0f4f-495c-aeed-2416f80a3d48 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:53.412490 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039a846-8105-4ee4-8544-f13ec8e08116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:53.413383 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039a846-8105-4ee4-8544-f13ec8e08116 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:53.413690 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039a846-8105-4ee4-8544-f13ec8e08116 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:53.413958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039a846-8105-4ee4-8544-f13ec8e08116 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:53.414686 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039a846-8105-4ee4-8544-f13ec8e08116 None admin] RBAC: Adding query filter params (role.id=e903cb11e2bf466fa1b3fae894847c3e, scope.project.id=c8f9428f37354c82ac52b6b8eccc424a, user.id=74c6647f3aa54dc68e888b3adb8c28b5) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:53.414992 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039a846-8105-4ee4-8544-f13ec8e08116 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:53.416661 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039a846-8105-4ee4-8544-f13ec8e08116 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:53.423648 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 276/536] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:13:53 2022] GET /identity/v3/role_assignments?user.id=74c6647f3aa54dc68e888b3adb8c28b5&scope.project.id=c8f9428f37354c82ac52b6b8eccc424a&role.id=e903cb11e2bf466fa1b3fae894847c3e => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:53.425006 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee898740-dc4a-4a04-bf18-de537838d7c3 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:53.425286 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee898740-dc4a-4a04-bf18-de537838d7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:53.425587 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee898740-dc4a-4a04-bf18-de537838d7c3 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:53.426956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 277/537] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:53.427601 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee898740-dc4a-4a04-bf18-de537838d7c3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:53.509146 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b856ffe-0f4f-495c-aeed-2416f80a3d48 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:53.552509 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:53.557753 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c8a78-a2d5-4c26-859d-2b6456ab8eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:53.559759 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c8a78-a2d5-4c26-859d-2b6456ab8eab None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:53.560259 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c8a78-a2d5-4c26-859d-2b6456ab8eab None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:53.560723 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c8a78-a2d5-4c26-859d-2b6456ab8eab None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:53.561602 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c8a78-a2d5-4c26-859d-2b6456ab8eab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:53.562704 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c8a78-a2d5-4c26-859d-2b6456ab8eab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:53.564675 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c8a78-a2d5-4c26-859d-2b6456ab8eab None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:53.577823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:53.581117 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee898740-dc4a-4a04-bf18-de537838d7c3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:53.581681 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 261/538] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:53.582946 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70800b59-e90c-4282-bfdd-d3e79295f473 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:53.587820 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70800b59-e90c-4282-bfdd-d3e79295f473 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:53.588106 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70800b59-e90c-4282-bfdd-d3e79295f473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:53.611949 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-70800b59-e90c-4282-bfdd-d3e79295f473 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:53.613174 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-70800b59-e90c-4282-bfdd-d3e79295f473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:53.625247 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09255ab5-fb2a-484e-9a65-dc83cad7abb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:53.626232 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09255ab5-fb2a-484e-9a65-dc83cad7abb8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:53.626664 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09255ab5-fb2a-484e-9a65-dc83cad7abb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:53.627073 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09255ab5-fb2a-484e-9a65-dc83cad7abb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:53.627988 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09255ab5-fb2a-484e-9a65-dc83cad7abb8 None admin] RBAC: Adding query filter params (role.id=e903cb11e2bf466fa1b3fae894847c3e, scope.project.id=c8f9428f37354c82ac52b6b8eccc424a, user.id=8b7fa3c4c5d94b3c9b7f17dde35d39a0) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:53.628431 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09255ab5-fb2a-484e-9a65-dc83cad7abb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:53.630037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09255ab5-fb2a-484e-9a65-dc83cad7abb8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:53.641714 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 278/539] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:13:53 2022] GET /identity/v3/role_assignments?user.id=8b7fa3c4c5d94b3c9b7f17dde35d39a0&scope.project.id=c8f9428f37354c82ac52b6b8eccc424a&role.id=e903cb11e2bf466fa1b3fae894847c3e => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:53.642922 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09255ab5-fb2a-484e-9a65-dc83cad7abb8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:53.719204 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 262/540] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:53.807409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09255ab5-fb2a-484e-9a65-dc83cad7abb8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:53.858217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d8e80-42e4-4fdc-8c17-35809c736346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:53.859215 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d8e80-42e4-4fdc-8c17-35809c736346 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:53.859687 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d8e80-42e4-4fdc-8c17-35809c736346 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:53.860158 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d8e80-42e4-4fdc-8c17-35809c736346 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:53.867404 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d8e80-42e4-4fdc-8c17-35809c736346 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:53.869143 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d8e80-42e4-4fdc-8c17-35809c736346 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:53.885128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-b50d8e80-42e4-4fdc-8c17-35809c736346 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:13:53.885128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:53.885128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:53.885128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:53.885128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:53.885128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:53.885128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:53.885128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:53.885128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:53.885128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:53.885128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:53.885128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:53.885128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:13:53.885128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:13:53.885128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:13:53.886186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:13:53.886186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:53.886186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:53.886186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:53.886186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:53.886186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:53.886186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:53.886186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:53.886186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:53.886186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:53.886186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:53.886186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:53.886186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:53.886186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:53.886186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:53.886186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:53.886186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:53.887249 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:13:53.887249 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:13:53.887249 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:13:53.887249 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:13:53.887249 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:13:53.887249 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:13:53.887249 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:13:53.887249 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:53.889498 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 279/541] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:13:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:53.895435 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70800b59-e90c-4282-bfdd-d3e79295f473 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:54.030673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70800b59-e90c-4282-bfdd-d3e79295f473 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:54.061759 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:54.066725 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf887ac-12be-4dbd-9796-9df206f2b5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:54.067337 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf887ac-12be-4dbd-9796-9df206f2b5e5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:54.067615 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf887ac-12be-4dbd-9796-9df206f2b5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:54.067883 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf887ac-12be-4dbd-9796-9df206f2b5e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:54.068576 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf887ac-12be-4dbd-9796-9df206f2b5e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:54.068876 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf887ac-12be-4dbd-9796-9df206f2b5e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:54.070355 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf887ac-12be-4dbd-9796-9df206f2b5e5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:54.082974 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 263/542] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:13:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:54.088622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d8e80-42e4-4fdc-8c17-35809c736346 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:54.095833 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:54.113544 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf887ac-12be-4dbd-9796-9df206f2b5e5 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:54.224365 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf887ac-12be-4dbd-9796-9df206f2b5e5 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:54.261853 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a1ee3-5f8b-4ef5-b65c-42eaf01f80f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:54.262522 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a1ee3-5f8b-4ef5-b65c-42eaf01f80f0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:54.262796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a1ee3-5f8b-4ef5-b65c-42eaf01f80f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:54.263183 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a1ee3-5f8b-4ef5-b65c-42eaf01f80f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:54.280028 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a1ee3-5f8b-4ef5-b65c-42eaf01f80f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:54.289179 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-b20a1ee3-5f8b-4ef5-b65c-42eaf01f80f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:13:54.289179 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:54.289179 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:54.289179 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:54.289179 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:54.289179 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:54.289179 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:54.289179 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:54.289179 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:54.289179 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:54.289179 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:54.289179 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:54.289179 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:54.289179 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:54.289179 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:54.289179 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:54.290084 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:54.290084 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:54.290084 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:54.290084 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:54.290084 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:54.290084 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:54.290084 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:54.290084 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:54.290084 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:54.290084 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:54.290084 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:54.290084 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:54.290084 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:54.290084 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:54.290084 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:54.290084 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:54.290888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:54.290888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:54.290888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:54.290888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:54.290888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:54.290888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:54.290888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:54.290888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:54.290888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:54.290888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:54.290888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:13:54.290888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:54.290888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 264/543] 10.222.0.94 () {56 vars in 1102 bytes} [Thu Sep 1 17:13:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:13:54.299965 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a1ee3-5f8b-4ef5-b65c-42eaf01f80f0 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:54.305140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d8e80-42e4-4fdc-8c17-35809c736346 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:54.377154 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714c984-15d7-46be-8889-1371ed5005f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:54.377705 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714c984-15d7-46be-8889-1371ed5005f3 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:54.377980 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714c984-15d7-46be-8889-1371ed5005f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:54.378290 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714c984-15d7-46be-8889-1371ed5005f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:54.379077 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8714c984-15d7-46be-8889-1371ed5005f3 None admin] RBAC: Adding query filter params (role.id=e903cb11e2bf466fa1b3fae894847c3e, scope.project.id=c8f9428f37354c82ac52b6b8eccc424a, user.id=92edc2953b8e4e42aa64569335acfc9f) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:54.379385 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8714c984-15d7-46be-8889-1371ed5005f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:54.382782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8714c984-15d7-46be-8889-1371ed5005f3 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:54.396035 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 280/544] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:13:54 2022] GET /identity/v3/role_assignments?user.id=92edc2953b8e4e42aa64569335acfc9f&scope.project.id=c8f9428f37354c82ac52b6b8eccc424a&role.id=e903cb11e2bf466fa1b3fae894847c3e => generated 259 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:54.400706 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:54.498862 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a1ee3-5f8b-4ef5-b65c-42eaf01f80f0 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:54.555120 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b1a4d-71bc-4f39-9595-74190a4de72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:54.556502 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b1a4d-71bc-4f39-9595-74190a4de72e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:54.557077 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b1a4d-71bc-4f39-9595-74190a4de72e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:54.557577 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b1a4d-71bc-4f39-9595-74190a4de72e None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:54.558663 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b1a4d-71bc-4f39-9595-74190a4de72e None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:54.559163 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b1a4d-71bc-4f39-9595-74190a4de72e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:54.561298 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b1a4d-71bc-4f39-9595-74190a4de72e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:54.573384 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 265/545] 10.222.0.94 () {56 vars in 1103 bytes} [Thu Sep 1 17:13:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:54.580599 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714c984-15d7-46be-8889-1371ed5005f3 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:54.683457 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:54.732549 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714c984-15d7-46be-8889-1371ed5005f3 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:54.767205 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a4dd8-bee0-4bf0-858d-f32aa6a71970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:54.768198 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a4dd8-bee0-4bf0-858d-f32aa6a71970 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:54.768670 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a4dd8-bee0-4bf0-858d-f32aa6a71970 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:54.769156 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a4dd8-bee0-4bf0-858d-f32aa6a71970 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:54.780897 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a4dd8-bee0-4bf0-858d-f32aa6a71970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:54.782621 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a4dd8-bee0-4bf0-858d-f32aa6a71970 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:54.797275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-a77a4dd8-bee0-4bf0-858d-f32aa6a71970 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:54.797275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:54.797275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:54.797275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:54.797275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:54.797275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:54.797275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:54.797275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:54.797275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:54.797275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:54.797275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:54.797275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:54.797275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:13:54.797275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:13:54.797275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:13:54.797275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:13:54.798409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:54.798409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:54.798409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:54.798409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:54.798409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:54.798409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:54.798409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:54.798409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:54.798409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:54.798409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:54.798409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:54.798409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:54.798409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:54.798409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:54.798409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:54.798409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:54.798409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:13:54.799279 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:13:54.799279 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:54.799279 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:54.801431 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 281/546] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:13:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:54.811034 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b1a4d-71bc-4f39-9595-74190a4de72e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:54.919509 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b1a4d-71bc-4f39-9595-74190a4de72e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:54.932526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:54.955673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2811f7-76d8-4439-b41a-f637e8b63f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:54.956199 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2811f7-76d8-4439-b41a-f637e8b63f7d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:54.956473 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2811f7-76d8-4439-b41a-f637e8b63f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:54.956740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2811f7-76d8-4439-b41a-f637e8b63f7d None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:54.957381 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2811f7-76d8-4439-b41a-f637e8b63f7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:54.957705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2811f7-76d8-4439-b41a-f637e8b63f7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:54.959056 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2811f7-76d8-4439-b41a-f637e8b63f7d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:54.975936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 266/547] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:54.977335 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a4dd8-bee0-4bf0-858d-f32aa6a71970 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:55.107684 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a4dd8-bee0-4bf0-858d-f32aa6a71970 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:55.133002 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:55.154273 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc53c5-255d-44a4-a220-9da720c7f3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:55.154902 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc53c5-255d-44a4-a220-9da720c7f3f0 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:55.155178 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc53c5-255d-44a4-a220-9da720c7f3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:55.155489 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc53c5-255d-44a4-a220-9da720c7f3f0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:55.167354 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc53c5-255d-44a4-a220-9da720c7f3f0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:55.168821 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc53c5-255d-44a4-a220-9da720c7f3f0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:55.185919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-39dc53c5-255d-44a4-a220-9da720c7f3f0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 17:13:55.185919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:55.185919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:55.185919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:55.185919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:55.185919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:55.185919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:55.185919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:55.185919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:55.185919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:55.185919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:55.185919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:55.185919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:13:55.185919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:13:55.185919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:13:55.185919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:13:55.186851 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:55.186851 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:55.186851 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:13:55.186851 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:13:55.186851 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:13:55.186851 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:13:55.186851 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:55.186851 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:55.186851 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:55.186851 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:55.186851 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:55.186851 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:55.186851 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:55.186851 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:55.186851 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:55.186851 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:55.186851 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:55.186851 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:55.188441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:55.188441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:55.188441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:13:55.188441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:13:55.188441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:13:55.188441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:13:55.188441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:13:55.188441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:13:55.188441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 17:13:55.188441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:55.188441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 282/548] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:13:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:55.193134 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2811f7-76d8-4439-b41a-f637e8b63f7d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:55.295370 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2811f7-76d8-4439-b41a-f637e8b63f7d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:55.330406 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480efed-82f8-4d17-854a-13391f1e9b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:55.331008 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480efed-82f8-4d17-854a-13391f1e9b72 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:55.331280 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480efed-82f8-4d17-854a-13391f1e9b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:55.331546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480efed-82f8-4d17-854a-13391f1e9b72 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:55.332259 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480efed-82f8-4d17-854a-13391f1e9b72 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:55.332554 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480efed-82f8-4d17-854a-13391f1e9b72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:55.334160 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480efed-82f8-4d17-854a-13391f1e9b72 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:55.356107 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 267/549] 10.222.0.94 () {56 vars in 1135 bytes} [Thu Sep 1 17:13:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:55.358074 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc53c5-255d-44a4-a220-9da720c7f3f0 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:55.488276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc53c5-255d-44a4-a220-9da720c7f3f0 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:55.534099 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8ee24-fe52-43d3-99fc-08a8abf1fddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:55.534996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8ee24-fe52-43d3-99fc-08a8abf1fddf None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:55.535468 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8ee24-fe52-43d3-99fc-08a8abf1fddf None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:55.535931 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8ee24-fe52-43d3-99fc-08a8abf1fddf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:55.561501 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c3c73-55db-4cb0-9af3-d8500028bfdf None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:55.561987 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c3c73-55db-4cb0-9af3-d8500028bfdf None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:55.561987 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c3c73-55db-4cb0-9af3-d8500028bfdf None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:55.564613 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 268/550] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:55.569344 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff27c9b-b508-4b22-b2f2-641aec5ea08b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:55.569344 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff27c9b-b508-4b22-b2f2-641aec5ea08b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:55.569344 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff27c9b-b508-4b22-b2f2-641aec5ea08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:55.587501 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-cff27c9b-b508-4b22-b2f2-641aec5ea08b None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:55.588676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cff27c9b-b508-4b22-b2f2-641aec5ea08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:55.600528 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:55.615959 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:55.649344 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8ee24-fe52-43d3-99fc-08a8abf1fddf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:55.652797 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8ee24-fe52-43d3-99fc-08a8abf1fddf None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:55.705484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 269/551] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 17:13:55.706872 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e2922-a47e-40fe-a236-58e10630d9ef None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:55.707158 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e2922-a47e-40fe-a236-58e10630d9ef None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:55.707435 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e2922-a47e-40fe-a236-58e10630d9ef None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:55.712954 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 270/552] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:55.714363 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aaa762-f307-4f55-977c-3a99a6655b91 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:55.714625 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aaa762-f307-4f55-977c-3a99a6655b91 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:55.714893 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aaa762-f307-4f55-977c-3a99a6655b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:55.751576 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-95aaa762-f307-4f55-977c-3a99a6655b91 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:55.752758 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-95aaa762-f307-4f55-977c-3a99a6655b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:55.794238 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 283/553] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:13:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 17:13:55.797713 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8ee24-fe52-43d3-99fc-08a8abf1fddf None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:55.890756 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 271/554] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:55.894842 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:55.915796 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8ee24-fe52-43d3-99fc-08a8abf1fddf None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:55.951399 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b10b6-8384-429d-9094-cee6bbb32b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:55.952035 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b10b6-8384-429d-9094-cee6bbb32b7e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:55.952315 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b10b6-8384-429d-9094-cee6bbb32b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:55.952832 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b10b6-8384-429d-9094-cee6bbb32b7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:55.963377 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b10b6-8384-429d-9094-cee6bbb32b7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:55.964829 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b10b6-8384-429d-9094-cee6bbb32b7e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:55.979526 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-bd3b10b6-8384-429d-9094-cee6bbb32b7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:55.979526 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:55.979526 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:55.979526 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:55.979526 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:55.979526 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:55.979526 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:55.979526 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:55.979526 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:55.979526 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:55.979526 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:55.979526 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:55.979526 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:13:55.979526 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:13:55.979526 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:13:55.979526 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:13:55.980442 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:55.980442 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:55.980442 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:55.980442 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:55.980442 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:55.980442 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:55.980442 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:55.980442 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:55.980442 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:55.980442 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:55.980442 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:55.980442 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:55.980442 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:55.980442 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:55.980442 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:55.980442 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:55.980442 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:13:55.981328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:13:55.981328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:55.981328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:55.981328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 284/555] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:13:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:55.986775 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aaa762-f307-4f55-977c-3a99a6655b91 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:56.128835 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b10b6-8384-429d-9094-cee6bbb32b7e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:56.132162 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:56.144009 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aaa762-f307-4f55-977c-3a99a6655b91 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:56.185376 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4752c70-b07b-452c-9d42-a56cc4370943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:56.186005 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4752c70-b07b-452c-9d42-a56cc4370943 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:56.186280 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4752c70-b07b-452c-9d42-a56cc4370943 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:56.186545 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4752c70-b07b-452c-9d42-a56cc4370943 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:56.187176 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4752c70-b07b-452c-9d42-a56cc4370943 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:56.187467 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4752c70-b07b-452c-9d42-a56cc4370943 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:56.188825 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4752c70-b07b-452c-9d42-a56cc4370943 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:56.201077 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 272/556] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:56.206927 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f21ea-819c-46c1-bd04-ccb3461746b2 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:56.207213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f21ea-819c-46c1-bd04-ccb3461746b2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:56.207489 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f21ea-819c-46c1-bd04-ccb3461746b2 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:56.213021 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 273/557] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:56.213021 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f21ea-819c-46c1-bd04-ccb3461746b2 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:56.252106 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b10b6-8384-429d-9094-cee6bbb32b7e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:56.282485 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:56.288440 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb0765-a781-4370-81fc-cf2daececd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:56.289069 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb0765-a781-4370-81fc-cf2daececd78 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:56.289349 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb0765-a781-4370-81fc-cf2daececd78 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:56.289645 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb0765-a781-4370-81fc-cf2daececd78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:56.300199 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb0765-a781-4370-81fc-cf2daececd78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:56.305162 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-a4fb0765-a781-4370-81fc-cf2daececd78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:13:56.305162 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:56.305162 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:56.305162 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:56.305162 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:56.305162 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:56.305162 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:56.305162 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:56.305162 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:56.305162 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:56.305162 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:56.305162 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:56.305162 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:56.305162 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:56.305162 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:56.305162 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:56.306130 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:56.306130 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:56.306130 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:56.306130 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:56.306130 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:56.306130 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:56.306130 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:56.306130 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:56.306130 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:56.306130 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:56.306130 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:56.306130 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:56.306130 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:56.306130 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:56.306130 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:56.306130 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:56.306939 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:56.306939 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:56.306939 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:56.306939 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:56.306939 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:56.306939 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:56.306939 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:56.306939 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:56.306939 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:56.306939 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:56.306939 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:13:56.306939 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:56.306939 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 285/558] 10.222.0.94 () {56 vars in 1102 bytes} [Thu Sep 1 17:13:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:56.307637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a7ec5-942f-4292-92cf-c006abeb9e0f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:56.307705 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a7ec5-942f-4292-92cf-c006abeb9e0f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:56.308389 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a7ec5-942f-4292-92cf-c006abeb9e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:56.326318 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-339a7ec5-942f-4292-92cf-c006abeb9e0f None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:56.327777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-339a7ec5-942f-4292-92cf-c006abeb9e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:56.332893 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f21ea-819c-46c1-bd04-ccb3461746b2 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:56.370272 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3439a-d049-4cf2-b7da-c38f2ae65957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:56.370896 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3439a-d049-4cf2-b7da-c38f2ae65957 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:56.371431 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3439a-d049-4cf2-b7da-c38f2ae65957 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:56.371431 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3439a-d049-4cf2-b7da-c38f2ae65957 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:56.378632 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3439a-d049-4cf2-b7da-c38f2ae65957 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:56.380199 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3439a-d049-4cf2-b7da-c38f2ae65957 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:56.391655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-8fe3439a-d049-4cf2-b7da-c38f2ae65957 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:13:56.391655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:56.391655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:56.391655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:56.391655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:56.391655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:56.391655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:56.391655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:56.391655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:56.391655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:56.391655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:56.391655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:56.391655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:13:56.391655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:13:56.391655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:13:56.392556 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:13:56.392556 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:56.392556 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:56.392556 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:56.392556 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:56.392556 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:56.392556 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:56.392556 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:56.392556 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:56.392556 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:56.392556 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:56.392556 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:56.392556 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:56.392556 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:56.392556 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:56.392556 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:56.392556 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:56.393848 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:13:56.393848 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:13:56.393848 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:13:56.393848 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:13:56.393848 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:13:56.393848 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:13:56.393848 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:13:56.393848 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:56.393848 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 274/559] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:13:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:13:56.393848 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3439a-d049-4cf2-b7da-c38f2ae65957 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:56.413611 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 286/560] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:56.413611 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a7ec5-942f-4292-92cf-c006abeb9e0f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:56.418834 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:56.521942 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3439a-d049-4cf2-b7da-c38f2ae65957 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:56.525584 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a7ec5-942f-4292-92cf-c006abeb9e0f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:56.552687 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:56.565844 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e203736-ebb0-440e-8119-611dc883af3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:56.566566 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e203736-ebb0-440e-8119-611dc883af3c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:56.566916 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e203736-ebb0-440e-8119-611dc883af3c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:56.567255 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e203736-ebb0-440e-8119-611dc883af3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:56.571935 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e470e10-745b-4a37-9ca5-f71cbe9283ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:56.572958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e470e10-745b-4a37-9ca5-f71cbe9283ed None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:56.573558 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e470e10-745b-4a37-9ca5-f71cbe9283ed None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:56.573996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e470e10-745b-4a37-9ca5-f71cbe9283ed None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:56.574986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e470e10-745b-4a37-9ca5-f71cbe9283ed None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:56.575766 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e470e10-745b-4a37-9ca5-f71cbe9283ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:56.577327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e470e10-745b-4a37-9ca5-f71cbe9283ed None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:56.578573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e203736-ebb0-440e-8119-611dc883af3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:56.585652 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-9e203736-ebb0-440e-8119-611dc883af3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:13:56.585652 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:56.585652 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:56.585652 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:56.585652 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:56.585652 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:56.585652 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:56.585652 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:56.585652 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:56.585652 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:56.585652 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:56.585652 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:56.585652 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:56.585652 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:56.585652 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:56.585652 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:56.586770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:56.586770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:56.586770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:56.586770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:56.586770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:56.586770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:56.586770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:56.586770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:56.586770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:56.586770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:56.586770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:56.586770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:56.586770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:56.586770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:56.586770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:56.586770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:56.587897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:56.587897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:56.587897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:56.587897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:56.587897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:56.587897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:56.587897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:56.587897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:56.587897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:56.587897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:56.587897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:13:56.587897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:56.594163 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 275/561] 10.222.0.94 () {56 vars in 1102 bytes} [Thu Sep 1 17:13:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:56.594163 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e203736-ebb0-440e-8119-611dc883af3c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:56.597573 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 287/562] 10.222.0.94 () {56 vars in 1103 bytes} [Thu Sep 1 17:13:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:56.599940 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e470e10-745b-4a37-9ca5-f71cbe9283ed None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:56.684302 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:56.718124 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e203736-ebb0-440e-8119-611dc883af3c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:56.725237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e470e10-745b-4a37-9ca5-f71cbe9283ed None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:56.751265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2779f-1df4-41de-99e1-a81b7fbe7281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:56.751866 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2779f-1df4-41de-99e1-a81b7fbe7281 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:56.752142 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2779f-1df4-41de-99e1-a81b7fbe7281 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:56.752409 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2779f-1df4-41de-99e1-a81b7fbe7281 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:56.753089 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2779f-1df4-41de-99e1-a81b7fbe7281 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:56.753385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2779f-1df4-41de-99e1-a81b7fbe7281 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:56.754845 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2779f-1df4-41de-99e1-a81b7fbe7281 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:56.759209 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481312c-17d1-4aa0-ba63-e9e4a2e5d313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:56.759805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481312c-17d1-4aa0-ba63-e9e4a2e5d313 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:56.760081 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481312c-17d1-4aa0-ba63-e9e4a2e5d313 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:56.760349 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481312c-17d1-4aa0-ba63-e9e4a2e5d313 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:56.761003 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481312c-17d1-4aa0-ba63-e9e4a2e5d313 None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:56.761308 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481312c-17d1-4aa0-ba63-e9e4a2e5d313 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:56.762681 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481312c-17d1-4aa0-ba63-e9e4a2e5d313 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:56.766709 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 276/563] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:13:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:56.767500 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2779f-1df4-41de-99e1-a81b7fbe7281 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:56.774753 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 288/564] 10.222.0.94 () {56 vars in 1103 bytes} [Thu Sep 1 17:13:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:56.775630 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481312c-17d1-4aa0-ba63-e9e4a2e5d313 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:56.821534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:56.865643 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2779f-1df4-41de-99e1-a81b7fbe7281 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:56.873509 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481312c-17d1-4aa0-ba63-e9e4a2e5d313 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:56.894479 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:56.900662 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60072f-2dbd-45cf-b246-9690149f6eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:56.901285 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60072f-2dbd-45cf-b246-9690149f6eff None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:56.901586 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60072f-2dbd-45cf-b246-9690149f6eff None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:56.901861 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60072f-2dbd-45cf-b246-9690149f6eff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:56.906270 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535b44b-e45c-45fe-9564-916b8a327270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:56.906887 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535b44b-e45c-45fe-9564-916b8a327270 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:56.907166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535b44b-e45c-45fe-9564-916b8a327270 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:56.907436 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535b44b-e45c-45fe-9564-916b8a327270 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:56.911636 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60072f-2dbd-45cf-b246-9690149f6eff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:56.913068 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60072f-2dbd-45cf-b246-9690149f6eff None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:56.917163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535b44b-e45c-45fe-9564-916b8a327270 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:56.922956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-8535b44b-e45c-45fe-9564-916b8a327270 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:13:56.922956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:56.922956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:56.922956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:56.922956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:56.922956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:56.922956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:56.922956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:56.922956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:56.922956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:56.922956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:56.922956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:56.922956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:56.922956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:56.922956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:56.922956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:56.923904 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:56.923904 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:56.923904 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:56.923904 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:56.923904 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:56.923904 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:56.923904 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:56.923904 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:56.923904 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:56.923904 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:56.923904 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:56.923904 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:56.923904 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:56.923904 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:56.923904 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:56.923904 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:56.924779 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:56.924779 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:56.924779 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:56.924779 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:56.924779 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:56.924779 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:56.924779 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:56.924779 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:56.924779 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:56.924779 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:56.924779 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:13:56.924779 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:56.924779 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 289/565] 10.222.0.94 () {56 vars in 1102 bytes} [Thu Sep 1 17:13:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:56.925494 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725049c2-db51-4056-b486-020226b41766 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:56.925494 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725049c2-db51-4056-b486-020226b41766 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:56.925959 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725049c2-db51-4056-b486-020226b41766 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:56.927040 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 290/566] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:56.927796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-ad60072f-2dbd-45cf-b246-9690149f6eff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:56.927796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:56.927796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:56.927796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:56.927796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:56.927796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:56.927796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:56.927796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:56.927796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:56.927796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:56.927796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:56.927796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:56.927796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:13:56.927796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:13:56.927796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:13:56.927796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:13:56.928661 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:56.928661 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:56.928661 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:56.928661 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:56.928661 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:56.928661 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:56.928661 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:56.928661 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:56.928661 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:56.928661 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:56.928661 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:56.928661 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:56.928661 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:56.928661 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:56.928661 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:56.928661 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:56.928661 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:13:56.930912 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:13:56.930912 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:56.930912 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:56.930912 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 277/567] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:56.930912 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60072f-2dbd-45cf-b246-9690149f6eff None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:56.931503 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725049c2-db51-4056-b486-020226b41766 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:57.031952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60072f-2dbd-45cf-b246-9690149f6eff None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:57.032165 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725049c2-db51-4056-b486-020226b41766 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:57.039086 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:57.064777 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb071f9-a76b-48eb-985f-33ea76fb328c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:57.065408 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb071f9-a76b-48eb-985f-33ea76fb328c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:57.065705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb071f9-a76b-48eb-985f-33ea76fb328c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:57.065973 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb071f9-a76b-48eb-985f-33ea76fb328c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:57.066068 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a89faf-0f65-4af3-a9b3-c7a8fefd020d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:57.066563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a89faf-0f65-4af3-a9b3-c7a8fefd020d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:57.066839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a89faf-0f65-4af3-a9b3-c7a8fefd020d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:57.067105 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a89faf-0f65-4af3-a9b3-c7a8fefd020d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:57.067819 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a89faf-0f65-4af3-a9b3-c7a8fefd020d None admin] RBAC: Adding query filter params (role.id=e903cb11e2bf466fa1b3fae894847c3e, scope.project.id=c8f9428f37354c82ac52b6b8eccc424a, user.id=af7ebf43f36c4862a3c527941e033666) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:57.068119 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a89faf-0f65-4af3-a9b3-c7a8fefd020d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:57.069560 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a89faf-0f65-4af3-a9b3-c7a8fefd020d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:57.074730 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 291/568] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:13:56 2022] GET /identity/v3/role_assignments?user.id=af7ebf43f36c4862a3c527941e033666&scope.project.id=c8f9428f37354c82ac52b6b8eccc424a&role.id=e903cb11e2bf466fa1b3fae894847c3e => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:57.075512 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a89faf-0f65-4af3-a9b3-c7a8fefd020d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:57.076419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb071f9-a76b-48eb-985f-33ea76fb328c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:57.078175 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb071f9-a76b-48eb-985f-33ea76fb328c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:57.094000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-edb071f9-a76b-48eb-985f-33ea76fb328c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:57.094000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:57.094000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:57.094000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:57.094000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:57.094000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:57.094000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:57.094000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:57.094000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:57.094000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:57.094000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:57.094000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:57.094000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:13:57.094000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:13:57.094000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:13:57.094000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:13:57.095072 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:57.095072 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:57.095072 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:57.095072 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:57.095072 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:57.095072 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:57.095072 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:57.095072 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:57.095072 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:57.095072 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:57.095072 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:57.095072 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:57.095072 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:57.095072 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:57.095072 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:57.095072 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:57.095072 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:13:57.095978 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:13:57.095978 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:57.095978 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:57.095978 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 278/569] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:57.096679 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960727a-c695-4e9d-abc5-91f9bd9114ee None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:57.096679 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960727a-c695-4e9d-abc5-91f9bd9114ee None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:57.096946 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960727a-c695-4e9d-abc5-91f9bd9114ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:57.116259 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a960727a-c695-4e9d-abc5-91f9bd9114ee None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:57.117509 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a960727a-c695-4e9d-abc5-91f9bd9114ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:57.146763 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:57.193636 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a89faf-0f65-4af3-a9b3-c7a8fefd020d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:57.201448 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 279/570] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:57.201448 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960727a-c695-4e9d-abc5-91f9bd9114ee None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:57.240643 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ffeb7-452f-4f6a-8b97-bc7312fbb287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:57.241340 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ffeb7-452f-4f6a-8b97-bc7312fbb287 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:57.241726 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ffeb7-452f-4f6a-8b97-bc7312fbb287 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:57.242089 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ffeb7-452f-4f6a-8b97-bc7312fbb287 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:57.242822 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ffeb7-452f-4f6a-8b97-bc7312fbb287 None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:57.243192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ffeb7-452f-4f6a-8b97-bc7312fbb287 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:57.244738 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ffeb7-452f-4f6a-8b97-bc7312fbb287 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:57.258324 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 292/571] 10.222.0.94 () {56 vars in 1103 bytes} [Thu Sep 1 17:13:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:57.258324 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ffeb7-452f-4f6a-8b97-bc7312fbb287 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:57.290797 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:57.334669 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960727a-c695-4e9d-abc5-91f9bd9114ee None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:57.363239 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ffeb7-452f-4f6a-8b97-bc7312fbb287 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:57.389669 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e7caf-2b3b-4774-af42-92a736220b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:57.390865 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e7caf-2b3b-4774-af42-92a736220b2c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:57.391735 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e7caf-2b3b-4774-af42-92a736220b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:57.392208 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e7caf-2b3b-4774-af42-92a736220b2c None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:57.393283 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e7caf-2b3b-4774-af42-92a736220b2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:57.394104 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e7caf-2b3b-4774-af42-92a736220b2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:57.396427 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e7caf-2b3b-4774-af42-92a736220b2c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:57.399702 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95980000-4c4c-4d6f-9410-137a753e9d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:57.400398 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95980000-4c4c-4d6f-9410-137a753e9d73 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:57.400746 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95980000-4c4c-4d6f-9410-137a753e9d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:57.401087 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95980000-4c4c-4d6f-9410-137a753e9d73 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:57.401828 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95980000-4c4c-4d6f-9410-137a753e9d73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:57.402197 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95980000-4c4c-4d6f-9410-137a753e9d73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:57.404207 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95980000-4c4c-4d6f-9410-137a753e9d73 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:57.416997 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 280/572] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:57.416997 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e7caf-2b3b-4774-af42-92a736220b2c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:57.425515 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 293/573] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:57.426412 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95980000-4c4c-4d6f-9410-137a753e9d73 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:57.453603 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:57.526134 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:57.538114 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95980000-4c4c-4d6f-9410-137a753e9d73 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:57.540331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e7caf-2b3b-4774-af42-92a736220b2c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:57.574364 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91627c11-6b18-4f82-9b08-46af3a6475ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:57.575025 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91627c11-6b18-4f82-9b08-46af3a6475ea None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:57.575242 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68b7dc-2b5a-4838-8321-042fda024eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:57.576227 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91627c11-6b18-4f82-9b08-46af3a6475ea None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:57.576227 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91627c11-6b18-4f82-9b08-46af3a6475ea None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:57.576476 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68b7dc-2b5a-4838-8321-042fda024eef None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:57.576690 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68b7dc-2b5a-4838-8321-042fda024eef None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:57.576930 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68b7dc-2b5a-4838-8321-042fda024eef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:57.583652 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91627c11-6b18-4f82-9b08-46af3a6475ea None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:57.585112 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91627c11-6b18-4f82-9b08-46af3a6475ea None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:57.589217 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68b7dc-2b5a-4838-8321-042fda024eef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:57.590664 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68b7dc-2b5a-4838-8321-042fda024eef None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:57.597807 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-91627c11-6b18-4f82-9b08-46af3a6475ea None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 17:13:57.597807 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:57.597807 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:57.597807 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:57.597807 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:57.597807 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:57.597807 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:57.597807 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:57.597807 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:57.597807 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:57.597807 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:57.597807 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:57.597807 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:13:57.597807 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:13:57.597807 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:13:57.597807 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:13:57.598949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:57.598949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:57.598949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:13:57.598949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:13:57.598949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:13:57.598949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:13:57.598949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:57.598949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:57.598949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:57.598949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:57.598949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:57.598949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:57.598949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:57.598949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:57.598949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:57.598949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:57.598949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:57.598949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:57.600061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:57.600061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:57.600061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:13:57.600061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:13:57.600061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:13:57.600061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:13:57.600061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:13:57.600061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:13:57.600061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 17:13:57.600061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:57.600061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 294/574] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:57.604477 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91627c11-6b18-4f82-9b08-46af3a6475ea None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:57.609115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-ad68b7dc-2b5a-4838-8321-042fda024eef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:57.609115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:57.609115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:57.609115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:57.609115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:57.609115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:57.609115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:57.609115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:57.609115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:57.609115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:57.609115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:57.609115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:57.609115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:13:57.609115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:13:57.609115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:13:57.609115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:13:57.610091 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:57.610091 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:57.610091 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:57.610091 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:57.610091 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:57.610091 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:57.610091 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:57.610091 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:57.610091 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:57.610091 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:57.610091 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:57.610091 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:57.610091 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:57.610091 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:57.610091 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:57.610091 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:57.610091 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:13:57.610975 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:13:57.610975 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:57.610975 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:57.610975 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 281/575] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:57.611201 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68b7dc-2b5a-4838-8321-042fda024eef None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:57.691430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:57.716972 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68b7dc-2b5a-4838-8321-042fda024eef None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:57.717319 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91627c11-6b18-4f82-9b08-46af3a6475ea None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:57.753958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6025a-c9e9-4746-a212-051cf2d3f515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:57.754595 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6025a-c9e9-4746-a212-051cf2d3f515 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:57.754855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6025a-c9e9-4746-a212-051cf2d3f515 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:57.754957 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bf223-ede6-42bb-95e6-2c998427adcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:57.755152 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6025a-c9e9-4746-a212-051cf2d3f515 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:57.756142 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bf223-ede6-42bb-95e6-2c998427adcf None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:57.756651 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bf223-ede6-42bb-95e6-2c998427adcf None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:57.757123 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bf223-ede6-42bb-95e6-2c998427adcf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:57.763751 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6025a-c9e9-4746-a212-051cf2d3f515 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:57.765203 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6025a-c9e9-4746-a212-051cf2d3f515 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:57.769142 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569bf223-ede6-42bb-95e6-2c998427adcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:13:57.774671 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-569bf223-ede6-42bb-95e6-2c998427adcf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:13:57.774671 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:57.774671 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:57.774671 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:57.774671 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:57.774671 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:57.774671 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:57.774671 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:57.774671 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:57.774671 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:57.774671 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:57.774671 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:57.774671 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:13:57.774671 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:13:57.774671 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:13:57.774671 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:13:57.775711 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:13:57.775711 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:13:57.775711 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:13:57.775711 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:13:57.775711 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:57.775711 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:57.775711 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:57.775711 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:57.775711 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:57.775711 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:57.775711 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:57.775711 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:57.775711 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:57.775711 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:57.775711 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:57.775711 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:57.776755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:57.776755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:57.776755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:57.776755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:57.776755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:13:57.776755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:13:57.776755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:13:57.776755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:13:57.776755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:13:57.776755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:13:57.776755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:13:57.776755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:57.777551 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-0bc6025a-c9e9-4746-a212-051cf2d3f515 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 17:13:57.777551 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:57.777551 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:57.777551 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:57.777551 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:57.777551 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:57.777551 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:57.777551 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:57.777551 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:57.777551 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:57.777551 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:57.777551 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:57.777551 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:13:57.777551 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:13:57.777551 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:13:57.777551 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:13:57.778418 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:57.778418 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:57.778418 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:13:57.778418 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:13:57.778418 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:13:57.778418 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:13:57.778418 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:57.778418 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:57.778418 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:57.778418 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:57.778418 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:57.778418 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:57.778418 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:57.778418 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:57.778418 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:57.778418 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:57.778418 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:57.778418 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:57.779369 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:57.779369 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:57.779369 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:13:57.779369 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:13:57.779369 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:13:57.779369 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:13:57.779369 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:13:57.779369 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:13:57.779369 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 17:13:57.779369 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:57.779369 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 295/576] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:13:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:57.779369 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6025a-c9e9-4746-a212-051cf2d3f515 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:57.781196 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 282/577] 10.222.0.94 () {56 vars in 1102 bytes} [Thu Sep 1 17:13:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:57.782120 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bf223-ede6-42bb-95e6-2c998427adcf None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:57.800242 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:57.886377 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bf223-ede6-42bb-95e6-2c998427adcf None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:57.891237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6025a-c9e9-4746-a212-051cf2d3f515 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:57.921739 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886955d-884f-4f73-b8cb-9a97a06a0304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:57.922350 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886955d-884f-4f73-b8cb-9a97a06a0304 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:57.922627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886955d-884f-4f73-b8cb-9a97a06a0304 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:57.922900 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886955d-884f-4f73-b8cb-9a97a06a0304 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:57.923534 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886955d-884f-4f73-b8cb-9a97a06a0304 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:57.923943 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886955d-884f-4f73-b8cb-9a97a06a0304 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:57.925310 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886955d-884f-4f73-b8cb-9a97a06a0304 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:57.927333 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6a6ff-a9fd-41a8-a131-7ceef8a0dba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:57.927802 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:57.928381 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6a6ff-a9fd-41a8-a131-7ceef8a0dba3 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:57.928722 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6a6ff-a9fd-41a8-a131-7ceef8a0dba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:57.929020 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6a6ff-a9fd-41a8-a131-7ceef8a0dba3 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:57.929849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6a6ff-a9fd-41a8-a131-7ceef8a0dba3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:57.930164 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6a6ff-a9fd-41a8-a131-7ceef8a0dba3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:57.931592 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6a6ff-a9fd-41a8-a131-7ceef8a0dba3 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:57.943492 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 283/578] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:57.943492 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886955d-884f-4f73-b8cb-9a97a06a0304 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:57.951752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 296/579] 10.222.0.94 () {56 vars in 1137 bytes} [Thu Sep 1 17:13:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:57.956383 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6a6ff-a9fd-41a8-a131-7ceef8a0dba3 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:58.025108 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:58.060501 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6a6ff-a9fd-41a8-a131-7ceef8a0dba3 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:58.072112 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886955d-884f-4f73-b8cb-9a97a06a0304 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:58.100189 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318958b-07df-436f-a849-43e10876ec50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:58.101103 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318958b-07df-436f-a849-43e10876ec50 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:58.101563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318958b-07df-436f-a849-43e10876ec50 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:58.101988 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318958b-07df-436f-a849-43e10876ec50 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:58.102654 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318958b-07df-436f-a849-43e10876ec50 None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:58.102960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318958b-07df-436f-a849-43e10876ec50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:58.104339 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318958b-07df-436f-a849-43e10876ec50 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:58.108343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59857fa7-252f-4c57-9e49-92071639f17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:58.108959 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59857fa7-252f-4c57-9e49-92071639f17d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:58.109237 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59857fa7-252f-4c57-9e49-92071639f17d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:58.109542 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59857fa7-252f-4c57-9e49-92071639f17d None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:58.110266 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59857fa7-252f-4c57-9e49-92071639f17d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:58.110574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59857fa7-252f-4c57-9e49-92071639f17d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:58.112014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59857fa7-252f-4c57-9e49-92071639f17d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:58.118512 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 297/580] 10.222.0.94 () {56 vars in 1103 bytes} [Thu Sep 1 17:13:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:58.119556 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318958b-07df-436f-a849-43e10876ec50 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:58.130364 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 284/581] 10.222.0.94 () {56 vars in 1137 bytes} [Thu Sep 1 17:13:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:58.131176 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59857fa7-252f-4c57-9e49-92071639f17d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:58.197850 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:58.227066 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318958b-07df-436f-a849-43e10876ec50 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:58.246227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59857fa7-252f-4c57-9e49-92071639f17d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:58.257307 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:58.262830 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be366de3-f7cd-4015-b757-2e6060ae0129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:58.264048 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be366de3-f7cd-4015-b757-2e6060ae0129 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:58.264397 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be366de3-f7cd-4015-b757-2e6060ae0129 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:58.264738 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be366de3-f7cd-4015-b757-2e6060ae0129 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:58.272362 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be366de3-f7cd-4015-b757-2e6060ae0129 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:58.273857 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be366de3-f7cd-4015-b757-2e6060ae0129 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:58.284441 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebe9d9-b9e6-41e7-8cea-7ba3bf24a8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:58.285059 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebe9d9-b9e6-41e7-8cea-7ba3bf24a8ce None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:58.285331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebe9d9-b9e6-41e7-8cea-7ba3bf24a8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:58.285465 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-be366de3-f7cd-4015-b757-2e6060ae0129 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:13:58.285465 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:58.285465 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:58.285465 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:58.285465 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:58.285465 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:58.285465 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:58.285465 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:58.285465 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:58.285465 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:58.285465 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:58.285465 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:58.285465 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:13:58.285465 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:13:58.285465 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:13:58.285465 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:13:58.286345 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:58.286345 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:58.286345 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:13:58.286345 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:13:58.286345 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:13:58.286345 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:13:58.286345 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:58.286345 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:58.286345 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:58.286345 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:58.286345 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:58.286345 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:58.286345 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:58.286345 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:58.286345 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:58.286345 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:58.286345 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:58.286345 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:58.287309 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:58.287309 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:58.287309 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:13:58.287309 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:13:58.287309 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:13:58.287309 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:13:58.287309 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:13:58.287309 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:13:58.287309 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:13:58.287309 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:58.288487 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebe9d9-b9e6-41e7-8cea-7ba3bf24a8ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:58.291216 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 298/582] 10.222.0.94 () {56 vars in 1093 bytes} [Thu Sep 1 17:13:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:58.291794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be366de3-f7cd-4015-b757-2e6060ae0129 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:58.298082 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ebe9d9-b9e6-41e7-8cea-7ba3bf24a8ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:58.299562 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ebe9d9-b9e6-41e7-8cea-7ba3bf24a8ce None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:58.314391 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-97ebe9d9-b9e6-41e7-8cea-7ba3bf24a8ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:58.314391 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:58.314391 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:58.314391 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:58.314391 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:58.314391 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:58.314391 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:58.314391 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:58.314391 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:58.314391 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:58.314391 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:58.314391 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:58.314391 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:13:58.314391 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:13:58.314391 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:13:58.314391 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:13:58.315343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:58.315343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:58.315343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:58.315343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:58.315343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:58.315343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:58.315343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:58.315343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:58.315343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:58.315343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:58.315343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:58.315343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:58.315343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:58.315343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:58.315343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:58.315343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:58.315343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:13:58.316295 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:13:58.316295 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:58.316295 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:58.316295 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 285/583] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:58.316295 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebe9d9-b9e6-41e7-8cea-7ba3bf24a8ce None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:58.405311 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be366de3-f7cd-4015-b757-2e6060ae0129 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:58.421816 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebe9d9-b9e6-41e7-8cea-7ba3bf24a8ce None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:58.429204 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:58.442262 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d1a2d-0886-4478-97f7-82c3fd87f647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:58.442895 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d1a2d-0886-4478-97f7-82c3fd87f647 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:58.443173 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d1a2d-0886-4478-97f7-82c3fd87f647 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:58.443443 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d1a2d-0886-4478-97f7-82c3fd87f647 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:58.454403 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d1a2d-0886-4478-97f7-82c3fd87f647 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:58.455815 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d1a2d-0886-4478-97f7-82c3fd87f647 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:58.461474 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9b8a1-63ea-4b19-b113-3b4d68454eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:58.462272 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9b8a1-63ea-4b19-b113-3b4d68454eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:58.463087 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9b8a1-63ea-4b19-b113-3b4d68454eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:58.463508 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9b8a1-63ea-4b19-b113-3b4d68454eb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:58.470820 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-dd2d1a2d-0886-4478-97f7-82c3fd87f647 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:58.470820 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:58.470820 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:58.470820 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:58.470820 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:58.470820 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:58.470820 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:58.470820 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:58.470820 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:58.470820 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:58.470820 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:58.470820 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:58.470820 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:13:58.470820 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:13:58.470820 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:13:58.470820 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:13:58.471990 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:58.471990 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:58.471990 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:58.471990 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:58.471990 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:58.471990 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:58.471990 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:58.471990 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:58.471990 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:58.471990 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:58.471990 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:58.471990 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:58.471990 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:58.471990 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:58.471990 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:58.471990 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:58.471990 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:13:58.472896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:13:58.472896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:58.472896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:58.472896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 299/584] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:58.473229 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d1a2d-0886-4478-97f7-82c3fd87f647 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:58.480759 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9b8a1-63ea-4b19-b113-3b4d68454eb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:58.482969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9b8a1-63ea-4b19-b113-3b4d68454eb4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:58.503010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-a5d9b8a1-63ea-4b19-b113-3b4d68454eb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:58.503010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:58.503010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:58.503010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:58.503010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:58.503010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:58.503010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:58.503010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:58.503010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:58.503010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:58.503010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:58.503010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:58.503010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:13:58.503010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:13:58.503010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:13:58.503010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:13:58.504023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:58.504023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:58.504023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:58.504023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:58.504023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:58.504023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:58.504023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:58.504023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:58.504023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:58.504023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:58.504023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:58.504023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:58.504023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:58.504023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:58.504023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:58.504023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:58.504023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:13:58.505649 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:13:58.505649 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:58.505649 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:58.505649 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 286/585] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:58.505649 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9b8a1-63ea-4b19-b113-3b4d68454eb4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:58.542400 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:58.598903 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d1a2d-0886-4478-97f7-82c3fd87f647 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:58.616036 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9b8a1-63ea-4b19-b113-3b4d68454eb4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:58.633229 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c76ba5-9e1a-480e-959e-1e6b77316022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:58.633878 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c76ba5-9e1a-480e-959e-1e6b77316022 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:58.634159 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c76ba5-9e1a-480e-959e-1e6b77316022 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:58.634472 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c76ba5-9e1a-480e-959e-1e6b77316022 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:58.635181 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c76ba5-9e1a-480e-959e-1e6b77316022 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:58.635484 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c76ba5-9e1a-480e-959e-1e6b77316022 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:58.636924 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c76ba5-9e1a-480e-959e-1e6b77316022 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:58.658888 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 300/586] 10.222.0.94 () {56 vars in 1133 bytes} [Thu Sep 1 17:13:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:58.658888 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c76ba5-9e1a-480e-959e-1e6b77316022 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:58.660159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba318bca-7d1f-4726-8325-1b6f1ad082a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:58.660774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba318bca-7d1f-4726-8325-1b6f1ad082a0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:58.661052 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba318bca-7d1f-4726-8325-1b6f1ad082a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:58.661324 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba318bca-7d1f-4726-8325-1b6f1ad082a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:58.662192 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba318bca-7d1f-4726-8325-1b6f1ad082a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:58.663278 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba318bca-7d1f-4726-8325-1b6f1ad082a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:58.664670 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba318bca-7d1f-4726-8325-1b6f1ad082a0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:58.677781 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 287/587] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:58.678624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba318bca-7d1f-4726-8325-1b6f1ad082a0 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:58.699436 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:58.772160 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c76ba5-9e1a-480e-959e-1e6b77316022 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:58.774403 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:58.781274 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba318bca-7d1f-4726-8325-1b6f1ad082a0 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:58.810406 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15f507-74b7-4816-a234-72ecf7ca0505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:58.811387 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15f507-74b7-4816-a234-72ecf7ca0505 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:58.811863 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15f507-74b7-4816-a234-72ecf7ca0505 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:58.812319 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15f507-74b7-4816-a234-72ecf7ca0505 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:58.813319 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe15f507-74b7-4816-a234-72ecf7ca0505 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:58.813927 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe15f507-74b7-4816-a234-72ecf7ca0505 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:58.815582 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe15f507-74b7-4816-a234-72ecf7ca0505 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:58.815740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fdb0c-45c6-4a38-987f-74a279e7bffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:58.816324 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fdb0c-45c6-4a38-987f-74a279e7bffb None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:58.816601 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fdb0c-45c6-4a38-987f-74a279e7bffb None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:58.816877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fdb0c-45c6-4a38-987f-74a279e7bffb None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:58.817546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fdb0c-45c6-4a38-987f-74a279e7bffb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:58.817849 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fdb0c-45c6-4a38-987f-74a279e7bffb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:58.819189 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fdb0c-45c6-4a38-987f-74a279e7bffb None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:58.830166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 301/588] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:58.831268 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15f507-74b7-4816-a234-72ecf7ca0505 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:58.835092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 288/589] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:58.835845 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fdb0c-45c6-4a38-987f-74a279e7bffb None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:58.929319 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:58.939846 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15f507-74b7-4816-a234-72ecf7ca0505 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:58.954349 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fdb0c-45c6-4a38-987f-74a279e7bffb None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:58.974535 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3316972-0b4f-42b8-9104-edae783ef653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:58.975168 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3316972-0b4f-42b8-9104-edae783ef653 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:58.975450 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3316972-0b4f-42b8-9104-edae783ef653 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:58.975722 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3316972-0b4f-42b8-9104-edae783ef653 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:58.986937 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3316972-0b4f-42b8-9104-edae783ef653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:58.988382 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3316972-0b4f-42b8-9104-edae783ef653 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:58.993182 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4be6cf-3c72-47d6-92a9-939f27cbe38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:58.993838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4be6cf-3c72-47d6-92a9-939f27cbe38a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:58.994119 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4be6cf-3c72-47d6-92a9-939f27cbe38a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:58.994391 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4be6cf-3c72-47d6-92a9-939f27cbe38a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:59.001281 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4be6cf-3c72-47d6-92a9-939f27cbe38a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:59.002705 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-d3316972-0b4f-42b8-9104-edae783ef653 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:59.002705 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:59.002705 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:59.002705 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:59.002705 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:59.002705 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:59.002705 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:59.002705 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:59.002705 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:59.002705 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:59.002705 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:59.002705 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:59.002705 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:13:59.002705 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:13:59.002705 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:13:59.002705 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:13:59.003799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:59.003799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:59.003799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:59.003799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:59.003799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:59.003799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:59.003799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:59.003799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:59.003799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:59.003799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:59.003799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:59.003799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:59.003799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:59.003799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:59.003799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:59.003799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:59.003799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:13:59.004691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:13:59.004691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:59.004691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:59.004892 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4be6cf-3c72-47d6-92a9-939f27cbe38a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:59.004964 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 302/590] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:59.004964 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3316972-0b4f-42b8-9104-edae783ef653 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:59.016204 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-7b4be6cf-3c72-47d6-92a9-939f27cbe38a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:13:59.016204 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:59.016204 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:59.016204 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:59.016204 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:59.016204 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:59.016204 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:59.016204 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:59.016204 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:59.016204 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:59.016204 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:59.016204 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:59.016204 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:13:59.016204 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:13:59.016204 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:13:59.017128 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:13:59.017128 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:59.017128 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:59.017128 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:59.017128 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:59.017128 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:59.017128 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:59.017128 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:59.017128 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:59.017128 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:59.017128 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:59.017128 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:59.017128 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:59.017128 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:59.017128 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:59.017128 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:59.017128 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:59.018139 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:13:59.018139 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:13:59.018139 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:13:59.018139 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:13:59.018139 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:13:59.018139 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:13:59.018139 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:13:59.018139 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:59.018139 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 289/591] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:13:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:59.018139 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4be6cf-3c72-47d6-92a9-939f27cbe38a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:59.021593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:59.104436 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3316972-0b4f-42b8-9104-edae783ef653 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:59.116842 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4be6cf-3c72-47d6-92a9-939f27cbe38a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:59.139359 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fac6f-3021-4bef-b31f-34b7fd661f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:59.139995 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fac6f-3021-4bef-b31f-34b7fd661f47 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:59.140280 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fac6f-3021-4bef-b31f-34b7fd661f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:59.140558 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fac6f-3021-4bef-b31f-34b7fd661f47 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:59.148047 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fac6f-3021-4bef-b31f-34b7fd661f47 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:59.149573 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fac6f-3021-4bef-b31f-34b7fd661f47 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:59.151430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a463d11-c34d-4e4f-ad2c-2cd9708e439a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:59.152044 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a463d11-c34d-4e4f-ad2c-2cd9708e439a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:59.152312 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a463d11-c34d-4e4f-ad2c-2cd9708e439a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:59.152572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a463d11-c34d-4e4f-ad2c-2cd9708e439a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:59.159051 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a463d11-c34d-4e4f-ad2c-2cd9708e439a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:59.160458 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a463d11-c34d-4e4f-ad2c-2cd9708e439a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:59.160691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-aa7fac6f-3021-4bef-b31f-34b7fd661f47 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 17:13:59.160691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:59.160691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:59.160691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:59.160691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:59.160691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:59.160691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:59.160691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:59.160691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:59.160691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:59.160691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:59.160691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:59.160691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:13:59.160691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:13:59.160691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:13:59.160691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:13:59.161655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:59.161655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:59.161655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:13:59.161655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:13:59.161655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:13:59.161655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:13:59.161655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:59.161655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:59.161655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:59.161655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:59.161655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:59.161655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:59.161655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:59.161655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:59.161655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:59.161655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:59.161655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:59.161655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:59.162614 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:59.162614 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:59.162614 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:13:59.162614 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:13:59.162614 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:13:59.162614 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:13:59.162614 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:13:59.162614 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:13:59.162614 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 17:13:59.162614 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:59.162614 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 303/592] 10.222.0.94 () {56 vars in 1102 bytes} [Thu Sep 1 17:13:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:59.163802 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8eb685-1508-44e0-bd13-3a5ba7d96d76 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:59.163802 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8eb685-1508-44e0-bd13-3a5ba7d96d76 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:59.163802 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8eb685-1508-44e0-bd13-3a5ba7d96d76 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:59.164830 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 304/593] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:13:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:13:59.165331 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8eb685-1508-44e0-bd13-3a5ba7d96d76 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:59.166771 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:59.178214 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-7a463d11-c34d-4e4f-ad2c-2cd9708e439a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:13:59.178214 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:59.178214 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:59.178214 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:59.178214 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:59.178214 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:59.178214 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:59.178214 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:59.178214 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:59.178214 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:59.178214 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:59.178214 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:59.178214 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:13:59.178214 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:13:59.178214 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:13:59.179202 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:13:59.179202 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:59.179202 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:59.179202 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:59.179202 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:59.179202 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:59.179202 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:59.179202 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:59.179202 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:59.179202 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:59.179202 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:59.179202 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:59.179202 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:59.179202 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:59.179202 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:59.179202 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:59.179202 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:59.180611 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:13:59.180611 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:13:59.180611 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:13:59.180611 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:13:59.180611 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:13:59.180611 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:13:59.180611 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:13:59.180611 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:13:59.180611 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 290/594] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:13:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:59.180611 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a463d11-c34d-4e4f-ad2c-2cd9708e439a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:59.245082 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:59.272955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8eb685-1508-44e0-bd13-3a5ba7d96d76 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:59.278497 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a463d11-c34d-4e4f-ad2c-2cd9708e439a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:59.306610 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7653fe7-9ed6-46d4-b508-69943514c112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:59.307208 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7653fe7-9ed6-46d4-b508-69943514c112 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:59.307494 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7653fe7-9ed6-46d4-b508-69943514c112 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:59.307765 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7653fe7-9ed6-46d4-b508-69943514c112 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:59.308399 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7653fe7-9ed6-46d4-b508-69943514c112 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:59.308702 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7653fe7-9ed6-46d4-b508-69943514c112 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:59.310122 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7653fe7-9ed6-46d4-b508-69943514c112 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:59.311721 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18412c41-d488-4337-99ec-e1c041a48fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:59.312317 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18412c41-d488-4337-99ec-e1c041a48fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:59.312595 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18412c41-d488-4337-99ec-e1c041a48fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:59.312864 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18412c41-d488-4337-99ec-e1c041a48fc1 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:59.313580 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18412c41-d488-4337-99ec-e1c041a48fc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:59.313884 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18412c41-d488-4337-99ec-e1c041a48fc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:59.315283 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18412c41-d488-4337-99ec-e1c041a48fc1 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:59.321494 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 305/595] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:59.322285 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7653fe7-9ed6-46d4-b508-69943514c112 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:59.331415 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 291/596] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:13:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:59.332603 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a49c37-eec9-418e-8d95-38c4770fed23 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:59.332886 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a49c37-eec9-418e-8d95-38c4770fed23 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:59.333158 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a49c37-eec9-418e-8d95-38c4770fed23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:59.350488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e2a49c37-eec9-418e-8d95-38c4770fed23 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:13:59.351663 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e2a49c37-eec9-418e-8d95-38c4770fed23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:13:59.403483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:59.417568 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 292/597] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:13:59.418367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a49c37-eec9-418e-8d95-38c4770fed23 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:59.423932 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7653fe7-9ed6-46d4-b508-69943514c112 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:59.462514 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b4d64-6e31-4b55-97d2-4eff0fa578e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:59.463120 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b4d64-6e31-4b55-97d2-4eff0fa578e0 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:59.463398 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b4d64-6e31-4b55-97d2-4eff0fa578e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:59.463670 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b4d64-6e31-4b55-97d2-4eff0fa578e0 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:59.464391 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b4d64-6e31-4b55-97d2-4eff0fa578e0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:59.464695 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b4d64-6e31-4b55-97d2-4eff0fa578e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:59.466268 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b4d64-6e31-4b55-97d2-4eff0fa578e0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:59.468030 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:59.489223 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 306/598] 10.222.0.94 () {56 vars in 1139 bytes} [Thu Sep 1 17:13:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:59.490113 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b4d64-6e31-4b55-97d2-4eff0fa578e0 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:59.520941 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a49c37-eec9-418e-8d95-38c4770fed23 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:59.560881 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf72820-b047-4374-a8e2-ad82c3f7bdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:59.561537 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf72820-b047-4374-a8e2-ad82c3f7bdb1 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:59.561815 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf72820-b047-4374-a8e2-ad82c3f7bdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:59.562081 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf72820-b047-4374-a8e2-ad82c3f7bdb1 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:59.562764 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf72820-b047-4374-a8e2-ad82c3f7bdb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:13:59.563064 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf72820-b047-4374-a8e2-ad82c3f7bdb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:59.564474 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf72820-b047-4374-a8e2-ad82c3f7bdb1 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:59.576096 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 293/599] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:13:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:13:59.576867 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf72820-b047-4374-a8e2-ad82c3f7bdb1 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:59.607789 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b4d64-6e31-4b55-97d2-4eff0fa578e0 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:59.635306 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:59.645675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec7515-39f5-48b2-ba10-9006e4908f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:59.646304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec7515-39f5-48b2-ba10-9006e4908f2f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:59.646576 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec7515-39f5-48b2-ba10-9006e4908f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:59.646848 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec7515-39f5-48b2-ba10-9006e4908f2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:59.653919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec7515-39f5-48b2-ba10-9006e4908f2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:59.655293 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec7515-39f5-48b2-ba10-9006e4908f2f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:59.666531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-5dec7515-39f5-48b2-ba10-9006e4908f2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:13:59.666531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:59.666531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:59.666531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:59.666531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:59.666531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:59.666531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:59.666531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:59.666531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:59.666531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:59.666531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:59.666531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:59.666531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:13:59.666531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:13:59.666531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:13:59.667426 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:13:59.667426 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:59.667426 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:59.667426 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:59.667426 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:59.667426 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:59.667426 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:59.667426 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:59.667426 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:59.667426 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:59.667426 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:59.667426 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:59.667426 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:59.667426 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:59.667426 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:59.667426 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:59.667426 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:59.668313 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:13:59.668313 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:13:59.668313 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:13:59.668313 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:13:59.668313 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:13:59.668313 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:13:59.668313 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:13:59.668313 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:59.668313 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 307/600] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:13:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:59.669842 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec7515-39f5-48b2-ba10-9006e4908f2f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:59.695001 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf72820-b047-4374-a8e2-ad82c3f7bdb1 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:59.723072 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:59.729316 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41024548-03c3-429c-b7af-f6e662dc3f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:59.729989 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41024548-03c3-429c-b7af-f6e662dc3f15 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:59.730263 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41024548-03c3-429c-b7af-f6e662dc3f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:59.730528 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41024548-03c3-429c-b7af-f6e662dc3f15 None admin] PATH_INFO: `/v3/projects/c8f9428f37354c82ac52b6b8eccc424a/users/eee371754d7d43b4987084db58f44957/roles/e903cb11e2bf466fa1b3fae894847c3e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:59.744936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41024548-03c3-429c-b7af-f6e662dc3f15 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8f9428f37354c82ac52b6b8eccc424a, user_id=eee371754d7d43b4987084db58f44957, role_id=e903cb11e2bf466fa1b3fae894847c3e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:59.746389 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41024548-03c3-429c-b7af-f6e662dc3f15 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:59.762414 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 294/601] 10.222.0.94 () {58 vars in 1439 bytes} [Thu Sep 1 17:13:59 2022] PUT /identity/v3/projects/c8f9428f37354c82ac52b6b8eccc424a/users/eee371754d7d43b4987084db58f44957/roles/e903cb11e2bf466fa1b3fae894847c3e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:13:59.763221 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41024548-03c3-429c-b7af-f6e662dc3f15 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:59.771476 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec7515-39f5-48b2-ba10-9006e4908f2f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:59.809228 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32dd393-1eef-43e5-a1c8-21da15b10105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:59.810737 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dd393-1eef-43e5-a1c8-21da15b10105 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:59.810829 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dd393-1eef-43e5-a1c8-21da15b10105 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:59.811032 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dd393-1eef-43e5-a1c8-21da15b10105 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:59.822725 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32dd393-1eef-43e5-a1c8-21da15b10105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:59.824220 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32dd393-1eef-43e5-a1c8-21da15b10105 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:59.840205 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-b32dd393-1eef-43e5-a1c8-21da15b10105 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:59.840205 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:13:59.840205 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:13:59.840205 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:13:59.840205 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:13:59.840205 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:13:59.840205 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:13:59.840205 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:13:59.840205 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:13:59.840205 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:13:59.840205 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:13:59.840205 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:13:59.840205 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:13:59.840205 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:13:59.840205 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:13:59.840205 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:13:59.841531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:13:59.841531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:13:59.841531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:13:59.841531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:13:59.841531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:13:59.841531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:13:59.841531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:13:59.841531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:13:59.841531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:13:59.841531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:13:59.841531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:13:59.841531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:13:59.841531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:13:59.841531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:13:59.841531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:13:59.841531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:13:59.841531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:13:59.842666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:13:59.842666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:13:59.842666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:13:59.842666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 308/602] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:13:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:13:59.842666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32dd393-1eef-43e5-a1c8-21da15b10105 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:13:59.898497 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:59.904947 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41024548-03c3-429c-b7af-f6e662dc3f15 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:59.943967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa40ef-ac82-41a4-9950-0dab69d0c426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:13:59.944743 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa40ef-ac82-41a4-9950-0dab69d0c426 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:13:59.945021 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa40ef-ac82-41a4-9950-0dab69d0c426 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:13:59.945340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa40ef-ac82-41a4-9950-0dab69d0c426 None admin] PATH_INFO: `/v3/projects/c8f9428f37354c82ac52b6b8eccc424a/users/74c6647f3aa54dc68e888b3adb8c28b5/roles/e903cb11e2bf466fa1b3fae894847c3e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:13:59.956631 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32dd393-1eef-43e5-a1c8-21da15b10105 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:13:59.958946 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:13:59.962953 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa40ef-ac82-41a4-9950-0dab69d0c426 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8f9428f37354c82ac52b6b8eccc424a, user_id=74c6647f3aa54dc68e888b3adb8c28b5, role_id=e903cb11e2bf466fa1b3fae894847c3e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:13:59.964677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa40ef-ac82-41a4-9950-0dab69d0c426 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:13:59.985450 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 295/603] 10.222.0.94 () {58 vars in 1439 bytes} [Thu Sep 1 17:13:59 2022] PUT /identity/v3/projects/c8f9428f37354c82ac52b6b8eccc424a/users/74c6647f3aa54dc68e888b3adb8c28b5/roles/e903cb11e2bf466fa1b3fae894847c3e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:13:59.985450 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa40ef-ac82-41a4-9950-0dab69d0c426 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:00.006339 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6953d6c-d58f-41b5-bb86-ea2a1146a80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:00.007068 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6953d6c-d58f-41b5-bb86-ea2a1146a80e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:00.007412 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6953d6c-d58f-41b5-bb86-ea2a1146a80e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:00.007690 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6953d6c-d58f-41b5-bb86-ea2a1146a80e None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:00.008397 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6953d6c-d58f-41b5-bb86-ea2a1146a80e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:00.008690 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6953d6c-d58f-41b5-bb86-ea2a1146a80e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:00.010239 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6953d6c-d58f-41b5-bb86-ea2a1146a80e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:00.024205 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 309/604] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:13:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:00.025081 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6953d6c-d58f-41b5-bb86-ea2a1146a80e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:00.145901 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa40ef-ac82-41a4-9950-0dab69d0c426 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:00.181498 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6953d6c-d58f-41b5-bb86-ea2a1146a80e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:00.195250 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbcdb9-0b19-41a2-a7a3-de8575bad791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:00.196206 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbcdb9-0b19-41a2-a7a3-de8575bad791 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:00.196681 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbcdb9-0b19-41a2-a7a3-de8575bad791 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:00.197126 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbcdb9-0b19-41a2-a7a3-de8575bad791 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:00.209600 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbcdb9-0b19-41a2-a7a3-de8575bad791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:14:00.214838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-94fbcdb9-0b19-41a2-a7a3-de8575bad791 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:14:00.214838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:00.214838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:00.214838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:00.214838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:00.214838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:00.214838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:00.214838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:00.214838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:00.214838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:00.214838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:00.214838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:00.214838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:14:00.214838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:14:00.214838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:14:00.214838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:14:00.215780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:14:00.215780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:14:00.215780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:14:00.215780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:14:00.215780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:00.215780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:00.215780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:00.215780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:00.215780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:00.215780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:00.215780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:00.215780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:00.215780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:00.215780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:00.215780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:00.215780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:00.216694 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:00.216694 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:00.216694 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:00.216694 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:00.216694 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:14:00.216694 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:14:00.216694 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:14:00.216694 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:14:00.216694 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:14:00.216694 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:14:00.216694 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:14:00.216694 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:00.219517 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 296/605] 10.222.0.94 () {56 vars in 1102 bytes} [Thu Sep 1 17:13:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:00.220556 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbcdb9-0b19-41a2-a7a3-de8575bad791 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:00.227221 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8422ca-3f86-4434-8ccd-46ed3ef47a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:00.227927 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8422ca-3f86-4434-8ccd-46ed3ef47a8a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:00.228276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8422ca-3f86-4434-8ccd-46ed3ef47a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:00.228641 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8422ca-3f86-4434-8ccd-46ed3ef47a8a None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:00.229372 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8422ca-3f86-4434-8ccd-46ed3ef47a8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:00.229774 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8422ca-3f86-4434-8ccd-46ed3ef47a8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:00.231237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8422ca-3f86-4434-8ccd-46ed3ef47a8a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:00.235358 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:00.250290 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 310/606] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:00.254239 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8422ca-3f86-4434-8ccd-46ed3ef47a8a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:00.288907 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:00.343588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbcdb9-0b19-41a2-a7a3-de8575bad791 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:00.371445 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8422ca-3f86-4434-8ccd-46ed3ef47a8a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:00.391353 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd4467-7eb8-431f-8aab-2e2020f2bd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:00.392921 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd4467-7eb8-431f-8aab-2e2020f2bd99 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:00.393385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd4467-7eb8-431f-8aab-2e2020f2bd99 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:00.393862 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd4467-7eb8-431f-8aab-2e2020f2bd99 None admin] PATH_INFO: `/v3/projects/c8f9428f37354c82ac52b6b8eccc424a/users/8b7fa3c4c5d94b3c9b7f17dde35d39a0/roles/e903cb11e2bf466fa1b3fae894847c3e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:00.407724 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314ba40-c213-49d3-83ef-5f9c423b44b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:00.408421 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314ba40-c213-49d3-83ef-5f9c423b44b0 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:00.408780 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314ba40-c213-49d3-83ef-5f9c423b44b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:00.409061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314ba40-c213-49d3-83ef-5f9c423b44b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:00.410006 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314ba40-c213-49d3-83ef-5f9c423b44b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:00.410374 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314ba40-c213-49d3-83ef-5f9c423b44b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:00.411869 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314ba40-c213-49d3-83ef-5f9c423b44b0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:00.415921 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd4467-7eb8-431f-8aab-2e2020f2bd99 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8f9428f37354c82ac52b6b8eccc424a, user_id=8b7fa3c4c5d94b3c9b7f17dde35d39a0, role_id=e903cb11e2bf466fa1b3fae894847c3e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:00.417808 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd4467-7eb8-431f-8aab-2e2020f2bd99 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:00.424909 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 311/607] 10.222.0.94 () {56 vars in 1103 bytes} [Thu Sep 1 17:14:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:00.426433 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314ba40-c213-49d3-83ef-5f9c423b44b0 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:00.435512 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 297/608] 10.222.0.94 () {58 vars in 1439 bytes} [Thu Sep 1 17:14:00 2022] PUT /identity/v3/projects/c8f9428f37354c82ac52b6b8eccc424a/users/8b7fa3c4c5d94b3c9b7f17dde35d39a0/roles/e903cb11e2bf466fa1b3fae894847c3e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:14:00.442605 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd4467-7eb8-431f-8aab-2e2020f2bd99 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:00.507324 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:00.579512 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:00.593224 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd4467-7eb8-431f-8aab-2e2020f2bd99 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:00.606106 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314ba40-c213-49d3-83ef-5f9c423b44b0 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:00.663009 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3f7ac-aefc-4c20-bec8-0c38f820cccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:00.665559 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3f7ac-aefc-4c20-bec8-0c38f820cccc None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:00.666724 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3f7ac-aefc-4c20-bec8-0c38f820cccc None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:00.667174 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3f7ac-aefc-4c20-bec8-0c38f820cccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:00.681987 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4addaf-b4e9-4a38-8941-69291cdfcd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:00.682997 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4addaf-b4e9-4a38-8941-69291cdfcd7c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:00.683292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4addaf-b4e9-4a38-8941-69291cdfcd7c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:00.683810 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4addaf-b4e9-4a38-8941-69291cdfcd7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:00.684405 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3f7ac-aefc-4c20-bec8-0c38f820cccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:00.686813 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3f7ac-aefc-4c20-bec8-0c38f820cccc None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:00.693012 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4addaf-b4e9-4a38-8941-69291cdfcd7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:00.695169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4addaf-b4e9-4a38-8941-69291cdfcd7c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:00.703803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-a1d3f7ac-aefc-4c20-bec8-0c38f820cccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:00.703803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:00.703803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:00.703803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:00.703803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:00.703803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:00.703803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:00.703803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:00.703803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:00.703803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:00.703803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:00.703803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:00.703803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:00.703803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:00.703803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:00.703803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:00.704795 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:00.704795 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:00.704795 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:00.704795 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:00.704795 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:00.704795 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:00.704795 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:00.704795 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:00.704795 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:00.704795 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:00.704795 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:00.704795 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:00.704795 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:00.704795 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:00.704795 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:00.704795 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:00.704795 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:00.705863 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:00.705863 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:00.705863 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:00.707647 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 298/609] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:00.711204 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-6d4addaf-b4e9-4a38-8941-69291cdfcd7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:00.711204 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:00.711204 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:00.711204 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:00.711204 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:00.711204 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:00.711204 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:00.711204 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:00.711204 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:00.711204 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:00.711204 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:00.711204 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:00.711204 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:14:00.711204 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:14:00.711204 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:14:00.712283 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:14:00.712283 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:00.712283 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:00.712283 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:00.712283 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:00.712283 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:00.712283 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:00.712283 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:00.712283 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:00.712283 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:00.712283 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:00.712283 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:00.712283 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:00.712283 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:00.712283 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:00.712283 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:00.712283 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:00.713168 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:14:00.713168 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:14:00.713168 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:14:00.713168 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:14:00.713168 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:14:00.713168 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:14:00.713168 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:00.713168 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:00.714865 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3f7ac-aefc-4c20-bec8-0c38f820cccc None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:00.717204 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 312/610] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:14:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:00.726748 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4addaf-b4e9-4a38-8941-69291cdfcd7c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:00.849122 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4addaf-b4e9-4a38-8941-69291cdfcd7c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:00.884599 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3f7ac-aefc-4c20-bec8-0c38f820cccc None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:00.891847 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6ff10-614b-4748-902f-4d7d83e35f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:00.892475 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6ff10-614b-4748-902f-4d7d83e35f0c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:00.892756 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6ff10-614b-4748-902f-4d7d83e35f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:00.893027 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6ff10-614b-4748-902f-4d7d83e35f0c None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:00.898585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6ff10-614b-4748-902f-4d7d83e35f0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:00.898904 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6ff10-614b-4748-902f-4d7d83e35f0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:00.900432 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6ff10-614b-4748-902f-4d7d83e35f0c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:00.907507 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:00.919145 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 313/611] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:14:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:00.924891 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6ff10-614b-4748-902f-4d7d83e35f0c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:00.945855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:00.998486 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90681610-bc85-45a1-9031-f37283f05f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:00.999112 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90681610-bc85-45a1-9031-f37283f05f5d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:00.999391 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90681610-bc85-45a1-9031-f37283f05f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:00.999659 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90681610-bc85-45a1-9031-f37283f05f5d None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:01.000311 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90681610-bc85-45a1-9031-f37283f05f5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:01.000611 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90681610-bc85-45a1-9031-f37283f05f5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:01.003732 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90681610-bc85-45a1-9031-f37283f05f5d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:01.039763 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 299/612] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:01.041752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6ff10-614b-4748-902f-4d7d83e35f0c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:01.046617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90681610-bc85-45a1-9031-f37283f05f5d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:01.081633 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9992fa4-2899-4241-a2df-15a12e230a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:01.082329 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9992fa4-2899-4241-a2df-15a12e230a13 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:01.082615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9992fa4-2899-4241-a2df-15a12e230a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:01.082895 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9992fa4-2899-4241-a2df-15a12e230a13 None admin] PATH_INFO: `/v3/projects/c8f9428f37354c82ac52b6b8eccc424a/users/92edc2953b8e4e42aa64569335acfc9f/roles/e903cb11e2bf466fa1b3fae894847c3e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:01.098883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9992fa4-2899-4241-a2df-15a12e230a13 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8f9428f37354c82ac52b6b8eccc424a, user_id=92edc2953b8e4e42aa64569335acfc9f, role_id=e903cb11e2bf466fa1b3fae894847c3e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:01.100517 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9992fa4-2899-4241-a2df-15a12e230a13 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:01.116574 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 314/613] 10.222.0.94 () {58 vars in 1439 bytes} [Thu Sep 1 17:14:00 2022] PUT /identity/v3/projects/c8f9428f37354c82ac52b6b8eccc424a/users/92edc2953b8e4e42aa64569335acfc9f/roles/e903cb11e2bf466fa1b3fae894847c3e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:14:01.267780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90681610-bc85-45a1-9031-f37283f05f5d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:01.311049 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bcc221-3e93-4639-a409-a7ed6f60a465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:01.312050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcc221-3e93-4639-a409-a7ed6f60a465 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:01.312536 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcc221-3e93-4639-a409-a7ed6f60a465 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:01.313036 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcc221-3e93-4639-a409-a7ed6f60a465 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:01.323069 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bcc221-3e93-4639-a409-a7ed6f60a465 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:01.324784 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bcc221-3e93-4639-a409-a7ed6f60a465 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:01.339021 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-a2bcc221-3e93-4639-a409-a7ed6f60a465 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 17:14:01.339021 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:01.339021 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:01.339021 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:01.339021 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:01.339021 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:01.339021 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:01.339021 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:01.339021 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:01.339021 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:01.339021 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:01.339021 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:01.339021 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:14:01.339021 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:14:01.339021 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:14:01.339021 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:14:01.340014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:01.340014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:01.340014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:14:01.340014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:01.340014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:14:01.340014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:01.340014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:01.340014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:01.340014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:01.340014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:01.340014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:01.340014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:01.340014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:01.340014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:01.340014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:01.340014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:01.340014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:01.340014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:01.340970 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:01.340970 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:01.340970 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:14:01.340970 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:14:01.340970 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:14:01.340970 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:14:01.340970 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:14:01.340970 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:14:01.340970 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 17:14:01.340970 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:01.340970 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 300/614] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:14:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:01.347692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9992fa4-2899-4241-a2df-15a12e230a13 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:01.423881 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:01.489502 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9992fa4-2899-4241-a2df-15a12e230a13 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:01.540909 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a97c1-0309-4812-b3d7-98b8a1e7a2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:01.541862 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a97c1-0309-4812-b3d7-98b8a1e7a2b3 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:01.542336 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a97c1-0309-4812-b3d7-98b8a1e7a2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:01.542798 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a97c1-0309-4812-b3d7-98b8a1e7a2b3 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:01.543741 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a97c1-0309-4812-b3d7-98b8a1e7a2b3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:01.544810 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a97c1-0309-4812-b3d7-98b8a1e7a2b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:01.546474 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a97c1-0309-4812-b3d7-98b8a1e7a2b3 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:01.570824 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 315/615] 10.222.0.94 () {56 vars in 1135 bytes} [Thu Sep 1 17:14:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:01.577168 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bcc221-3e93-4639-a409-a7ed6f60a465 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:01.636674 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:01.736639 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bcc221-3e93-4639-a409-a7ed6f60a465 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:01.788109 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823af50-2b6c-411a-b9ee-4675de2fc251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:01.788663 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823af50-2b6c-411a-b9ee-4675de2fc251 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:01.788937 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823af50-2b6c-411a-b9ee-4675de2fc251 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:01.789202 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823af50-2b6c-411a-b9ee-4675de2fc251 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:01.805133 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823af50-2b6c-411a-b9ee-4675de2fc251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:01.806659 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823af50-2b6c-411a-b9ee-4675de2fc251 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:01.819143 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437e502-1af4-44bb-b419-dd09411a96ed None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:01.819767 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437e502-1af4-44bb-b419-dd09411a96ed None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:01.820233 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437e502-1af4-44bb-b419-dd09411a96ed None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:01.821773 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 316/616] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:14:01.827459 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426ba5e-b849-4a96-a456-ba433935755d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:01.827979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426ba5e-b849-4a96-a456-ba433935755d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:01.828250 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426ba5e-b849-4a96-a456-ba433935755d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:01.829601 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-8823af50-2b6c-411a-b9ee-4675de2fc251 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:01.829601 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:01.829601 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:01.829601 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:01.829601 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:01.829601 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:01.829601 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:01.829601 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:01.829601 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:01.829601 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:01.829601 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:01.829601 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:01.829601 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:01.829601 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:01.829601 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:01.829601 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:01.830585 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:01.830585 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:01.830585 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:01.830585 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:01.830585 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:01.830585 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:01.830585 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:01.830585 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:01.830585 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:01.830585 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:01.830585 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:01.830585 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:01.830585 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:01.830585 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:01.830585 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:01.830585 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:01.830585 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:01.831467 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:01.831467 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:01.831467 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:01.836621 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 301/617] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:01.839278 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823af50-2b6c-411a-b9ee-4675de2fc251 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:01.870939 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3426ba5e-b849-4a96-a456-ba433935755d None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:01.872121 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3426ba5e-b849-4a96-a456-ba433935755d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:01.973265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:01.974832 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 317/618] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:14:01.995223 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823af50-2b6c-411a-b9ee-4675de2fc251 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:02.032522 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44153275-7c37-47d3-9105-1c6051cfcc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:02.033123 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44153275-7c37-47d3-9105-1c6051cfcc7b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:02.033416 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44153275-7c37-47d3-9105-1c6051cfcc7b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:02.033690 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44153275-7c37-47d3-9105-1c6051cfcc7b None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:02.034324 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44153275-7c37-47d3-9105-1c6051cfcc7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:02.034620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44153275-7c37-47d3-9105-1c6051cfcc7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:02.035968 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44153275-7c37-47d3-9105-1c6051cfcc7b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:02.048573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 302/619] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:02.054020 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426ba5e-b849-4a96-a456-ba433935755d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:02.110236 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:02.163496 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426ba5e-b849-4a96-a456-ba433935755d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:02.209746 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea957d7-79c1-4b7b-8fec-63fa0bb996f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:02.210433 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea957d7-79c1-4b7b-8fec-63fa0bb996f2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:02.210714 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea957d7-79c1-4b7b-8fec-63fa0bb996f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:02.210981 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea957d7-79c1-4b7b-8fec-63fa0bb996f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:02.211325 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e89a56-ae06-4c78-a55f-67f14539a926 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:02.211798 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e89a56-ae06-4c78-a55f-67f14539a926 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:02.212079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e89a56-ae06-4c78-a55f-67f14539a926 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:02.217774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 303/620] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:14:02.222049 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea957d7-79c1-4b7b-8fec-63fa0bb996f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:02.222587 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcef44-e910-498f-b337-b2fc8804c3c8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:02.223092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcef44-e910-498f-b337-b2fc8804c3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:02.223522 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea957d7-79c1-4b7b-8fec-63fa0bb996f2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:02.223791 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcef44-e910-498f-b337-b2fc8804c3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:02.234956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-5ea957d7-79c1-4b7b-8fec-63fa0bb996f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:02.234956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:02.234956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:02.234956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:02.234956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:02.234956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:02.234956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:02.234956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:02.234956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:02.234956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:02.234956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:02.234956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:02.234956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:14:02.234956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:14:02.234956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:14:02.235896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:14:02.235896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:02.235896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:02.235896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:02.235896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:02.235896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:02.235896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:02.235896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:02.235896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:02.235896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:02.235896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:02.235896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:02.235896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:02.235896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:02.235896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:02.235896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:02.235896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:02.236802 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:14:02.236802 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:14:02.236802 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:14:02.236802 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:14:02.236802 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:14:02.236802 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:14:02.236802 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:02.236802 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:02.236802 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 318/621] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:14:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:02.241734 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea957d7-79c1-4b7b-8fec-63fa0bb996f2 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:02.262658 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7bdcef44-e910-498f-b337-b2fc8804c3c8 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:02.263919 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7bdcef44-e910-498f-b337-b2fc8804c3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:02.346600 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 304/622] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:14:02.347376 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcef44-e910-498f-b337-b2fc8804c3c8 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:02.370322 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea957d7-79c1-4b7b-8fec-63fa0bb996f2 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:02.373639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:02.432021 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9767f88-fa21-4592-aa60-72d2d2d1822e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:02.432634 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9767f88-fa21-4592-aa60-72d2d2d1822e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:02.432914 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9767f88-fa21-4592-aa60-72d2d2d1822e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:02.433183 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9767f88-fa21-4592-aa60-72d2d2d1822e None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:02.433905 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9767f88-fa21-4592-aa60-72d2d2d1822e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:02.434209 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9767f88-fa21-4592-aa60-72d2d2d1822e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:02.436076 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9767f88-fa21-4592-aa60-72d2d2d1822e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:02.449777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 319/623] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:14:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:02.456333 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9767f88-fa21-4592-aa60-72d2d2d1822e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:02.498104 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:02.555727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcef44-e910-498f-b337-b2fc8804c3c8 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:02.624149 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7bd20-6425-4094-8830-889318375318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:02.624714 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7bd20-6425-4094-8830-889318375318 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:02.624989 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7bd20-6425-4094-8830-889318375318 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:02.625254 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7bd20-6425-4094-8830-889318375318 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:02.647370 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7bd20-6425-4094-8830-889318375318 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:14:02.654994 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-50a7bd20-6425-4094-8830-889318375318 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:14:02.654994 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:02.654994 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:02.654994 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:02.654994 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:02.654994 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:02.654994 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:02.654994 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:02.654994 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:02.654994 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:02.654994 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:02.654994 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:02.654994 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:14:02.654994 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:14:02.654994 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:14:02.654994 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:14:02.655957 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:14:02.655957 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:14:02.655957 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:14:02.655957 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:14:02.655957 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:02.655957 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:02.655957 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:02.655957 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:02.655957 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:02.655957 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:02.655957 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:02.655957 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:02.655957 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:02.655957 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:02.655957 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:02.655957 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:02.656827 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:02.656827 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:02.656827 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:02.656827 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:02.656827 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:14:02.656827 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:14:02.656827 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:14:02.656827 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:14:02.656827 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:14:02.656827 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:14:02.656827 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:14:02.656827 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:02.660741 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 305/624] 10.222.0.94 () {56 vars in 1102 bytes} [Thu Sep 1 17:14:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:02.661167 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9767f88-fa21-4592-aa60-72d2d2d1822e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:02.663459 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7bd20-6425-4094-8830-889318375318 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:02.706292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e49c73-b4b3-4903-870c-025c04f088e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:02.707096 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e49c73-b4b3-4903-870c-025c04f088e4 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:02.707408 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e49c73-b4b3-4903-870c-025c04f088e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:02.707688 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e49c73-b4b3-4903-870c-025c04f088e4 None admin] PATH_INFO: `/v3/projects/c8f9428f37354c82ac52b6b8eccc424a/users/af7ebf43f36c4862a3c527941e033666/roles/e903cb11e2bf466fa1b3fae894847c3e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:02.723615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e49c73-b4b3-4903-870c-025c04f088e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8f9428f37354c82ac52b6b8eccc424a, user_id=af7ebf43f36c4862a3c527941e033666, role_id=e903cb11e2bf466fa1b3fae894847c3e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:02.725245 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e49c73-b4b3-4903-870c-025c04f088e4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:02.740248 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 320/625] 10.222.0.94 () {58 vars in 1439 bytes} [Thu Sep 1 17:14:02 2022] PUT /identity/v3/projects/c8f9428f37354c82ac52b6b8eccc424a/users/af7ebf43f36c4862a3c527941e033666/roles/e903cb11e2bf466fa1b3fae894847c3e => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:14:02.741168 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e49c73-b4b3-4903-870c-025c04f088e4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:02.785740 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:02.808974 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7bd20-6425-4094-8830-889318375318 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:02.887624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:02.914755 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e49c73-b4b3-4903-870c-025c04f088e4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:02.926735 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721222e2-421b-4b8f-8fd0-f0948e2f3c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:02.927368 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721222e2-421b-4b8f-8fd0-f0948e2f3c6f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:02.927650 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721222e2-421b-4b8f-8fd0-f0948e2f3c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:02.927925 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721222e2-421b-4b8f-8fd0-f0948e2f3c6f None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:02.928718 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721222e2-421b-4b8f-8fd0-f0948e2f3c6f None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:02.928981 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721222e2-421b-4b8f-8fd0-f0948e2f3c6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:02.930435 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721222e2-421b-4b8f-8fd0-f0948e2f3c6f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:02.943324 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 306/626] 10.222.0.94 () {56 vars in 1103 bytes} [Thu Sep 1 17:14:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:02.949149 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721222e2-421b-4b8f-8fd0-f0948e2f3c6f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:02.956299 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee969830-275e-4420-9c0b-f6aacc8ab8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:02.956938 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee969830-275e-4420-9c0b-f6aacc8ab8f1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:02.957224 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee969830-275e-4420-9c0b-f6aacc8ab8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:02.959329 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee969830-275e-4420-9c0b-f6aacc8ab8f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:02.972767 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee969830-275e-4420-9c0b-f6aacc8ab8f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:14:02.977839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-ee969830-275e-4420-9c0b-f6aacc8ab8f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:14:02.977839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:02.977839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:02.977839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:02.977839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:02.977839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:02.977839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:02.977839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:02.977839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:02.977839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:02.977839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:02.977839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:02.977839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:14:02.977839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:14:02.977839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:14:02.977839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:14:02.978775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:14:02.978775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:14:02.978775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:14:02.978775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:14:02.978775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:02.978775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:02.978775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:02.978775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:02.978775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:02.978775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:02.978775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:02.978775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:02.978775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:02.978775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:02.978775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:02.978775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:02.979624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:02.979624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:02.979624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:02.979624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:02.979624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:14:02.979624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:14:02.979624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:14:02.979624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:14:02.979624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:14:02.979624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:14:02.979624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:14:02.979624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:02.979624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 321/627] 10.222.0.94 () {56 vars in 1102 bytes} [Thu Sep 1 17:14:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:02.984878 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee969830-275e-4420-9c0b-f6aacc8ab8f1 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:03.074124 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721222e2-421b-4b8f-8fd0-f0948e2f3c6f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:03.080709 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:03.113946 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bfc8f-e822-4a2c-ac38-9abc4a45cbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:03.114833 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bfc8f-e822-4a2c-ac38-9abc4a45cbe6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:03.115256 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bfc8f-e822-4a2c-ac38-9abc4a45cbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:03.115511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee969830-275e-4420-9c0b-f6aacc8ab8f1 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:03.115850 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bfc8f-e822-4a2c-ac38-9abc4a45cbe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:03.131891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bfc8f-e822-4a2c-ac38-9abc4a45cbe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:03.133376 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bfc8f-e822-4a2c-ac38-9abc4a45cbe6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:03.150231 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-e56bfc8f-e822-4a2c-ac38-9abc4a45cbe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:03.150231 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:03.150231 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:03.150231 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:03.150231 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:03.150231 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:03.150231 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:03.150231 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:03.150231 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:03.150231 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:03.150231 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:03.150231 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:03.150231 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:03.150231 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:03.150231 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:03.150231 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:03.151213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:03.151213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:03.151213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:03.151213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:03.151213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:03.151213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:03.151213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:03.151213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:03.151213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:03.151213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:03.151213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:03.151213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:03.151213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:03.151213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:03.151213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:03.151213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:03.151213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:03.152705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:03.152705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:03.152705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:03.152705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 307/628] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:03.152705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b449806-5536-4b00-8d2e-ecd8c80e0d76 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:03.153002 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b449806-5536-4b00-8d2e-ecd8c80e0d76 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:03.153262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b449806-5536-4b00-8d2e-ecd8c80e0d76 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:03.155296 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 308/629] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:03.157111 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b449806-5536-4b00-8d2e-ecd8c80e0d76 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:03.167677 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954384a-05d6-4dd4-99a8-e3c89c34ee35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:03.168519 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954384a-05d6-4dd4-99a8-e3c89c34ee35 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:03.168944 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954384a-05d6-4dd4-99a8-e3c89c34ee35 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:03.170120 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954384a-05d6-4dd4-99a8-e3c89c34ee35 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:03.170828 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954384a-05d6-4dd4-99a8-e3c89c34ee35 None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:03.171140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954384a-05d6-4dd4-99a8-e3c89c34ee35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:03.172551 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954384a-05d6-4dd4-99a8-e3c89c34ee35 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:03.185758 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 322/630] 10.222.0.94 () {56 vars in 1103 bytes} [Thu Sep 1 17:14:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:03.185758 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c4e4d-407f-4e1e-a670-98414c1e1458 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:03.185758 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c4e4d-407f-4e1e-a670-98414c1e1458 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:03.185758 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c4e4d-407f-4e1e-a670-98414c1e1458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:03.202507 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a86c4e4d-407f-4e1e-a670-98414c1e1458 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:03.203978 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a86c4e4d-407f-4e1e-a670-98414c1e1458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:03.223583 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:03.279643 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 323/631] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:14:03.281663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c4e4d-407f-4e1e-a670-98414c1e1458 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:03.291711 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b449806-5536-4b00-8d2e-ecd8c80e0d76 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:03.354034 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934044e-7e50-4e4a-af42-109fe0036336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:03.354649 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934044e-7e50-4e4a-af42-109fe0036336 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:03.354924 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934044e-7e50-4e4a-af42-109fe0036336 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:03.355194 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934044e-7e50-4e4a-af42-109fe0036336 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:03.355835 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934044e-7e50-4e4a-af42-109fe0036336 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:03.356132 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934044e-7e50-4e4a-af42-109fe0036336 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:03.357844 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934044e-7e50-4e4a-af42-109fe0036336 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:03.370178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 309/632] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:03.375845 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934044e-7e50-4e4a-af42-109fe0036336 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:03.410800 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:03.484156 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c4e4d-407f-4e1e-a670-98414c1e1458 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:03.535434 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28dedb-0812-42df-b117-6c8a2dd6f496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:03.536094 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28dedb-0812-42df-b117-6c8a2dd6f496 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:03.536373 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28dedb-0812-42df-b117-6c8a2dd6f496 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:03.536644 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28dedb-0812-42df-b117-6c8a2dd6f496 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:03.549469 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28dedb-0812-42df-b117-6c8a2dd6f496 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:03.551809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28dedb-0812-42df-b117-6c8a2dd6f496 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:03.567976 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-9a28dedb-0812-42df-b117-6c8a2dd6f496 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:03.567976 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:03.567976 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:03.567976 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:03.567976 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:03.567976 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:03.567976 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:03.567976 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:03.567976 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:03.567976 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:03.567976 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:03.567976 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:03.567976 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:03.567976 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:03.567976 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:03.567976 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:03.568900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:03.568900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:03.568900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:03.568900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:03.568900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:03.568900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:03.568900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:03.568900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:03.568900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:03.568900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:03.568900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:03.568900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:03.568900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:03.568900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:03.568900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:03.568900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:03.568900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:03.569825 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:03.569825 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:03.569825 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:03.569825 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 324/633] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:03.570623 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d7818-5482-4797-ac21-5c4040a60261 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:03.570978 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d7818-5482-4797-ac21-5c4040a60261 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:03.571079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934044e-7e50-4e4a-af42-109fe0036336 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:03.571248 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d7818-5482-4797-ac21-5c4040a60261 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:03.576765 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 325/634] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:03.577887 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d7818-5482-4797-ac21-5c4040a60261 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:03.583864 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:03.612236 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5537225-baf1-4361-8124-bb7deadea17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:03.612947 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5537225-baf1-4361-8124-bb7deadea17e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:03.613292 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5537225-baf1-4361-8124-bb7deadea17e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:03.613679 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5537225-baf1-4361-8124-bb7deadea17e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:03.622011 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5537225-baf1-4361-8124-bb7deadea17e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:03.623861 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5537225-baf1-4361-8124-bb7deadea17e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:03.636079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-f5537225-baf1-4361-8124-bb7deadea17e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 17:14:03.636079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:03.636079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:03.636079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:03.636079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:03.636079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:03.636079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:03.636079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:03.636079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:03.636079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:03.636079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:03.636079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:03.636079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:14:03.636079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:14:03.636079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:14:03.636079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:14:03.637030 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:03.637030 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:03.637030 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:14:03.637030 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:03.637030 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:14:03.637030 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:03.637030 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:03.637030 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:03.637030 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:03.637030 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:03.637030 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:03.637030 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:03.637030 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:03.637030 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:03.637030 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:03.637030 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:03.637030 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:03.637030 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:03.638778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:03.638778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:03.638778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:14:03.638778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:14:03.638778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:14:03.638778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:14:03.638778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:14:03.638778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:14:03.638778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 17:14:03.638778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:03.642589 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 310/635] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:14:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:14:03.643902 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcb675-e0a2-44c1-ae2b-6b0098b36485 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:03.644258 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcb675-e0a2-44c1-ae2b-6b0098b36485 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:03.644683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcb675-e0a2-44c1-ae2b-6b0098b36485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:03.662098 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e3bcb675-e0a2-44c1-ae2b-6b0098b36485 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:03.663282 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e3bcb675-e0a2-44c1-ae2b-6b0098b36485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:03.705054 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d7818-5482-4797-ac21-5c4040a60261 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:03.722319 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:03.735365 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 311/636] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:14:03.736390 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bcb675-e0a2-44c1-ae2b-6b0098b36485 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:03.751222 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d737bc7-6ba3-4f49-b773-f94e5a264d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:03.752457 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d737bc7-6ba3-4f49-b773-f94e5a264d3d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:03.753198 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d737bc7-6ba3-4f49-b773-f94e5a264d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:03.753725 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d737bc7-6ba3-4f49-b773-f94e5a264d3d None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:03.754776 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d737bc7-6ba3-4f49-b773-f94e5a264d3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:03.755516 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d737bc7-6ba3-4f49-b773-f94e5a264d3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:03.757170 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d737bc7-6ba3-4f49-b773-f94e5a264d3d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:03.775755 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 326/637] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:03.776964 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d737bc7-6ba3-4f49-b773-f94e5a264d3d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:03.849537 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:03.855999 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bcb675-e0a2-44c1-ae2b-6b0098b36485 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:03.894232 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3bf53f-7fa0-43d0-b002-74dbba3222c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:03.894843 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bf53f-7fa0-43d0-b002-74dbba3222c2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:03.895160 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bf53f-7fa0-43d0-b002-74dbba3222c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:03.895431 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bf53f-7fa0-43d0-b002-74dbba3222c2 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:03.896216 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3bf53f-7fa0-43d0-b002-74dbba3222c2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:03.896521 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3bf53f-7fa0-43d0-b002-74dbba3222c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:03.898092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3bf53f-7fa0-43d0-b002-74dbba3222c2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:03.909667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d737bc7-6ba3-4f49-b773-f94e5a264d3d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:03.917467 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 312/638] 10.222.0.94 () {56 vars in 1137 bytes} [Thu Sep 1 17:14:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:03.918440 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3bf53f-7fa0-43d0-b002-74dbba3222c2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:03.954776 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d262b4-8c7f-49c3-8074-6939f4c0cc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:03.956635 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d262b4-8c7f-49c3-8074-6939f4c0cc5b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:03.957079 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d262b4-8c7f-49c3-8074-6939f4c0cc5b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:03.957521 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d262b4-8c7f-49c3-8074-6939f4c0cc5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:03.971029 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d262b4-8c7f-49c3-8074-6939f4c0cc5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:14:03.977259 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-90d262b4-8c7f-49c3-8074-6939f4c0cc5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:14:03.977259 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:03.977259 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:03.977259 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:03.977259 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:03.977259 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:03.977259 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:03.977259 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:03.977259 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:03.977259 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:03.977259 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:03.977259 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:03.977259 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:14:03.977259 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:14:03.977259 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:14:03.977259 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:14:03.978473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:14:03.978473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:14:03.978473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:14:03.978473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:14:03.978473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:03.978473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:03.978473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:03.978473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:03.978473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:03.978473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:03.978473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:03.978473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:03.978473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:03.978473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:03.978473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:03.978473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:03.979507 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:03.979507 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:03.979507 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:03.979507 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:03.979507 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:14:03.979507 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:14:03.979507 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:14:03.979507 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:14:03.979507 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:14:03.979507 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:14:03.979507 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:14:03.979507 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:03.982665 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 327/639] 10.222.0.94 () {56 vars in 1102 bytes} [Thu Sep 1 17:14:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:03.983588 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d262b4-8c7f-49c3-8074-6939f4c0cc5b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:04.026711 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:04.042387 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3bf53f-7fa0-43d0-b002-74dbba3222c2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:04.081683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f626625-2ad7-43e5-ba02-b24125fd999f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:04.082307 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f626625-2ad7-43e5-ba02-b24125fd999f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:04.082579 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f626625-2ad7-43e5-ba02-b24125fd999f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:04.082841 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f626625-2ad7-43e5-ba02-b24125fd999f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:04.089681 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f626625-2ad7-43e5-ba02-b24125fd999f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:04.091145 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f626625-2ad7-43e5-ba02-b24125fd999f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:04.092042 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d262b4-8c7f-49c3-8074-6939f4c0cc5b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:04.102340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-6f626625-2ad7-43e5-ba02-b24125fd999f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 17:14:04.102340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:04.102340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:04.102340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:04.102340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:04.102340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:04.102340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:04.102340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:04.102340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:04.102340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:04.102340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:04.102340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:04.102340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:14:04.102340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:14:04.102340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:14:04.102340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:14:04.103305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:04.103305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:04.103305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:14:04.103305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:04.103305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:14:04.103305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:04.103305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:04.103305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:04.103305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:04.103305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:04.103305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:04.103305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:04.103305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:04.103305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:04.103305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:04.103305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:04.103305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:04.103305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:04.104304 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:04.104304 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:04.104304 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:14:04.104304 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:14:04.104304 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:14:04.104304 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:14:04.104304 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:14:04.104304 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:14:04.104304 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 17:14:04.104304 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:04.104304 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 313/640] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:14:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:04.104304 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f626625-2ad7-43e5-ba02-b24125fd999f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:04.125234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:04.139444 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2ac75-6818-4324-866b-e45e62cafebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:04.140052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2ac75-6818-4324-866b-e45e62cafebf None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:04.140326 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2ac75-6818-4324-866b-e45e62cafebf None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:04.140594 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2ac75-6818-4324-866b-e45e62cafebf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:04.211935 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2ac75-6818-4324-866b-e45e62cafebf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:04.213333 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2ac75-6818-4324-866b-e45e62cafebf None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:04.217196 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f626625-2ad7-43e5-ba02-b24125fd999f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:04.254225 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:04.255124 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68620b-05c6-4892-96ce-7b9c14e9d59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:04.255740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68620b-05c6-4892-96ce-7b9c14e9d59b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:04.256541 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68620b-05c6-4892-96ce-7b9c14e9d59b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:04.256649 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68620b-05c6-4892-96ce-7b9c14e9d59b None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:04.257316 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68620b-05c6-4892-96ce-7b9c14e9d59b None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:04.257971 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68620b-05c6-4892-96ce-7b9c14e9d59b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:04.259364 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68620b-05c6-4892-96ce-7b9c14e9d59b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:04.268869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 314/641] 10.222.0.94 () {56 vars in 1103 bytes} [Thu Sep 1 17:14:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:04.269677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68620b-05c6-4892-96ce-7b9c14e9d59b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:04.329490 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 328/642] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:14:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:14:04.329490 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2ac75-6818-4324-866b-e45e62cafebf None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:04.357760 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:04.382731 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68620b-05c6-4892-96ce-7b9c14e9d59b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:04.420251 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16a0e8-eebc-4726-9c9a-ea08e454a679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:04.420878 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16a0e8-eebc-4726-9c9a-ea08e454a679 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:04.421156 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16a0e8-eebc-4726-9c9a-ea08e454a679 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:04.421447 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16a0e8-eebc-4726-9c9a-ea08e454a679 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:04.431230 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2ac75-6818-4324-866b-e45e62cafebf None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:04.431691 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16a0e8-eebc-4726-9c9a-ea08e454a679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:14:04.436891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-4c16a0e8-eebc-4726-9c9a-ea08e454a679 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:14:04.436891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:04.436891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:04.436891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:04.436891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:04.436891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:04.436891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:04.436891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:04.436891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:04.436891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:04.436891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:04.436891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:04.436891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:14:04.436891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:14:04.436891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:14:04.436891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:14:04.437945 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:14:04.437945 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:14:04.437945 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:14:04.437945 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:14:04.437945 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:04.437945 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:04.437945 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:04.437945 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:04.437945 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:04.437945 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:04.437945 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:04.437945 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:04.437945 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:04.437945 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:04.437945 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:04.437945 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:04.438812 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:04.438812 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:04.438812 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:04.438812 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:04.438812 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:14:04.438812 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:14:04.438812 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:14:04.438812 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:14:04.438812 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:14:04.438812 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:14:04.438812 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:14:04.438812 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:04.438812 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 315/643] 10.222.0.94 () {56 vars in 1102 bytes} [Thu Sep 1 17:14:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:04.439520 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16a0e8-eebc-4726-9c9a-ea08e454a679 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:04.475880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fba268-c60e-4fa6-a61c-6637deaabcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:04.476403 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fba268-c60e-4fa6-a61c-6637deaabcb8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:04.476675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fba268-c60e-4fa6-a61c-6637deaabcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:04.476944 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fba268-c60e-4fa6-a61c-6637deaabcb8 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:04.477704 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fba268-c60e-4fa6-a61c-6637deaabcb8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:04.478007 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fba268-c60e-4fa6-a61c-6637deaabcb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:04.479447 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fba268-c60e-4fa6-a61c-6637deaabcb8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:04.488079 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:04.499197 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 329/644] 10.222.0.94 () {56 vars in 1137 bytes} [Thu Sep 1 17:14:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:04.500199 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fba268-c60e-4fa6-a61c-6637deaabcb8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:04.553944 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16a0e8-eebc-4726-9c9a-ea08e454a679 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:04.589995 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283af04-658c-402a-b643-d7a49484b119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:04.590615 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283af04-658c-402a-b643-d7a49484b119 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:04.590891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283af04-658c-402a-b643-d7a49484b119 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:04.591679 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283af04-658c-402a-b643-d7a49484b119 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:04.594683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:04.604522 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283af04-658c-402a-b643-d7a49484b119 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:04.604693 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fba268-c60e-4fa6-a61c-6637deaabcb8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:04.606199 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283af04-658c-402a-b643-d7a49484b119 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:04.621026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-3283af04-658c-402a-b643-d7a49484b119 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:04.621026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:04.621026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:04.621026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:04.621026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:04.621026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:04.621026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:04.621026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:04.621026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:04.621026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:04.621026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:04.621026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:04.621026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:04.621026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:04.621026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:04.621026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:04.622209 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:04.622209 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:04.622209 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:04.622209 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:04.622209 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:04.622209 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:04.622209 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:04.622209 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:04.622209 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:04.622209 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:04.622209 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:04.622209 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:04.622209 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:04.622209 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:04.622209 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:04.622209 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:04.622209 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:04.623715 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:04.623715 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:04.623715 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:04.623715 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 316/645] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:04.623715 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283af04-658c-402a-b643-d7a49484b119 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:04.643757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aabe45-fbfe-4f95-8a1b-631e691d7959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:04.644395 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aabe45-fbfe-4f95-8a1b-631e691d7959 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:04.644676 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aabe45-fbfe-4f95-8a1b-631e691d7959 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:04.644945 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aabe45-fbfe-4f95-8a1b-631e691d7959 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:04.655670 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aabe45-fbfe-4f95-8a1b-631e691d7959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:04.657121 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aabe45-fbfe-4f95-8a1b-631e691d7959 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:04.671627 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-78aabe45-fbfe-4f95-8a1b-631e691d7959 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:04.671627 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:04.671627 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:04.671627 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:04.671627 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:04.671627 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:04.671627 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:04.671627 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:04.671627 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:04.671627 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:04.671627 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:04.671627 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:04.671627 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:04.671627 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:04.671627 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:04.671627 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:04.672589 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:04.672589 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:04.672589 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:04.672589 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:04.672589 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:04.672589 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:04.672589 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:04.672589 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:04.672589 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:04.672589 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:04.672589 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:04.672589 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:04.672589 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:04.672589 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:04.672589 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:04.672589 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:04.672589 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:04.673570 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:04.673570 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:04.673570 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:04.673570 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 330/646] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:04.673570 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aabe45-fbfe-4f95-8a1b-631e691d7959 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:04.722760 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:04.734660 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283af04-658c-402a-b643-d7a49484b119 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:04.770176 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab33971-01ca-41d7-8a5e-62062c5c56c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:04.771042 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab33971-01ca-41d7-8a5e-62062c5c56c0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:04.771443 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab33971-01ca-41d7-8a5e-62062c5c56c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:04.771713 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab33971-01ca-41d7-8a5e-62062c5c56c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:04.772597 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab33971-01ca-41d7-8a5e-62062c5c56c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:04.772981 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab33971-01ca-41d7-8a5e-62062c5c56c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:04.774369 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab33971-01ca-41d7-8a5e-62062c5c56c0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:04.774467 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aabe45-fbfe-4f95-8a1b-631e691d7959 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:04.785714 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 317/647] 10.222.0.94 () {56 vars in 1103 bytes} [Thu Sep 1 17:14:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:04.786873 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab33971-01ca-41d7-8a5e-62062c5c56c0 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:04.809760 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ada492-8a04-4584-84c2-29ba478e90ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:04.811147 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ada492-8a04-4584-84c2-29ba478e90ec None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:04.811517 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ada492-8a04-4584-84c2-29ba478e90ec None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:04.811854 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ada492-8a04-4584-84c2-29ba478e90ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:04.838866 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:04.877842 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ada492-8a04-4584-84c2-29ba478e90ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:04.879364 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ada492-8a04-4584-84c2-29ba478e90ec None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:04.888332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab33971-01ca-41d7-8a5e-62062c5c56c0 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:04.920431 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318842a-444a-4417-865c-c5793182983d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:04.921028 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318842a-444a-4417-865c-c5793182983d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:04.921303 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318842a-444a-4417-865c-c5793182983d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:04.921610 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318842a-444a-4417-865c-c5793182983d None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:04.922235 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318842a-444a-4417-865c-c5793182983d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:04.922533 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318842a-444a-4417-865c-c5793182983d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:04.923872 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318842a-444a-4417-865c-c5793182983d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:04.926599 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:04.935250 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 318/648] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:04.936034 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318842a-444a-4417-865c-c5793182983d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:04.981265 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 331/649] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:14:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:14:04.982172 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ada492-8a04-4584-84c2-29ba478e90ec None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:05.038061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318842a-444a-4417-865c-c5793182983d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:05.049044 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:05.073270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae185d-9195-4373-a083-ce7c9d9b072e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:05.073900 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae185d-9195-4373-a083-ce7c9d9b072e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:05.074183 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae185d-9195-4373-a083-ce7c9d9b072e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:05.074455 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae185d-9195-4373-a083-ce7c9d9b072e None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:05.075149 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae185d-9195-4373-a083-ce7c9d9b072e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:05.075885 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae185d-9195-4373-a083-ce7c9d9b072e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:05.077283 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae185d-9195-4373-a083-ce7c9d9b072e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:05.079149 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ada492-8a04-4584-84c2-29ba478e90ec None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:05.088363 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 319/650] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:05.089552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21ccfc-636b-4dbb-b113-74753f451d7f None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:05.089835 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21ccfc-636b-4dbb-b113-74753f451d7f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:05.090106 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21ccfc-636b-4dbb-b113-74753f451d7f None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:05.092015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 320/651] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:05.092520 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21ccfc-636b-4dbb-b113-74753f451d7f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:05.116243 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70321982-cbb4-44fd-9756-06127b92a1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:05.116863 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70321982-cbb4-44fd-9756-06127b92a1d9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:05.117138 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70321982-cbb4-44fd-9756-06127b92a1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:05.117422 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70321982-cbb4-44fd-9756-06127b92a1d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:05.127219 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70321982-cbb4-44fd-9756-06127b92a1d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:05.128659 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70321982-cbb4-44fd-9756-06127b92a1d9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:05.138428 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:05.145565 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-70321982-cbb4-44fd-9756-06127b92a1d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:05.145565 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:05.145565 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:05.145565 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:05.145565 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:05.145565 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:05.145565 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:05.145565 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:05.145565 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:05.145565 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:05.145565 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:05.145565 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:05.145565 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:05.145565 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:05.145565 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:05.145565 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:05.146692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:05.146692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:05.146692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:05.146692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:05.146692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:05.146692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:05.146692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:05.146692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:05.146692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:05.146692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:05.146692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:05.146692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:05.146692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:05.146692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:05.146692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:05.146692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:05.146692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:05.147799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:05.147799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:05.147799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:05.147799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 332/652] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:05.147799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70321982-cbb4-44fd-9756-06127b92a1d9 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:05.194875 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21ccfc-636b-4dbb-b113-74753f451d7f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:05.229104 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf50313-398c-46f5-901a-9a1072c48094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:05.229755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf50313-398c-46f5-901a-9a1072c48094 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:05.230034 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf50313-398c-46f5-901a-9a1072c48094 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:05.230306 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf50313-398c-46f5-901a-9a1072c48094 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:05.237137 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf50313-398c-46f5-901a-9a1072c48094 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:05.238601 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf50313-398c-46f5-901a-9a1072c48094 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:05.248836 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70321982-cbb4-44fd-9756-06127b92a1d9 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:05.250604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-ddf50313-398c-46f5-901a-9a1072c48094 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:14:05.250604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:05.250604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:05.250604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:05.250604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:05.250604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:05.250604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:05.250604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:05.250604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:05.250604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:05.250604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:05.250604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:05.250604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:14:05.250604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:14:05.250604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:14:05.250604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:14:05.251683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:05.251683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:05.251683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:14:05.251683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:05.251683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:14:05.251683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:05.251683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:05.251683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:05.251683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:05.251683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:05.251683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:05.251683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:05.251683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:05.251683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:05.251683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:05.251683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:05.251683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:05.251683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:05.252855 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:05.252855 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:05.252855 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:14:05.252855 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:14:05.252855 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:14:05.252855 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:14:05.252855 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:14:05.252855 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:14:05.252855 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:14:05.252855 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:05.252855 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 321/653] 10.222.0.94 () {56 vars in 1093 bytes} [Thu Sep 1 17:14:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:05.252855 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf50313-398c-46f5-901a-9a1072c48094 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:05.281819 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:05.286731 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d8867-2e02-4751-beb7-2c36471af9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:05.287387 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d8867-2e02-4751-beb7-2c36471af9e3 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:05.287655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d8867-2e02-4751-beb7-2c36471af9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:05.287925 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d8867-2e02-4751-beb7-2c36471af9e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:05.298312 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d8867-2e02-4751-beb7-2c36471af9e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:05.299661 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d8867-2e02-4751-beb7-2c36471af9e3 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:05.313712 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-512d8867-2e02-4751-beb7-2c36471af9e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:05.313712 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:05.313712 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:05.313712 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:05.313712 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:05.313712 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:05.313712 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:05.313712 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:05.313712 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:05.313712 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:05.313712 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:05.313712 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:05.313712 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:05.313712 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:05.313712 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:05.313712 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:05.314727 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:05.314727 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:05.314727 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:05.314727 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:05.314727 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:05.314727 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:05.314727 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:05.314727 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:05.314727 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:05.314727 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:05.314727 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:05.314727 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:05.314727 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:05.314727 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:05.314727 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:05.314727 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:05.314727 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:05.315617 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:05.315617 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:05.315617 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:05.315617 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 333/654] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:05.316198 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0048a7e-c782-4119-9e7d-eb016bbe20bc None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:05.316198 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0048a7e-c782-4119-9e7d-eb016bbe20bc None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:05.316425 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0048a7e-c782-4119-9e7d-eb016bbe20bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:05.334198 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b0048a7e-c782-4119-9e7d-eb016bbe20bc None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:05.335372 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b0048a7e-c782-4119-9e7d-eb016bbe20bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:05.354523 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf50313-398c-46f5-901a-9a1072c48094 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:05.380945 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:05.387816 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e370e7d-0bd1-4de6-a92c-1715fb59f6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:05.388499 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e370e7d-0bd1-4de6-a92c-1715fb59f6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:05.388777 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e370e7d-0bd1-4de6-a92c-1715fb59f6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:05.389050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e370e7d-0bd1-4de6-a92c-1715fb59f6a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:05.395642 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e370e7d-0bd1-4de6-a92c-1715fb59f6a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:05.397063 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e370e7d-0bd1-4de6-a92c-1715fb59f6a5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:05.401366 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 334/655] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:14:05.402205 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0048a7e-c782-4119-9e7d-eb016bbe20bc None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:05.408664 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-3e370e7d-0bd1-4de6-a92c-1715fb59f6a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:05.408664 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:05.408664 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:05.408664 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:05.408664 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:05.408664 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:05.408664 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:05.408664 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:05.408664 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:05.408664 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:05.408664 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:05.408664 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:05.408664 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:14:05.408664 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:14:05.408664 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:14:05.409558 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:14:05.409558 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:05.409558 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:05.409558 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:05.409558 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:05.409558 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:05.409558 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:05.409558 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:05.409558 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:05.409558 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:05.409558 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:05.409558 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:05.409558 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:05.409558 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:05.409558 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:05.409558 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:05.409558 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:05.410483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:14:05.410483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:14:05.410483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:14:05.410483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:14:05.410483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:14:05.410483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:14:05.410483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:05.410483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:05.410483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 322/656] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:14:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:05.410967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e370e7d-0bd1-4de6-a92c-1715fb59f6a5 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:05.506520 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0048a7e-c782-4119-9e7d-eb016bbe20bc None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:05.510140 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:05.520159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e370e7d-0bd1-4de6-a92c-1715fb59f6a5 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:05.549633 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c07fb-df98-4e4a-acc4-ce1164d0b1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:05.550178 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c07fb-df98-4e4a-acc4-ce1164d0b1a3 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:05.550455 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c07fb-df98-4e4a-acc4-ce1164d0b1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:05.550721 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c07fb-df98-4e4a-acc4-ce1164d0b1a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:05.551355 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c07fb-df98-4e4a-acc4-ce1164d0b1a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:05.551655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c07fb-df98-4e4a-acc4-ce1164d0b1a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:05.553298 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c07fb-df98-4e4a-acc4-ce1164d0b1a3 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:05.554899 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d18b9f-e1af-432b-a537-1ea1a0b7c38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:05.555509 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d18b9f-e1af-432b-a537-1ea1a0b7c38a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:05.555787 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d18b9f-e1af-432b-a537-1ea1a0b7c38a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:05.556063 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d18b9f-e1af-432b-a537-1ea1a0b7c38a None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:05.556786 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d18b9f-e1af-432b-a537-1ea1a0b7c38a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:05.557088 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d18b9f-e1af-432b-a537-1ea1a0b7c38a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:05.558521 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d18b9f-e1af-432b-a537-1ea1a0b7c38a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:05.566915 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 335/657] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:05.568085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c07fb-df98-4e4a-acc4-ce1164d0b1a3 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:05.581318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 323/658] 10.222.0.94 () {56 vars in 1133 bytes} [Thu Sep 1 17:14:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:05.582439 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d18b9f-e1af-432b-a537-1ea1a0b7c38a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:05.619212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:05.681432 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c07fb-df98-4e4a-acc4-ce1164d0b1a3 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:05.691116 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d18b9f-e1af-432b-a537-1ea1a0b7c38a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:05.717688 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fa4eb-5611-4cf5-915f-ac63608b6259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:05.718292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fa4eb-5611-4cf5-915f-ac63608b6259 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:05.718569 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fa4eb-5611-4cf5-915f-ac63608b6259 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:05.719326 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fa4eb-5611-4cf5-915f-ac63608b6259 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:05.719968 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5fa4eb-5611-4cf5-915f-ac63608b6259 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:05.720270 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5fa4eb-5611-4cf5-915f-ac63608b6259 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:05.721658 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5fa4eb-5611-4cf5-915f-ac63608b6259 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:05.725893 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ae87f-cc84-4f05-90b2-5c764882e37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:05.726496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ae87f-cc84-4f05-90b2-5c764882e37c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:05.726777 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ae87f-cc84-4f05-90b2-5c764882e37c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:05.727048 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ae87f-cc84-4f05-90b2-5c764882e37c None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:05.727732 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ae87f-cc84-4f05-90b2-5c764882e37c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:05.728037 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ae87f-cc84-4f05-90b2-5c764882e37c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:05.729473 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ae87f-cc84-4f05-90b2-5c764882e37c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:05.733644 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 336/659] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:05.734435 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fa4eb-5611-4cf5-915f-ac63608b6259 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:05.741352 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 324/660] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:14:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:05.742193 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ae87f-cc84-4f05-90b2-5c764882e37c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:05.753247 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:05.841653 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fa4eb-5611-4cf5-915f-ac63608b6259 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:05.843685 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:05.850834 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ae87f-cc84-4f05-90b2-5c764882e37c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:05.877910 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb813f-6efa-4cd6-9dc9-39c9a2b972b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:05.878530 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb813f-6efa-4cd6-9dc9-39c9a2b972b5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:05.878811 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb813f-6efa-4cd6-9dc9-39c9a2b972b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:05.879080 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb813f-6efa-4cd6-9dc9-39c9a2b972b5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:05.885035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73597ea6-11ff-4c42-bcb3-4abc2bd2c881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:05.885669 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73597ea6-11ff-4c42-bcb3-4abc2bd2c881 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:05.885949 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73597ea6-11ff-4c42-bcb3-4abc2bd2c881 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:05.886226 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73597ea6-11ff-4c42-bcb3-4abc2bd2c881 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:05.886321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb813f-6efa-4cd6-9dc9-39c9a2b972b5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:05.887692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb813f-6efa-4cd6-9dc9-39c9a2b972b5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:05.899222 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-22bb813f-6efa-4cd6-9dc9-39c9a2b972b5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 17:14:05.899222 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:05.899222 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:05.899222 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:05.899222 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:05.899222 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:05.899222 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:05.899222 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:05.899222 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:05.899222 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:05.899222 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:05.899222 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:05.899222 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:14:05.899222 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:14:05.899222 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:14:05.899222 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:14:05.900176 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:05.900176 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:05.900176 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:14:05.900176 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:05.900176 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:14:05.900176 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:05.900176 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:05.900176 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:05.900176 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:05.900176 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:05.900176 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:05.900176 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:05.900176 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:05.900176 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:05.900176 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:05.900176 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:05.900176 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:05.900176 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:05.901129 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:05.901129 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:05.901129 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:14:05.901129 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:14:05.901129 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:14:05.901129 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:14:05.901129 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:14:05.901129 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:14:05.901129 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 17:14:05.901129 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:05.901129 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 337/661] 10.222.0.94 () {56 vars in 1102 bytes} [Thu Sep 1 17:14:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:05.901129 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb813f-6efa-4cd6-9dc9-39c9a2b972b5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:05.959079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73597ea6-11ff-4c42-bcb3-4abc2bd2c881 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:05.960531 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73597ea6-11ff-4c42-bcb3-4abc2bd2c881 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:05.970432 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:05.997678 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb813f-6efa-4cd6-9dc9-39c9a2b972b5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:06.029794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1129676-4564-4739-8f21-ab34789a7bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:06.030411 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1129676-4564-4739-8f21-ab34789a7bad None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:06.030690 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1129676-4564-4739-8f21-ab34789a7bad None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:06.030960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1129676-4564-4739-8f21-ab34789a7bad None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:06.040683 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1129676-4564-4739-8f21-ab34789a7bad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:14:06.045979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-a1129676-4564-4739-8f21-ab34789a7bad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:14:06.045979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:06.045979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:06.045979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:06.045979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:06.045979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:06.045979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:06.045979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:06.045979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:06.045979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:06.045979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:06.045979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:06.045979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:14:06.045979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:14:06.045979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:14:06.045979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:14:06.047084 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:14:06.047084 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:14:06.047084 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:14:06.047084 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:14:06.047084 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:06.047084 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:06.047084 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:06.047084 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:06.047084 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:06.047084 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:06.047084 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:06.047084 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:06.047084 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:06.047084 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:06.047084 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:06.047084 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:06.047940 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:06.047940 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:06.047940 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:06.047940 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:06.047940 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:14:06.047940 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:14:06.047940 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:14:06.047940 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:14:06.047940 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:14:06.047940 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:14:06.047940 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:14:06.047940 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:06.047940 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 338/662] 10.222.0.94 () {56 vars in 1102 bytes} [Thu Sep 1 17:14:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:06.047940 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1129676-4564-4739-8f21-ab34789a7bad None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:06.058613 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 325/663] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:14:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:14:06.059468 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73597ea6-11ff-4c42-bcb3-4abc2bd2c881 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:06.072151 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:06.146052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1129676-4564-4739-8f21-ab34789a7bad None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:06.156909 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73597ea6-11ff-4c42-bcb3-4abc2bd2c881 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:06.166234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:06.178645 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01be562-8973-4688-8fa5-0160b971b699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:06.179272 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01be562-8973-4688-8fa5-0160b971b699 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:06.179552 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01be562-8973-4688-8fa5-0160b971b699 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:06.179823 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01be562-8973-4688-8fa5-0160b971b699 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:06.187052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01be562-8973-4688-8fa5-0160b971b699 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:06.188489 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01be562-8973-4688-8fa5-0160b971b699 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:06.192184 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7863b-5112-4188-b2d0-8c21f4994f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:06.192777 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7863b-5112-4188-b2d0-8c21f4994f22 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:06.193059 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7863b-5112-4188-b2d0-8c21f4994f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:06.193328 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7863b-5112-4188-b2d0-8c21f4994f22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:06.194071 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7863b-5112-4188-b2d0-8c21f4994f22 None admin] RBAC: Adding query filter params (role.id=e903cb11e2bf466fa1b3fae894847c3e, scope.project.id=c8f9428f37354c82ac52b6b8eccc424a, user.id=eee371754d7d43b4987084db58f44957) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:06.194379 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7863b-5112-4188-b2d0-8c21f4994f22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:06.195778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7863b-5112-4188-b2d0-8c21f4994f22 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:06.199501 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-a01be562-8973-4688-8fa5-0160b971b699 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:06.199501 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:06.199501 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:06.199501 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:06.199501 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:06.199501 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:06.199501 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:06.199501 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:06.199501 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:06.199501 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:06.199501 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:06.199501 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:06.199501 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:14:06.199501 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:14:06.199501 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:14:06.200409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:14:06.200409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:06.200409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:06.200409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:06.200409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:06.200409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:06.200409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:06.200409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:06.200409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:06.200409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:06.200409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:06.200409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:06.200409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:06.200409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:06.200409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:06.200409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:06.200409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:06.201387 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:14:06.201387 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:14:06.201387 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:14:06.201387 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:14:06.201387 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:14:06.201387 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:14:06.201387 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:06.201387 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:06.201387 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 339/664] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:14:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:06.201906 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 326/665] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:14:06 2022] GET /identity/v3/role_assignments?user.id=eee371754d7d43b4987084db58f44957&scope.project.id=c8f9428f37354c82ac52b6b8eccc424a&role.id=e903cb11e2bf466fa1b3fae894847c3e => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:06.202367 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01be562-8973-4688-8fa5-0160b971b699 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:06.202576 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7863b-5112-4188-b2d0-8c21f4994f22 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:06.312886 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:06.322007 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7863b-5112-4188-b2d0-8c21f4994f22 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:06.332915 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01be562-8973-4688-8fa5-0160b971b699 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:06.364958 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b1445-57e9-43fc-af0d-a0aefdf25d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:06.365490 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b1445-57e9-43fc-af0d-a0aefdf25d06 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:06.365774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b1445-57e9-43fc-af0d-a0aefdf25d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:06.366046 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b1445-57e9-43fc-af0d-a0aefdf25d06 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:06.366709 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b1445-57e9-43fc-af0d-a0aefdf25d06 None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:06.367009 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b1445-57e9-43fc-af0d-a0aefdf25d06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:06.368375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b1445-57e9-43fc-af0d-a0aefdf25d06 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:06.373922 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b662a2-9016-45e2-8077-aa2e11562c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:06.374604 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b662a2-9016-45e2-8077-aa2e11562c24 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:06.374886 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b662a2-9016-45e2-8077-aa2e11562c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:06.375151 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b662a2-9016-45e2-8077-aa2e11562c24 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:06.375883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b662a2-9016-45e2-8077-aa2e11562c24 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:06.376188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b662a2-9016-45e2-8077-aa2e11562c24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:06.377659 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b662a2-9016-45e2-8077-aa2e11562c24 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:06.378315 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 327/666] 10.222.0.94 () {56 vars in 1103 bytes} [Thu Sep 1 17:14:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:06.379315 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b1445-57e9-43fc-af0d-a0aefdf25d06 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:06.396491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 340/667] 10.222.0.94 () {56 vars in 1139 bytes} [Thu Sep 1 17:14:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:06.396669 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b662a2-9016-45e2-8077-aa2e11562c24 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:06.416950 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:06.491881 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b1445-57e9-43fc-af0d-a0aefdf25d06 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:06.510006 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b662a2-9016-45e2-8077-aa2e11562c24 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:06.527782 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad28884-2f0e-47a7-ba27-792e7d563bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:06.528527 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad28884-2f0e-47a7-ba27-792e7d563bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:06.529482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad28884-2f0e-47a7-ba27-792e7d563bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:06.529832 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad28884-2f0e-47a7-ba27-792e7d563bc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:06.543294 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad28884-2f0e-47a7-ba27-792e7d563bc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:06.544829 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad28884-2f0e-47a7-ba27-792e7d563bc4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:06.552186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392d2b5-f1ea-4cf6-aaa7-66ce999c5c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:06.552794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392d2b5-f1ea-4cf6-aaa7-66ce999c5c87 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:06.553069 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392d2b5-f1ea-4cf6-aaa7-66ce999c5c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:06.553329 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392d2b5-f1ea-4cf6-aaa7-66ce999c5c87 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:06.554055 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392d2b5-f1ea-4cf6-aaa7-66ce999c5c87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:06.554358 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392d2b5-f1ea-4cf6-aaa7-66ce999c5c87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:06.555806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392d2b5-f1ea-4cf6-aaa7-66ce999c5c87 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:06.560375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-7ad28884-2f0e-47a7-ba27-792e7d563bc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:06.560375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:06.560375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:06.560375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:06.560375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:06.560375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:06.560375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:06.560375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:06.560375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:06.560375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:06.560375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:06.560375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:06.560375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:06.560375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:06.560375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:06.560375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:06.561318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:06.561318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:06.561318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:06.561318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:06.561318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:06.561318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:06.561318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:06.561318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:06.561318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:06.561318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:06.561318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:06.561318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:06.561318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:06.561318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:06.561318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:06.561318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:06.561318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:06.562279 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:06.562279 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:06.562279 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:06.562279 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 328/668] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:06.563027 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad28884-2f0e-47a7-ba27-792e7d563bc4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:06.569811 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:06.574000 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 341/669] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:14:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:06.574849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392d2b5-f1ea-4cf6-aaa7-66ce999c5c87 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:06.658553 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:06.675626 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad28884-2f0e-47a7-ba27-792e7d563bc4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:06.683509 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392d2b5-f1ea-4cf6-aaa7-66ce999c5c87 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:06.711268 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f13234-a585-433e-b3c7-94c07b54c98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:06.711897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f13234-a585-433e-b3c7-94c07b54c98d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:06.712175 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f13234-a585-433e-b3c7-94c07b54c98d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:06.712444 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f13234-a585-433e-b3c7-94c07b54c98d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:06.721831 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d3803-8988-4412-9713-c3f1725b9356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:06.722643 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d3803-8988-4412-9713-c3f1725b9356 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:06.722927 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d3803-8988-4412-9713-c3f1725b9356 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:06.723201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d3803-8988-4412-9713-c3f1725b9356 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:06.723473 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f13234-a585-433e-b3c7-94c07b54c98d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:06.724967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f13234-a585-433e-b3c7-94c07b54c98d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:06.742177 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-05f13234-a585-433e-b3c7-94c07b54c98d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:06.742177 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:06.742177 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:06.742177 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:06.742177 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:06.742177 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:06.742177 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:06.742177 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:06.742177 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:06.742177 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:06.742177 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:06.742177 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:06.742177 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:06.742177 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:06.742177 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:06.742177 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:06.743575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:06.743575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:06.743575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:06.743575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:06.743575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:06.743575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:06.743575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:06.743575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:06.743575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:06.743575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:06.743575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:06.743575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:06.743575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:06.743575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:06.743575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:06.743575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:06.743575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:06.745429 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:06.745429 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:06.745429 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:06.745429 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 329/670] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:06.745429 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f13234-a585-433e-b3c7-94c07b54c98d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:06.804678 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:06.808047 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d3803-8988-4412-9713-c3f1725b9356 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:06.810666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d3803-8988-4412-9713-c3f1725b9356 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:06.850173 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f13234-a585-433e-b3c7-94c07b54c98d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:06.891459 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42f69c-6b38-42c0-be7b-a11b6e83c226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:06.892073 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42f69c-6b38-42c0-be7b-a11b6e83c226 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:06.892376 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42f69c-6b38-42c0-be7b-a11b6e83c226 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:06.892649 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42f69c-6b38-42c0-be7b-a11b6e83c226 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:06.893295 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42f69c-6b38-42c0-be7b-a11b6e83c226 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:06.893645 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42f69c-6b38-42c0-be7b-a11b6e83c226 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:06.895041 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42f69c-6b38-42c0-be7b-a11b6e83c226 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:06.902035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:06.912165 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 330/671] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:06.912165 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42f69c-6b38-42c0-be7b-a11b6e83c226 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:06.928414 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 342/672] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:14:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:14:06.928414 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d3803-8988-4412-9713-c3f1725b9356 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:07.015911 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42f69c-6b38-42c0-be7b-a11b6e83c226 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:07.030570 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:07.034036 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d3803-8988-4412-9713-c3f1725b9356 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:07.051742 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c65e08-5a8e-4fea-9a94-df3b61635734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:07.052441 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c65e08-5a8e-4fea-9a94-df3b61635734 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:07.052725 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c65e08-5a8e-4fea-9a94-df3b61635734 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:07.052993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c65e08-5a8e-4fea-9a94-df3b61635734 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:07.053737 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c65e08-5a8e-4fea-9a94-df3b61635734 None admin] RBAC: Adding query filter params (role.id=e903cb11e2bf466fa1b3fae894847c3e, scope.project.id=c8f9428f37354c82ac52b6b8eccc424a, user.id=74c6647f3aa54dc68e888b3adb8c28b5) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:07.054038 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c65e08-5a8e-4fea-9a94-df3b61635734 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:07.055451 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c65e08-5a8e-4fea-9a94-df3b61635734 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:07.062479 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 331/673] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:14:06 2022] GET /identity/v3/role_assignments?user.id=74c6647f3aa54dc68e888b3adb8c28b5&scope.project.id=c8f9428f37354c82ac52b6b8eccc424a&role.id=e903cb11e2bf466fa1b3fae894847c3e => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:07.063175 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c65e08-5a8e-4fea-9a94-df3b61635734 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:07.096569 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69048084-aff9-4b91-9c6c-49e95d7253dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:07.097196 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69048084-aff9-4b91-9c6c-49e95d7253dd None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:07.097503 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69048084-aff9-4b91-9c6c-49e95d7253dd None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:07.097777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69048084-aff9-4b91-9c6c-49e95d7253dd None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:07.098843 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69048084-aff9-4b91-9c6c-49e95d7253dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:07.098843 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69048084-aff9-4b91-9c6c-49e95d7253dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:07.100276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69048084-aff9-4b91-9c6c-49e95d7253dd None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:07.114361 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 343/674] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:07.117114 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69048084-aff9-4b91-9c6c-49e95d7253dd None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:07.157544 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:07.206149 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c65e08-5a8e-4fea-9a94-df3b61635734 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:07.255589 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69048084-aff9-4b91-9c6c-49e95d7253dd None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:07.259361 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d290fc-84b5-4b2d-8c4d-d87ca65c6c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:07.259992 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d290fc-84b5-4b2d-8c4d-d87ca65c6c35 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:07.260270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d290fc-84b5-4b2d-8c4d-d87ca65c6c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:07.260537 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d290fc-84b5-4b2d-8c4d-d87ca65c6c35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:07.267779 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d290fc-84b5-4b2d-8c4d-d87ca65c6c35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:07.269229 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d290fc-84b5-4b2d-8c4d-d87ca65c6c35 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:07.283435 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-42d290fc-84b5-4b2d-8c4d-d87ca65c6c35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:07.283435 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:07.283435 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:07.283435 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:07.283435 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:07.283435 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:07.283435 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:07.283435 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:07.283435 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:07.283435 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:07.283435 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:07.283435 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:07.283435 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:14:07.283435 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:14:07.283435 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:14:07.284473 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:14:07.284473 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:07.284473 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:07.284473 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:07.284473 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:07.284473 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:07.284473 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:07.284473 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:07.284473 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:07.284473 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:07.284473 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:07.284473 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:07.284473 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:07.284473 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:07.284473 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:07.284473 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:07.284473 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:07.285527 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:14:07.285527 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:14:07.285527 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:14:07.285527 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:14:07.285527 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:14:07.285527 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:14:07.285527 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:07.285527 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:07.285527 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 332/675] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:14:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:07.286560 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d290fc-84b5-4b2d-8c4d-d87ca65c6c35 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:07.298972 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e168695-c7e2-4ed3-ad20-9f9c2b90d56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:07.300288 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e168695-c7e2-4ed3-ad20-9f9c2b90d56b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:07.300733 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e168695-c7e2-4ed3-ad20-9f9c2b90d56b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:07.301163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e168695-c7e2-4ed3-ad20-9f9c2b90d56b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:07.314780 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e168695-c7e2-4ed3-ad20-9f9c2b90d56b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:07.316295 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e168695-c7e2-4ed3-ad20-9f9c2b90d56b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:07.335674 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-7e168695-c7e2-4ed3-ad20-9f9c2b90d56b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:07.335674 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:07.335674 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:07.335674 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:07.335674 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:07.335674 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:07.335674 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:07.335674 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:07.335674 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:07.335674 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:07.335674 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:07.335674 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:07.335674 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:07.335674 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:07.335674 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:07.335674 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:07.336703 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:07.336703 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:07.336703 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:07.336703 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:07.336703 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:07.336703 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:07.336703 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:07.336703 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:07.336703 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:07.336703 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:07.336703 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:07.336703 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:07.336703 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:07.336703 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:07.336703 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:07.336703 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:07.336703 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:07.337734 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:07.337734 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:07.337734 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:07.337734 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 344/676] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:07.337734 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e168695-c7e2-4ed3-ad20-9f9c2b90d56b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:07.357888 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:07.423134 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d290fc-84b5-4b2d-8c4d-d87ca65c6c35 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:07.448382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:07.462727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae10dc-647b-4f69-b5b6-de129139fa68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:07.463442 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae10dc-647b-4f69-b5b6-de129139fa68 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:07.463820 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae10dc-647b-4f69-b5b6-de129139fa68 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:07.464189 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae10dc-647b-4f69-b5b6-de129139fa68 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:07.474046 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae10dc-647b-4f69-b5b6-de129139fa68 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:07.475491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae10dc-647b-4f69-b5b6-de129139fa68 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:07.481051 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e168695-c7e2-4ed3-ad20-9f9c2b90d56b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:07.487666 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-5dae10dc-647b-4f69-b5b6-de129139fa68 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 17:14:07.487666 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:07.487666 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:07.487666 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:07.487666 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:07.487666 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:07.487666 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:07.487666 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:07.487666 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:07.487666 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:07.487666 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:07.487666 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:07.487666 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:14:07.487666 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:14:07.487666 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:14:07.487666 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:14:07.488847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:07.488847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:07.488847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:14:07.488847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:07.488847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:14:07.488847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:07.488847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:07.488847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:07.488847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:07.488847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:07.488847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:07.488847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:07.488847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:07.488847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:07.488847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:07.488847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:07.488847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:07.488847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:07.490104 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:07.490104 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:07.490104 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:14:07.490104 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:14:07.490104 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:14:07.490104 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:14:07.490104 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:14:07.490104 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:14:07.490104 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 17:14:07.490104 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:07.492119 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 333/677] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:14:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:07.492882 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae10dc-647b-4f69-b5b6-de129139fa68 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:07.538944 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf112b-4365-4fa0-bdf3-b76b25056dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:07.539696 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf112b-4365-4fa0-bdf3-b76b25056dac None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:07.540079 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf112b-4365-4fa0-bdf3-b76b25056dac None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:07.540452 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf112b-4365-4fa0-bdf3-b76b25056dac None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:07.541268 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf112b-4365-4fa0-bdf3-b76b25056dac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:07.541688 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf112b-4365-4fa0-bdf3-b76b25056dac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:07.543349 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf112b-4365-4fa0-bdf3-b76b25056dac None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:07.561555 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 345/678] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:14:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:07.562819 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf112b-4365-4fa0-bdf3-b76b25056dac None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:07.619114 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae10dc-647b-4f69-b5b6-de129139fa68 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:07.641610 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:07.661176 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d50422-226f-4249-be3b-4a6a8c093a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:07.662264 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d50422-226f-4249-be3b-4a6a8c093a9d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:07.662800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d50422-226f-4249-be3b-4a6a8c093a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:07.663284 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d50422-226f-4249-be3b-4a6a8c093a9d None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:07.664223 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d50422-226f-4249-be3b-4a6a8c093a9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:07.664876 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d50422-226f-4249-be3b-4a6a8c093a9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:07.666586 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d50422-226f-4249-be3b-4a6a8c093a9d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:07.677523 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf112b-4365-4fa0-bdf3-b76b25056dac None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:07.685673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 334/679] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:07.686962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d50422-226f-4249-be3b-4a6a8c093a9d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:07.720004 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfc79e-f6d7-4cdd-998b-3f3ac98c1d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:07.720534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfc79e-f6d7-4cdd-998b-3f3ac98c1d23 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:07.720814 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfc79e-f6d7-4cdd-998b-3f3ac98c1d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:07.721085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfc79e-f6d7-4cdd-998b-3f3ac98c1d23 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:07.722010 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfc79e-f6d7-4cdd-998b-3f3ac98c1d23 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:07.722315 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfc79e-f6d7-4cdd-998b-3f3ac98c1d23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:07.724364 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfc79e-f6d7-4cdd-998b-3f3ac98c1d23 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:07.740956 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:07.757473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 346/680] 10.222.0.94 () {56 vars in 1135 bytes} [Thu Sep 1 17:14:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:07.759676 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfc79e-f6d7-4cdd-998b-3f3ac98c1d23 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:07.855214 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d50422-226f-4249-be3b-4a6a8c093a9d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:07.932083 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfc79e-f6d7-4cdd-998b-3f3ac98c1d23 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:07.945434 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11822ab-6480-4e32-9e64-e44cd2ac0030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:07.945434 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11822ab-6480-4e32-9e64-e44cd2ac0030 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:07.945434 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11822ab-6480-4e32-9e64-e44cd2ac0030 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:07.945434 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11822ab-6480-4e32-9e64-e44cd2ac0030 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:07.945827 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11822ab-6480-4e32-9e64-e44cd2ac0030 None admin] RBAC: Adding query filter params (role.id=e903cb11e2bf466fa1b3fae894847c3e, scope.project.id=c8f9428f37354c82ac52b6b8eccc424a, user.id=8b7fa3c4c5d94b3c9b7f17dde35d39a0) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:07.945827 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11822ab-6480-4e32-9e64-e44cd2ac0030 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:07.947076 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11822ab-6480-4e32-9e64-e44cd2ac0030 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:07.963393 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:07.969606 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 335/681] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:14:07 2022] GET /identity/v3/role_assignments?user.id=8b7fa3c4c5d94b3c9b7f17dde35d39a0&scope.project.id=c8f9428f37354c82ac52b6b8eccc424a&role.id=e903cb11e2bf466fa1b3fae894847c3e => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:07.969606 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11822ab-6480-4e32-9e64-e44cd2ac0030 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:08.002332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178c780-4336-43d3-97ad-a6411b289ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:08.003354 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178c780-4336-43d3-97ad-a6411b289ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:08.004046 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178c780-4336-43d3-97ad-a6411b289ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:08.004529 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178c780-4336-43d3-97ad-a6411b289ab3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:08.027544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178c780-4336-43d3-97ad-a6411b289ab3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:08.034964 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178c780-4336-43d3-97ad-a6411b289ab3 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:08.071224 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-c178c780-4336-43d3-97ad-a6411b289ab3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:08.071224 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:08.071224 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:08.071224 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:08.071224 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:08.071224 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:08.071224 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:08.071224 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:08.071224 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:08.071224 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:08.071224 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:08.071224 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:08.071224 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:14:08.071224 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:14:08.071224 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:14:08.072201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:14:08.072201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:08.072201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:08.072201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:08.072201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:08.072201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:08.072201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:08.072201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:08.072201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:08.072201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:08.072201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:08.072201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:08.072201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:08.072201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:08.072201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:08.072201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:08.072201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:08.073100 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:14:08.073100 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:14:08.073100 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:14:08.073100 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:14:08.073100 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:14:08.073100 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:14:08.073100 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:08.073100 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:08.076403 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 347/682] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:14:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:08.083552 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178c780-4336-43d3-97ad-a6411b289ab3 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:08.212633 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11822ab-6480-4e32-9e64-e44cd2ac0030 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:08.223239 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:08.275433 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17646a6-194a-4164-a4d3-2fd2792809df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:08.275757 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17646a6-194a-4164-a4d3-2fd2792809df None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:08.276040 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17646a6-194a-4164-a4d3-2fd2792809df None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:08.276611 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17646a6-194a-4164-a4d3-2fd2792809df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:08.284620 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178c780-4336-43d3-97ad-a6411b289ab3 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:08.336518 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207526f-3334-4472-938d-f74baa34ae06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:08.337600 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207526f-3334-4472-938d-f74baa34ae06 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:08.337892 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207526f-3334-4472-938d-f74baa34ae06 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:08.338170 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207526f-3334-4472-938d-f74baa34ae06 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:08.338897 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207526f-3334-4472-938d-f74baa34ae06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:08.339211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207526f-3334-4472-938d-f74baa34ae06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:08.342598 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207526f-3334-4472-938d-f74baa34ae06 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:08.361566 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 348/683] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:14:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:08.362864 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3692d27-a63c-48d6-8cf4-d571d5ba2c7f None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:08.363146 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3692d27-a63c-48d6-8cf4-d571d5ba2c7f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:08.363415 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3692d27-a63c-48d6-8cf4-d571d5ba2c7f None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:08.364894 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 349/684] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:08.370970 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3692d27-a63c-48d6-8cf4-d571d5ba2c7f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:08.377006 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17646a6-194a-4164-a4d3-2fd2792809df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:08.378481 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17646a6-194a-4164-a4d3-2fd2792809df None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:08.445742 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:08.492137 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 336/685] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:14:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:14:08.493299 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da6f40-6f1b-4534-9af8-4b270841e964 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:08.493618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da6f40-6f1b-4534-9af8-4b270841e964 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:08.493888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da6f40-6f1b-4534-9af8-4b270841e964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:08.507946 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:08.512390 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3692d27-a63c-48d6-8cf4-d571d5ba2c7f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:08.513343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-38da6f40-6f1b-4534-9af8-4b270841e964 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:08.514607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-38da6f40-6f1b-4534-9af8-4b270841e964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:08.564373 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b3f5d-dc3d-4de5-91da-32ecee07a00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:08.565328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b3f5d-dc3d-4de5-91da-32ecee07a00d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:08.566046 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b3f5d-dc3d-4de5-91da-32ecee07a00d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:08.566667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b3f5d-dc3d-4de5-91da-32ecee07a00d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:08.567630 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b3f5d-dc3d-4de5-91da-32ecee07a00d None admin] RBAC: Adding query filter params (role.id=e903cb11e2bf466fa1b3fae894847c3e, scope.project.id=c8f9428f37354c82ac52b6b8eccc424a, user.id=92edc2953b8e4e42aa64569335acfc9f) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:08.568121 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b3f5d-dc3d-4de5-91da-32ecee07a00d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:08.570982 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b3f5d-dc3d-4de5-91da-32ecee07a00d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:08.585752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 350/686] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:14:08 2022] GET /identity/v3/role_assignments?user.id=92edc2953b8e4e42aa64569335acfc9f&scope.project.id=c8f9428f37354c82ac52b6b8eccc424a&role.id=e903cb11e2bf466fa1b3fae894847c3e => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:08.586995 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b3f5d-dc3d-4de5-91da-32ecee07a00d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:08.593445 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 337/687] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:14:08.715737 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b3f5d-dc3d-4de5-91da-32ecee07a00d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:08.733091 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:08.756962 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869dc97-c1c4-439a-aa86-8178ce27d57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:08.757998 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869dc97-c1c4-439a-aa86-8178ce27d57e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:08.758549 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869dc97-c1c4-439a-aa86-8178ce27d57e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:08.759008 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869dc97-c1c4-439a-aa86-8178ce27d57e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:08.771280 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869dc97-c1c4-439a-aa86-8178ce27d57e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:08.773036 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869dc97-c1c4-439a-aa86-8178ce27d57e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:08.788988 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-5869dc97-c1c4-439a-aa86-8178ce27d57e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:08.788988 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:08.788988 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:08.788988 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:08.788988 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:08.788988 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:08.788988 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:08.788988 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:08.788988 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:08.788988 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:08.788988 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:08.788988 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:08.788988 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:08.788988 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:08.788988 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:08.788988 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:08.790028 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:08.790028 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:08.790028 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:08.790028 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:08.790028 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:08.790028 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:08.790028 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:08.790028 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:08.790028 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:08.790028 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:08.790028 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:08.790028 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:08.790028 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:08.790028 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:08.790028 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:08.790028 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:08.790028 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:08.790965 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:08.790965 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:08.790965 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:08.792752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 351/688] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:08.798660 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da6f40-6f1b-4534-9af8-4b270841e964 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:08.881777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869dc97-c1c4-439a-aa86-8178ce27d57e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:08.920940 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da6f40-6f1b-4534-9af8-4b270841e964 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:08.958135 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b392ca3-f25a-4689-bc23-f5a1fa81f83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:08.958552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b392ca3-f25a-4689-bc23-f5a1fa81f83e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:08.958824 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b392ca3-f25a-4689-bc23-f5a1fa81f83e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:08.959089 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b392ca3-f25a-4689-bc23-f5a1fa81f83e None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:08.959780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b392ca3-f25a-4689-bc23-f5a1fa81f83e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:08.960018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b392ca3-f25a-4689-bc23-f5a1fa81f83e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:08.961375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b392ca3-f25a-4689-bc23-f5a1fa81f83e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:08.963824 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:08.975135 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 338/689] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:08.980986 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b392ca3-f25a-4689-bc23-f5a1fa81f83e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:09.005756 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869dc97-c1c4-439a-aa86-8178ce27d57e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:09.045943 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa26e0d-9764-4aec-8551-6ffe1b63107a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:09.047332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa26e0d-9764-4aec-8551-6ffe1b63107a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:09.047845 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa26e0d-9764-4aec-8551-6ffe1b63107a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:09.048270 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa26e0d-9764-4aec-8551-6ffe1b63107a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:09.049167 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa26e0d-9764-4aec-8551-6ffe1b63107a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:09.051068 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa26e0d-9764-4aec-8551-6ffe1b63107a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:09.065174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-4aa26e0d-9764-4aec-8551-6ffe1b63107a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 17:14:09.065174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:09.065174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:14:09.065174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:14:09.065174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:14:09.065174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:14:09.065174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:14:09.065174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:09.065174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 17:14:09.065174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:09.065174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:14:09.065174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:09.065174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:09.065174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:09.065174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:09.065174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:09.065174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:09.066511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:09.066511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:09.066511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:09.066511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:09.066511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:09.066511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:09.066511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:14:09.066511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:14:09.066511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:14:09.066511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:14:09.066511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:09.066511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:09.066511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:09.066511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:09.066511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:09.066511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:09.067481 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:09.067481 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:09.067481 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:09.067481 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:09.067481 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:09.067481 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:09.067481 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:09.067481 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:09.067481 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:09.067481 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:09.067481 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:14:09.067481 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:09.067481 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 17:14:09.067481 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:09.070125 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 352/690] 10.222.0.94 () {56 vars in 1129 bytes} [Thu Sep 1 17:14:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:14:09.076511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa26e0d-9764-4aec-8551-6ffe1b63107a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:09.106935 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b392ca3-f25a-4689-bc23-f5a1fa81f83e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:09.139234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:09.148832 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8014a6-8946-4cfc-b890-91cbab2d4c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:09.149511 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8014a6-8946-4cfc-b890-91cbab2d4c88 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:09.149780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8014a6-8946-4cfc-b890-91cbab2d4c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:09.150050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8014a6-8946-4cfc-b890-91cbab2d4c88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:09.158351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8014a6-8946-4cfc-b890-91cbab2d4c88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:09.159798 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8014a6-8946-4cfc-b890-91cbab2d4c88 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:09.172094 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-8b8014a6-8946-4cfc-b890-91cbab2d4c88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:09.172094 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:09.172094 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:09.172094 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:09.172094 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:09.172094 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:09.172094 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:09.172094 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:09.172094 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:09.172094 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:09.172094 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:09.172094 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:09.172094 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:14:09.172094 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:14:09.172094 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:14:09.173031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:14:09.173031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:09.173031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:09.173031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:09.173031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:09.173031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:09.173031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:09.173031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:09.173031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:09.173031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:09.173031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:09.173031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:09.173031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:09.173031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:09.173031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:09.173031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:09.173031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:09.173984 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:14:09.173984 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:14:09.173984 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:14:09.173984 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:14:09.173984 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:14:09.173984 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:14:09.173984 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:09.173984 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:09.173984 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 339/691] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:14:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:09.179087 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8014a6-8946-4cfc-b890-91cbab2d4c88 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:09.188986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa26e0d-9764-4aec-8551-6ffe1b63107a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:09.232736 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155c65c-d4e0-4cdd-a9df-5fe547f318c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:09.233761 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155c65c-d4e0-4cdd-a9df-5fe547f318c7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:09.234282 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155c65c-d4e0-4cdd-a9df-5fe547f318c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:09.234765 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155c65c-d4e0-4cdd-a9df-5fe547f318c7 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:09.235627 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155c65c-d4e0-4cdd-a9df-5fe547f318c7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:09.236191 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155c65c-d4e0-4cdd-a9df-5fe547f318c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:09.237873 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155c65c-d4e0-4cdd-a9df-5fe547f318c7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:09.242931 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 353/692] 10.222.0.94 () {56 vars in 1124 bytes} [Thu Sep 1 17:14:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:09.250568 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155c65c-d4e0-4cdd-a9df-5fe547f318c7 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:09.306577 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:09.359672 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8014a6-8946-4cfc-b890-91cbab2d4c88 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:09.387586 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:09.395949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155c65c-d4e0-4cdd-a9df-5fe547f318c7 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:09.396887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55671bec-5d41-4f21-b202-c57e28c854df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:09.397532 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55671bec-5d41-4f21-b202-c57e28c854df None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:09.397817 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55671bec-5d41-4f21-b202-c57e28c854df None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:09.398090 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55671bec-5d41-4f21-b202-c57e28c854df None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:09.398961 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55671bec-5d41-4f21-b202-c57e28c854df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:09.399267 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55671bec-5d41-4f21-b202-c57e28c854df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:09.401550 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55671bec-5d41-4f21-b202-c57e28c854df None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:09.417752 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 340/693] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:14:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:09.420981 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c0c30-f8dd-43fd-8914-f71e6b2b5f09 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:09.421606 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c0c30-f8dd-43fd-8914-f71e6b2b5f09 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:09.422083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c0c30-f8dd-43fd-8914-f71e6b2b5f09 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:09.424620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 341/694] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:09.425535 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c0c30-f8dd-43fd-8914-f71e6b2b5f09 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:09.448353 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df95e0c-bd29-4739-963c-80310d3c048c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:09.448994 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df95e0c-bd29-4739-963c-80310d3c048c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:09.449827 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df95e0c-bd29-4739-963c-80310d3c048c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:09.450109 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df95e0c-bd29-4739-963c-80310d3c048c None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:09.451078 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df95e0c-bd29-4739-963c-80310d3c048c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:09.451394 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df95e0c-bd29-4739-963c-80310d3c048c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:09.453592 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df95e0c-bd29-4739-963c-80310d3c048c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:09.460729 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 354/695] 10.222.0.94 () {56 vars in 1124 bytes} [Thu Sep 1 17:14:09 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:09.462714 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99fcff-37af-4665-b81c-26e53835d968 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:09.463010 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99fcff-37af-4665-b81c-26e53835d968 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:09.463295 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99fcff-37af-4665-b81c-26e53835d968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:09.500589 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1e99fcff-37af-4665-b81c-26e53835d968 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:09.501879 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1e99fcff-37af-4665-b81c-26e53835d968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:09.607781 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c0c30-f8dd-43fd-8914-f71e6b2b5f09 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:09.645540 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:09.667405 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 355/696] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:14:09.674229 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51678c-1172-4133-91fb-9812bef3e49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:09.674845 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51678c-1172-4133-91fb-9812bef3e49e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:09.675122 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51678c-1172-4133-91fb-9812bef3e49e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:09.675397 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51678c-1172-4133-91fb-9812bef3e49e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:09.676122 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51678c-1172-4133-91fb-9812bef3e49e None admin] RBAC: Adding query filter params (role.id=e903cb11e2bf466fa1b3fae894847c3e, scope.project.id=c8f9428f37354c82ac52b6b8eccc424a, user.id=af7ebf43f36c4862a3c527941e033666) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:09.676432 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51678c-1172-4133-91fb-9812bef3e49e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:09.677980 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51678c-1172-4133-91fb-9812bef3e49e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:09.684271 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 342/697] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:14:09 2022] GET /identity/v3/role_assignments?user.id=af7ebf43f36c4862a3c527941e033666&scope.project.id=c8f9428f37354c82ac52b6b8eccc424a&role.id=e903cb11e2bf466fa1b3fae894847c3e => generated 608 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:10.009781 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99fcff-37af-4665-b81c-26e53835d968 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:10.105057 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:10.118200 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99fcff-37af-4665-b81c-26e53835d968 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:10.158783 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e71e73-2607-4152-b6d8-7a95c751a448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:10.159420 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e71e73-2607-4152-b6d8-7a95c751a448 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:10.159695 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e71e73-2607-4152-b6d8-7a95c751a448 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:10.159957 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e71e73-2607-4152-b6d8-7a95c751a448 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:10.171171 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e71e73-2607-4152-b6d8-7a95c751a448 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:10.172636 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e71e73-2607-4152-b6d8-7a95c751a448 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:10.187378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-d4e71e73-2607-4152-b6d8-7a95c751a448 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:10.187378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:10.187378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:10.187378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:10.187378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:10.187378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:10.187378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:10.187378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:10.187378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:10.187378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:10.187378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:10.187378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:10.187378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:10.187378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:10.187378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:10.187378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:10.188350 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:10.188350 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:10.188350 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:10.188350 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:10.188350 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:10.188350 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:10.188350 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:10.188350 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:10.188350 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:10.188350 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:10.188350 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:10.188350 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:10.188350 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:10.188350 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:10.188350 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:10.188350 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:10.188350 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:10.189874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:10.189874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:10.189874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:10.189874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 356/698] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:10.194567 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51678c-1172-4133-91fb-9812bef3e49e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:10.298452 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51678c-1172-4133-91fb-9812bef3e49e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:10.342330 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b03b9-f463-4770-afd5-418b89caf91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:10.342964 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b03b9-f463-4770-afd5-418b89caf91b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:10.343212 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b03b9-f463-4770-afd5-418b89caf91b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:10.343454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b03b9-f463-4770-afd5-418b89caf91b None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:10.344092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b03b9-f463-4770-afd5-418b89caf91b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:10.344388 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b03b9-f463-4770-afd5-418b89caf91b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:10.345770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b03b9-f463-4770-afd5-418b89caf91b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:10.360893 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 343/699] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:10.366641 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e71e73-2607-4152-b6d8-7a95c751a448 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:10.433438 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e60ea5-f237-47b6-b252-32358581f082 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:10.433778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e60ea5-f237-47b6-b252-32358581f082 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:10.434073 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e60ea5-f237-47b6-b252-32358581f082 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:10.436126 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 344/700] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:10.441719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f12ca5-8b5e-42f7-b55e-9a0612980d9a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:10.442013 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f12ca5-8b5e-42f7-b55e-9a0612980d9a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:10.442292 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f12ca5-8b5e-42f7-b55e-9a0612980d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:10.470301 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e71e73-2607-4152-b6d8-7a95c751a448 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:10.478545 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e3f12ca5-8b5e-42f7-b55e-9a0612980d9a None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:10.479781 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e3f12ca5-8b5e-42f7-b55e-9a0612980d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:10.504913 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de7ce7-c1f0-4ca7-a49b-c5933c4cec07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:10.505549 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de7ce7-c1f0-4ca7-a49b-c5933c4cec07 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:10.505826 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de7ce7-c1f0-4ca7-a49b-c5933c4cec07 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:10.506092 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de7ce7-c1f0-4ca7-a49b-c5933c4cec07 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:10.506752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de7ce7-c1f0-4ca7-a49b-c5933c4cec07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:10.508182 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de7ce7-c1f0-4ca7-a49b-c5933c4cec07 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:10.521224 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:10.542163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 357/701] 10.222.0.94 () {60 vars in 1132 bytes} [Thu Sep 1 17:14:10 2022] POST /identity/v3/users => generated 254 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:14:10.554766 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:10.607657 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 345/702] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:14:10.952012 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de7ce7-c1f0-4ca7-a49b-c5933c4cec07 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:11.058678 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de7ce7-c1f0-4ca7-a49b-c5933c4cec07 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:11.103274 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b321f-61f4-4f22-8843-202cc224b7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:11.103907 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b321f-61f4-4f22-8843-202cc224b7bc None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:11.104181 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b321f-61f4-4f22-8843-202cc224b7bc None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:11.104453 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b321f-61f4-4f22-8843-202cc224b7bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:11.115541 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b321f-61f4-4f22-8843-202cc224b7bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:14:11.121033 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-7f2b321f-61f4-4f22-8843-202cc224b7bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:14:11.121033 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:11.121033 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:11.121033 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:11.121033 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:11.121033 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:11.121033 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:11.121033 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:11.121033 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:11.121033 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:11.121033 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:11.121033 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:11.121033 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:14:11.121033 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:14:11.121033 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:14:11.121033 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:14:11.122058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:14:11.122058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:14:11.122058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:14:11.122058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:14:11.122058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:11.122058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:11.122058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:11.122058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:11.122058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:11.122058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:11.122058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:11.122058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:11.122058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:11.122058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:11.122058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:11.122058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:11.124155 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:11.124155 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:11.124155 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:11.124155 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:11.124155 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:14:11.124155 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:14:11.124155 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:14:11.124155 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:14:11.124155 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:14:11.124155 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:14:11.124155 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:14:11.124155 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:11.124155 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 358/703] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:14:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:11.128654 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f12ca5-8b5e-42f7-b55e-9a0612980d9a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:11.230402 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f12ca5-8b5e-42f7-b55e-9a0612980d9a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:11.266321 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5573dd6-3659-4687-9f0d-1bb1c64c1857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:11.266931 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5573dd6-3659-4687-9f0d-1bb1c64c1857 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:11.267205 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5573dd6-3659-4687-9f0d-1bb1c64c1857 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:11.267471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5573dd6-3659-4687-9f0d-1bb1c64c1857 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:11.269192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd063f2-e28b-4edf-87ed-ea399d2aa82e None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:11.269488 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd063f2-e28b-4edf-87ed-ea399d2aa82e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:11.270085 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5573dd6-3659-4687-9f0d-1bb1c64c1857 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:11.270362 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd063f2-e28b-4edf-87ed-ea399d2aa82e None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:11.270467 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5573dd6-3659-4687-9f0d-1bb1c64c1857 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:11.271778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5573dd6-3659-4687-9f0d-1bb1c64c1857 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:11.272525 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 359/704] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:14:11.278401 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e3a43-cded-4e07-b794-fb08610fa9ed None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:11.279460 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e3a43-cded-4e07-b794-fb08610fa9ed None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:11.279953 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e3a43-cded-4e07-b794-fb08610fa9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:11.286736 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 346/705] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:14:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:11.292297 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5573dd6-3659-4687-9f0d-1bb1c64c1857 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:11.301302 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-275e3a43-cded-4e07-b794-fb08610fa9ed None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:11.302764 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-275e3a43-cded-4e07-b794-fb08610fa9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:11.359692 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:11.373793 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:11.410801 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 360/706] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:14:11.450414 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5573dd6-3659-4687-9f0d-1bb1c64c1857 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:11.492545 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cb316-812c-4aa6-94ee-a48bb4e7e0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:11.493136 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cb316-812c-4aa6-94ee-a48bb4e7e0f2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:11.493426 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cb316-812c-4aa6-94ee-a48bb4e7e0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:11.493710 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cb316-812c-4aa6-94ee-a48bb4e7e0f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:11.508903 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9cb316-812c-4aa6-94ee-a48bb4e7e0f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:11.510362 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9cb316-812c-4aa6-94ee-a48bb4e7e0f2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:11.530496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-ea9cb316-812c-4aa6-94ee-a48bb4e7e0f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:11.530496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:11.530496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:11.530496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:11.530496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:11.530496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:11.530496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:11.530496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:11.530496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:11.530496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:11.530496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:11.530496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:11.530496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:11.530496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:11.530496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:11.530496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:11.531488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:11.531488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:11.531488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:11.531488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:11.531488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:11.531488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:11.531488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:11.531488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:11.531488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:11.531488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:11.531488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:11.531488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:11.531488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:11.531488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:11.531488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:11.531488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:11.531488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:11.532404 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:11.532404 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:11.532404 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:11.532404 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 347/707] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:11.535938 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e3a43-cded-4e07-b794-fb08610fa9ed None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:11.659946 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e3a43-cded-4e07-b794-fb08610fa9ed None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:11.696973 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86c2e6-4139-4c3e-993b-c933df4bdfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:11.697976 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86c2e6-4139-4c3e-993b-c933df4bdfb2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:11.698463 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86c2e6-4139-4c3e-993b-c933df4bdfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:11.698955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86c2e6-4139-4c3e-993b-c933df4bdfb2 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:11.699815 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86c2e6-4139-4c3e-993b-c933df4bdfb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:11.700342 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86c2e6-4139-4c3e-993b-c933df4bdfb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:11.702007 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86c2e6-4139-4c3e-993b-c933df4bdfb2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:11.718474 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 361/708] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:11.723879 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cb316-812c-4aa6-94ee-a48bb4e7e0f2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:11.786984 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86c2e6-4139-4c3e-993b-c933df4bdfb2 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:11.867985 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:11.876683 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:11.899924 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cb316-812c-4aa6-94ee-a48bb4e7e0f2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:11.943861 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86c2e6-4139-4c3e-993b-c933df4bdfb2 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:11.944106 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84937529-0b21-4106-af8e-d92059be0e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:11.944758 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84937529-0b21-4106-af8e-d92059be0e7f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:11.945018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84937529-0b21-4106-af8e-d92059be0e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:11.945282 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84937529-0b21-4106-af8e-d92059be0e7f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:11.956936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84937529-0b21-4106-af8e-d92059be0e7f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:11.958669 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84937529-0b21-4106-af8e-d92059be0e7f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:11.974358 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-84937529-0b21-4106-af8e-d92059be0e7f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:14:11.974358 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:11.974358 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:11.974358 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:11.974358 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:11.974358 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:11.974358 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:11.974358 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:11.974358 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:11.974358 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:11.974358 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:11.974358 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:11.974358 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:14:11.974358 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:14:11.974358 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:14:11.974358 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:14:11.975542 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:11.975542 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:11.975542 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:14:11.975542 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:11.975542 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:14:11.975542 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:11.975542 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:11.975542 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:11.975542 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:11.975542 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:11.975542 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:11.975542 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:11.975542 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:11.975542 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:11.975542 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:11.975542 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:11.975542 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:11.975542 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:11.976839 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:11.976839 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:11.976839 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:14:11.976839 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:14:11.976839 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:14:11.976839 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:14:11.976839 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:14:11.976839 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:14:11.976839 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:14:11.976839 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:11.976839 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 348/709] 10.222.0.94 () {56 vars in 1093 bytes} [Thu Sep 1 17:14:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:11.977484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ef21e-8952-4afd-b311-4f7cc53351b8 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:11.977484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ef21e-8952-4afd-b311-4f7cc53351b8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:11.977625 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ef21e-8952-4afd-b311-4f7cc53351b8 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:11.978792 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 349/710] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:11.983040 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ef21e-8952-4afd-b311-4f7cc53351b8 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:11.988156 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ce6f4-3510-4671-b096-718c6d07c66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:11.988790 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ce6f4-3510-4671-b096-718c6d07c66e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:11.989064 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ce6f4-3510-4671-b096-718c6d07c66e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:11.989331 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ce6f4-3510-4671-b096-718c6d07c66e None admin] PATH_INFO: `/v3/services/network` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:11.989943 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ce6f4-3510-4671-b096-718c6d07c66e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:11.991310 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ce6f4-3510-4671-b096-718c6d07c66e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:12.000883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-a56ce6f4-3510-4671-b096-718c6d07c66e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 17:14:12.000883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:12.000883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:14:12.000883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:14:12.000883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:14:12.000883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:14:12.000883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:14:12.000883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:12.000883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 17:14:12.000883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:12.000883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:14:12.000883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:12.000883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:12.000883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:12.000883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:12.000883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:12.000883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:12.002110 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:12.002110 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:12.002110 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:12.002110 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:12.002110 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:12.002110 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:12.002110 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:14:12.002110 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:14:12.002110 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:14:12.002110 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:14:12.002110 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:12.002110 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:12.002110 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:12.002110 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:12.002110 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:12.002110 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:12.003172 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:12.003172 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:12.003172 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:12.003172 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:12.003172 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:12.003172 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:12.003172 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:12.003172 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:12.003172 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:12.003172 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:12.003172 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:14:12.003172 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:12.003172 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 17:14:12.003172 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:12.005534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 362/711] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:14:11 2022] GET /identity/v3/services/network => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:12.006812 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092e52d-7e17-45f2-a2e6-3b54e91db11d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:12.007252 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092e52d-7e17-45f2-a2e6-3b54e91db11d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:12.007673 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092e52d-7e17-45f2-a2e6-3b54e91db11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:12.026354 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b092e52d-7e17-45f2-a2e6-3b54e91db11d None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:12.027517 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b092e52d-7e17-45f2-a2e6-3b54e91db11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:12.104370 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ef21e-8952-4afd-b311-4f7cc53351b8 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:12.117860 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 363/712] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:14:12.119355 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092e52d-7e17-45f2-a2e6-3b54e91db11d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:12.166974 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5d748-1c05-43f1-84f8-e16c5dd47d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:12.167569 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5d748-1c05-43f1-84f8-e16c5dd47d3e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:12.167845 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5d748-1c05-43f1-84f8-e16c5dd47d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:12.168110 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5d748-1c05-43f1-84f8-e16c5dd47d3e None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:12.168835 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5d748-1c05-43f1-84f8-e16c5dd47d3e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:12.169171 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5d748-1c05-43f1-84f8-e16c5dd47d3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:12.170621 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5d748-1c05-43f1-84f8-e16c5dd47d3e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:12.190471 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:12.203172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 350/713] 10.222.0.94 () {56 vars in 1133 bytes} [Thu Sep 1 17:14:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:12.206013 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5d748-1c05-43f1-84f8-e16c5dd47d3e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:12.210640 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:12.300404 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092e52d-7e17-45f2-a2e6-3b54e91db11d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:12.337706 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c8b51-3460-4e8d-888d-d0250aa42cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:12.338415 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c8b51-3460-4e8d-888d-d0250aa42cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:12.338709 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c8b51-3460-4e8d-888d-d0250aa42cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:12.338983 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c8b51-3460-4e8d-888d-d0250aa42cb9 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:12.339732 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c8b51-3460-4e8d-888d-d0250aa42cb9 None admin] RBAC: Adding query filter params (name=network) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:12.340042 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c8b51-3460-4e8d-888d-d0250aa42cb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:12.341480 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c8b51-3460-4e8d-888d-d0250aa42cb9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:12.347176 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 364/714] 10.222.0.94 () {56 vars in 1112 bytes} [Thu Sep 1 17:14:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:12.348348 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104a431-7a9a-4183-855b-c28e96136e86 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:12.348632 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104a431-7a9a-4183-855b-c28e96136e86 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:12.348906 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104a431-7a9a-4183-855b-c28e96136e86 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:12.349302 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5d748-1c05-43f1-84f8-e16c5dd47d3e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:12.354260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 365/715] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:12.355104 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104a431-7a9a-4183-855b-c28e96136e86 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:12.390353 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea97dd-5a4f-46cd-9c72-f792ca492d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:12.390953 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea97dd-5a4f-46cd-9c72-f792ca492d32 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:12.391227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea97dd-5a4f-46cd-9c72-f792ca492d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:12.391495 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea97dd-5a4f-46cd-9c72-f792ca492d32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:12.465364 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea97dd-5a4f-46cd-9c72-f792ca492d32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:12.467419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea97dd-5a4f-46cd-9c72-f792ca492d32 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:12.469323 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:12.486066 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104a431-7a9a-4183-855b-c28e96136e86 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:12.489173 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:12.522004 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac676ca-68ed-49eb-ac41-5faad13ee1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:12.522606 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac676ca-68ed-49eb-ac41-5faad13ee1d5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:12.522882 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac676ca-68ed-49eb-ac41-5faad13ee1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:12.523146 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac676ca-68ed-49eb-ac41-5faad13ee1d5 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:12.523778 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac676ca-68ed-49eb-ac41-5faad13ee1d5 None admin] RBAC: Adding query filter params (type=network) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:12.524079 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac676ca-68ed-49eb-ac41-5faad13ee1d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:12.525466 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac676ca-68ed-49eb-ac41-5faad13ee1d5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:12.541623 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 366/716] 10.222.0.94 () {56 vars in 1112 bytes} [Thu Sep 1 17:14:12 2022] GET /identity/v3/services?type=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:12.544968 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6aebb-a065-4fbf-a649-347020137d0c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:12.545616 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6aebb-a065-4fbf-a649-347020137d0c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:12.546377 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6aebb-a065-4fbf-a649-347020137d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:12.575041 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-cbb6aebb-a065-4fbf-a649-347020137d0c None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:12.578357 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cbb6aebb-a065-4fbf-a649-347020137d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:12.593092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 351/717] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:14:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:14:12.594285 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea97dd-5a4f-46cd-9c72-f792ca492d32 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:12.669010 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 367/718] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:14:12.670659 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6aebb-a065-4fbf-a649-347020137d0c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:12.725092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea97dd-5a4f-46cd-9c72-f792ca492d32 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:12.727366 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:12.769500 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9537c3-e9cb-4288-a948-1768fb5b0e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:12.770874 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9537c3-e9cb-4288-a948-1768fb5b0e7f None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:12.771341 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9537c3-e9cb-4288-a948-1768fb5b0e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:12.772068 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9537c3-e9cb-4288-a948-1768fb5b0e7f None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:12.772913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9537c3-e9cb-4288-a948-1768fb5b0e7f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:12.775217 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9537c3-e9cb-4288-a948-1768fb5b0e7f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:12.781836 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:12.789425 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6aebb-a065-4fbf-a649-347020137d0c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:12.816986 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 352/719] 10.222.0.94 () {60 vars in 1141 bytes} [Thu Sep 1 17:14:12 2022] POST /identity/v3/services => generated 251 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:14:12.867622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3f8fd-7aa0-4209-9cca-cbb7cf172939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:12.868295 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3f8fd-7aa0-4209-9cca-cbb7cf172939 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:12.868571 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3f8fd-7aa0-4209-9cca-cbb7cf172939 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:12.868840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3f8fd-7aa0-4209-9cca-cbb7cf172939 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:12.889741 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3f8fd-7aa0-4209-9cca-cbb7cf172939 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:12.891242 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3f8fd-7aa0-4209-9cca-cbb7cf172939 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:12.912052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-43b3f8fd-7aa0-4209-9cca-cbb7cf172939 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:12.912052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:12.912052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:12.912052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:12.912052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:12.912052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:12.912052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:12.912052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:12.912052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:12.912052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:12.912052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:12.912052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:12.912052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:12.912052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:12.912052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:12.912052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:12.913147 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:12.913147 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:12.913147 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:12.913147 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:12.913147 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:12.913147 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:12.913147 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:12.913147 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:12.913147 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:12.913147 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:12.913147 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:12.913147 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:12.913147 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:12.913147 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:12.913147 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:12.913147 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:12.913147 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:12.914088 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:12.914088 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:12.914088 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:12.914088 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 368/720] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:12.918814 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9537c3-e9cb-4288-a948-1768fb5b0e7f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:12.970134 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3f8fd-7aa0-4209-9cca-cbb7cf172939 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:13.045965 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9537c3-e9cb-4288-a948-1768fb5b0e7f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:13.076294 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3f8fd-7aa0-4209-9cca-cbb7cf172939 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:13.084581 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa926e1-cafc-4007-8746-0fa104ac3b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:13.085193 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa926e1-cafc-4007-8746-0fa104ac3b00 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:13.085499 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa926e1-cafc-4007-8746-0fa104ac3b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:13.085770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa926e1-cafc-4007-8746-0fa104ac3b00 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:13.086537 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa926e1-cafc-4007-8746-0fa104ac3b00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:13.086890 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa926e1-cafc-4007-8746-0fa104ac3b00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:13.088365 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa926e1-cafc-4007-8746-0fa104ac3b00 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:13.102148 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 353/721] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:13.109468 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa926e1-cafc-4007-8746-0fa104ac3b00 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:13.116415 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5643d-5593-45ba-b8c9-b54b698929fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:13.117258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5643d-5593-45ba-b8c9-b54b698929fe None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:13.117737 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5643d-5593-45ba-b8c9-b54b698929fe None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:13.118182 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5643d-5593-45ba-b8c9-b54b698929fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:13.130062 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5643d-5593-45ba-b8c9-b54b698929fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:14:13.135667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-98b5643d-5593-45ba-b8c9-b54b698929fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:14:13.135667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:13.135667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:13.135667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:13.135667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:13.135667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:13.135667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:13.135667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:13.135667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:13.135667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:13.135667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:13.135667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:13.135667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:14:13.135667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:14:13.135667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:14:13.135667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:14:13.136842 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:14:13.136842 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:14:13.136842 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:14:13.136842 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:14:13.136842 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:13.136842 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:13.136842 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:13.136842 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:13.136842 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:13.136842 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:13.136842 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:13.136842 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:13.136842 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:13.136842 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:13.136842 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:13.136842 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:13.137995 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:13.137995 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:13.137995 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:13.137995 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:13.137995 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:14:13.137995 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:14:13.137995 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:14:13.137995 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:14:13.137995 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:14:13.137995 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:14:13.137995 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:14:13.137995 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:13.140294 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 369/722] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:14:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:14:13.143924 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:13.146377 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5643d-5593-45ba-b8c9-b54b698929fe None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:13.161301 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:13.245192 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa926e1-cafc-4007-8746-0fa104ac3b00 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:13.275932 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5643d-5593-45ba-b8c9-b54b698929fe None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:13.285759 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3dbf68-d0f9-492d-8465-09f9b9a73550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:13.287080 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3dbf68-d0f9-492d-8465-09f9b9a73550 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:13.287871 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3dbf68-d0f9-492d-8465-09f9b9a73550 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:13.288351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3dbf68-d0f9-492d-8465-09f9b9a73550 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:13.297912 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3dbf68-d0f9-492d-8465-09f9b9a73550 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:13.300077 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3dbf68-d0f9-492d-8465-09f9b9a73550 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:13.311134 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5d586-4d67-4ed7-b5fb-08fcb2fe2852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:13.311750 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5d586-4d67-4ed7-b5fb-08fcb2fe2852 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:13.312035 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5d586-4d67-4ed7-b5fb-08fcb2fe2852 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:13.312308 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5d586-4d67-4ed7-b5fb-08fcb2fe2852 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:13.312978 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5d586-4d67-4ed7-b5fb-08fcb2fe2852 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:13.313279 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5d586-4d67-4ed7-b5fb-08fcb2fe2852 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:13.314699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5d586-4d67-4ed7-b5fb-08fcb2fe2852 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:13.316198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-ec3dbf68-d0f9-492d-8465-09f9b9a73550 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:13.316198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:13.316198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:13.316198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:13.316198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:13.316198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:13.316198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:13.316198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:13.316198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:13.316198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:13.316198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:13.316198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:13.316198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:14:13.316198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:14:13.316198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:14:13.317097 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:14:13.317097 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:13.317097 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:13.317097 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:13.317097 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:13.317097 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:13.317097 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:13.317097 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:13.317097 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:13.317097 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:13.317097 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:13.317097 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:13.317097 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:13.317097 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:13.317097 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:13.317097 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:13.317097 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:13.318042 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:14:13.318042 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:14:13.318042 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:14:13.318042 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:14:13.318042 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:14:13.318042 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:14:13.318042 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:13.318042 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:13.324167 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 354/723] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:14:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:14:13.324167 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508168d-cdc1-4c9d-876d-91201187c584 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:13.324167 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508168d-cdc1-4c9d-876d-91201187c584 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:13.324167 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508168d-cdc1-4c9d-876d-91201187c584 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:13.325081 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 355/724] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:13.326583 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508168d-cdc1-4c9d-876d-91201187c584 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:13.329611 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 370/725] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:14:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:13.331616 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a1bf2-ed03-416c-b99a-3a13d738b887 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:13.331903 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a1bf2-ed03-416c-b99a-3a13d738b887 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:13.332178 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a1bf2-ed03-416c-b99a-3a13d738b887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:13.351614 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-440a1bf2-ed03-416c-b99a-3a13d738b887 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:13.352941 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-440a1bf2-ed03-416c-b99a-3a13d738b887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:13.423184 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:13.427842 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:13.431674 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 371/726] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:13 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:14:13.432787 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a1bf2-ed03-416c-b99a-3a13d738b887 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:13.467668 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508168d-cdc1-4c9d-876d-91201187c584 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:13.532479 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d817385-1bd0-4407-aa61-55c00d2c2433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:13.533442 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d817385-1bd0-4407-aa61-55c00d2c2433 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:13.533966 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d817385-1bd0-4407-aa61-55c00d2c2433 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:13.534442 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d817385-1bd0-4407-aa61-55c00d2c2433 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:13.536195 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d817385-1bd0-4407-aa61-55c00d2c2433 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:13.537255 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d817385-1bd0-4407-aa61-55c00d2c2433 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:13.539801 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d817385-1bd0-4407-aa61-55c00d2c2433 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:13.569831 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 356/727] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:14:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:13.571057 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d817385-1bd0-4407-aa61-55c00d2c2433 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:13.620803 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a1bf2-ed03-416c-b99a-3a13d738b887 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:13.691820 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c5488-24bb-444f-891e-33b08e322726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:13.692469 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c5488-24bb-444f-891e-33b08e322726 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:13.692745 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c5488-24bb-444f-891e-33b08e322726 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:13.693013 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c5488-24bb-444f-891e-33b08e322726 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:13.720005 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c5488-24bb-444f-891e-33b08e322726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:13.721617 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c5488-24bb-444f-891e-33b08e322726 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:13.749300 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-5c7c5488-24bb-444f-891e-33b08e322726 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:13.749300 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:13.749300 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:13.749300 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:13.749300 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:13.749300 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:13.749300 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:13.749300 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:13.749300 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:13.749300 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:13.749300 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:13.749300 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:13.749300 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:13.749300 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:13.749300 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:13.749300 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:13.750332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:13.750332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:13.750332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:13.750332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:13.750332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:13.750332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:13.750332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:13.750332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:13.750332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:13.750332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:13.750332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:13.750332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:13.750332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:13.750332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:13.750332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:13.750332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:13.750332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:13.751237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:13.751237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:13.751237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:13.757654 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 372/728] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:13.758502 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c5488-24bb-444f-891e-33b08e322726 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:13.763487 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d817385-1bd0-4407-aa61-55c00d2c2433 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:13.801343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06681a5f-af14-4074-9583-910e52bdd513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:13.801901 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06681a5f-af14-4074-9583-910e52bdd513 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:13.802237 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06681a5f-af14-4074-9583-910e52bdd513 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:13.802507 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06681a5f-af14-4074-9583-910e52bdd513 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:13.803283 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06681a5f-af14-4074-9583-910e52bdd513 None admin] RBAC: Adding query filter params (role.id=70f911a75b7b40a19f65857b9d19cfad, scope.project.id=c8f9428f37354c82ac52b6b8eccc424a, user.id=8b7fa3c4c5d94b3c9b7f17dde35d39a0) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:13.803592 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06681a5f-af14-4074-9583-910e52bdd513 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:13.805019 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06681a5f-af14-4074-9583-910e52bdd513 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:13.810865 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 357/729] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:14:13 2022] GET /identity/v3/role_assignments?user.id=8b7fa3c4c5d94b3c9b7f17dde35d39a0&scope.project.id=c8f9428f37354c82ac52b6b8eccc424a&role.id=70f911a75b7b40a19f65857b9d19cfad => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:13.811747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06681a5f-af14-4074-9583-910e52bdd513 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:13.820012 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:13.821437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:13.887670 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c5488-24bb-444f-891e-33b08e322726 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:13.922367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06681a5f-af14-4074-9583-910e52bdd513 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:13.929667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537e0f5-2d18-4528-88aa-88781effeaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:13.930413 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537e0f5-2d18-4528-88aa-88781effeaff None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:13.930698 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537e0f5-2d18-4528-88aa-88781effeaff None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:13.930970 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537e0f5-2d18-4528-88aa-88781effeaff None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:13.943869 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9537e0f5-2d18-4528-88aa-88781effeaff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:14:13.950038 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-9537e0f5-2d18-4528-88aa-88781effeaff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:14:13.950038 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:13.950038 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:13.950038 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:13.950038 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:13.950038 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:13.950038 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:13.950038 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:13.950038 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:13.950038 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:13.950038 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:13.950038 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:13.950038 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:14:13.950038 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:14:13.950038 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:14:13.950038 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:14:13.952202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:14:13.952202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:14:13.952202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:14:13.952202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:14:13.952202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:13.952202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:13.952202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:13.952202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:13.952202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:13.952202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:13.952202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:13.952202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:13.952202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:13.952202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:13.952202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:13.952202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:13.954480 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:13.954480 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:13.954480 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:13.954480 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:13.954480 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:14:13.954480 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:14:13.954480 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:14:13.954480 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:14:13.954480 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:14:13.954480 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:14:13.954480 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:14:13.954480 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:13.956079 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 373/730] 10.222.0.94 () {56 vars in 1102 bytes} [Thu Sep 1 17:14:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:13.961423 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537e0f5-2d18-4528-88aa-88781effeaff None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:13.961640 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d966c-73ea-4dc3-b6ec-1cd5d0688652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:13.961640 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d966c-73ea-4dc3-b6ec-1cd5d0688652 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:13.961640 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d966c-73ea-4dc3-b6ec-1cd5d0688652 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:13.961640 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d966c-73ea-4dc3-b6ec-1cd5d0688652 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:13.962252 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d966c-73ea-4dc3-b6ec-1cd5d0688652 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:13.962397 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d966c-73ea-4dc3-b6ec-1cd5d0688652 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:13.963719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d966c-73ea-4dc3-b6ec-1cd5d0688652 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:13.976945 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 358/731] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:13.986478 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d966c-73ea-4dc3-b6ec-1cd5d0688652 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:14.087127 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537e0f5-2d18-4528-88aa-88781effeaff None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:14.106048 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:14.112495 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:14.153318 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59910198-a235-415f-8519-8879547b1d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:14.154807 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59910198-a235-415f-8519-8879547b1d79 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:14.155071 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59910198-a235-415f-8519-8879547b1d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:14.155344 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59910198-a235-415f-8519-8879547b1d79 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:14.156022 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59910198-a235-415f-8519-8879547b1d79 None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:14.156326 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59910198-a235-415f-8519-8879547b1d79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:14.157734 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59910198-a235-415f-8519-8879547b1d79 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:14.160730 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d966c-73ea-4dc3-b6ec-1cd5d0688652 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:14.182886 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 374/732] 10.222.0.94 () {56 vars in 1103 bytes} [Thu Sep 1 17:14:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:14.185607 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59910198-a235-415f-8519-8879547b1d79 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:14.230024 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898b411-9198-425f-b80e-976d8c44bc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:14.230666 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898b411-9198-425f-b80e-976d8c44bc4c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:14.230945 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898b411-9198-425f-b80e-976d8c44bc4c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:14.231217 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898b411-9198-425f-b80e-976d8c44bc4c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:14.243373 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898b411-9198-425f-b80e-976d8c44bc4c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:14.244831 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898b411-9198-425f-b80e-976d8c44bc4c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:14.269574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-1898b411-9198-425f-b80e-976d8c44bc4c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 17:14:14.269574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:14.269574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:14.269574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:14.269574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:14.269574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:14.269574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:14.269574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:14.269574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:14.269574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:14.269574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:14.269574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:14.269574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:14:14.269574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:14:14.269574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:14:14.269574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:14:14.270612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:14.270612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:14.270612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:14:14.270612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:14.270612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:14:14.270612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:14.270612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:14.270612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:14.270612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:14.270612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:14.270612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:14.270612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:14.270612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:14.270612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:14.270612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:14.270612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:14.270612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:14.270612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:14.271575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:14.271575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:14.271575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:14:14.271575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:14:14.271575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:14:14.271575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:14:14.271575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:14:14.271575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:14:14.271575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 17:14:14.271575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:14.271575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 359/733] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:14:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:14.277085 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898b411-9198-425f-b80e-976d8c44bc4c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:14.390313 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59910198-a235-415f-8519-8879547b1d79 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:14.460480 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6edb2-9c39-4d03-b226-c2da82f42246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:14.461121 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6edb2-9c39-4d03-b226-c2da82f42246 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:14.461418 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6edb2-9c39-4d03-b226-c2da82f42246 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:14.461695 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6edb2-9c39-4d03-b226-c2da82f42246 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:14.482667 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898b411-9198-425f-b80e-976d8c44bc4c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:14.485896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6edb2-9c39-4d03-b226-c2da82f42246 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:14.487366 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6edb2-9c39-4d03-b226-c2da82f42246 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:14.514199 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-30d6edb2-9c39-4d03-b226-c2da82f42246 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:14.514199 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:14.514199 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:14.514199 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:14.514199 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:14.514199 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:14.514199 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:14.514199 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:14.514199 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:14.514199 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:14.514199 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:14.514199 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:14.514199 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:14.514199 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:14.514199 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:14.514199 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:14.516483 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:14.516483 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:14.516483 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:14.516483 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:14.516483 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:14.516483 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:14.516483 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:14.516483 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:14.516483 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:14.516483 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:14.516483 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:14.516483 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:14.516483 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:14.516483 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:14.516483 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:14.516483 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:14.516483 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:14.518653 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:14.518653 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:14.518653 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:14.526646 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 375/734] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:14.530674 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6edb2-9c39-4d03-b226-c2da82f42246 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:14.535327 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:14.555076 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2572e7-f8cb-46ae-a51c-194c4ab11ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:14.555742 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2572e7-f8cb-46ae-a51c-194c4ab11ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:14.556031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2572e7-f8cb-46ae-a51c-194c4ab11ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:14.556307 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2572e7-f8cb-46ae-a51c-194c4ab11ec4 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:14.557046 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2572e7-f8cb-46ae-a51c-194c4ab11ec4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:14.557350 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2572e7-f8cb-46ae-a51c-194c4ab11ec4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:14.558804 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2572e7-f8cb-46ae-a51c-194c4ab11ec4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:14.577258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:14.589778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 360/735] 10.222.0.94 () {56 vars in 1135 bytes} [Thu Sep 1 17:14:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:14.591207 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2572e7-f8cb-46ae-a51c-194c4ab11ec4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:14.694941 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2572e7-f8cb-46ae-a51c-194c4ab11ec4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:14.708113 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6edb2-9c39-4d03-b226-c2da82f42246 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:14.730568 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a35c30-efff-4bb5-bc02-b9bf024e6b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:14.731171 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a35c30-efff-4bb5-bc02-b9bf024e6b4b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:14.731445 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a35c30-efff-4bb5-bc02-b9bf024e6b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:14.732336 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a35c30-efff-4bb5-bc02-b9bf024e6b4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:14.743824 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d944e9-4534-4388-bc8b-10b758f5dd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:14.744440 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d944e9-4534-4388-bc8b-10b758f5dd96 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:14.744810 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d944e9-4534-4388-bc8b-10b758f5dd96 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:14.745090 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d944e9-4534-4388-bc8b-10b758f5dd96 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:14.745761 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d944e9-4534-4388-bc8b-10b758f5dd96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:14.746065 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d944e9-4534-4388-bc8b-10b758f5dd96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:14.747602 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d944e9-4534-4388-bc8b-10b758f5dd96 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:14.760576 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 376/736] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:14.762011 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d5797-2059-465f-9d4c-af3eec5fedc9 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:14.762298 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d5797-2059-465f-9d4c-af3eec5fedc9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:14.762569 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d5797-2059-465f-9d4c-af3eec5fedc9 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:14.768528 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 377/737] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:14.769293 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d5797-2059-465f-9d4c-af3eec5fedc9 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:14.787346 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:14.805073 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a35c30-efff-4bb5-bc02-b9bf024e6b4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:14.806548 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a35c30-efff-4bb5-bc02-b9bf024e6b4b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:14.862855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:14.883028 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d5797-2059-465f-9d4c-af3eec5fedc9 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:14.916931 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 361/738] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:14:14 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 17:14:14.918279 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2846ce3-f3d2-48b5-a5ef-70bef0ef565f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:14.918562 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2846ce3-f3d2-48b5-a5ef-70bef0ef565f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:14.918856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2846ce3-f3d2-48b5-a5ef-70bef0ef565f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:14.921463 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d47e9b-371c-424c-8b52-eed7938a6540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:14.922377 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d47e9b-371c-424c-8b52-eed7938a6540 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:14.922894 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d47e9b-371c-424c-8b52-eed7938a6540 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:14.923308 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d47e9b-371c-424c-8b52-eed7938a6540 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:14.931339 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d47e9b-371c-424c-8b52-eed7938a6540 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:14.933024 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d47e9b-371c-424c-8b52-eed7938a6540 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:14.946291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-57d47e9b-371c-424c-8b52-eed7938a6540 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 17:14:14.946291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:14.946291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:14.946291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:14.946291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:14.946291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:14.946291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:14.946291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:14.946291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:14.946291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:14.946291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:14.946291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:14.946291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:14:14.946291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:14:14.946291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:14:14.946291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:14:14.947509 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:14.947509 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:14.947509 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:14:14.947509 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:14.947509 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:14:14.947509 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:14.947509 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:14.947509 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:14.947509 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:14.947509 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:14.947509 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:14.947509 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:14.947509 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:14.947509 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:14.947509 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:14.947509 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:14.947509 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:14.947509 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:14.948622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:14.948622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:14.948622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:14:14.948622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:14:14.948622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:14:14.948622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:14:14.948622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:14:14.948622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:14:14.948622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 17:14:14.948622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:14.951440 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 378/739] 10.222.0.94 () {56 vars in 1117 bytes} [Thu Sep 1 17:14:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:14.952557 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d47e9b-371c-424c-8b52-eed7938a6540 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:15.053007 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e2846ce3-f3d2-48b5-a5ef-70bef0ef565f None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:15.054154 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e2846ce3-f3d2-48b5-a5ef-70bef0ef565f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:15.065542 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d47e9b-371c-424c-8b52-eed7938a6540 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:15.109379 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4634fd7-5c2b-4899-b38a-57c86077edba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:15.110372 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4634fd7-5c2b-4899-b38a-57c86077edba None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:15.110650 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4634fd7-5c2b-4899-b38a-57c86077edba None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:15.110920 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4634fd7-5c2b-4899-b38a-57c86077edba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:15.124272 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4634fd7-5c2b-4899-b38a-57c86077edba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:15.126191 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4634fd7-5c2b-4899-b38a-57c86077edba None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:15.129769 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:15.145339 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-d4634fd7-5c2b-4899-b38a-57c86077edba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:15.145339 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:15.145339 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:15.145339 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:15.145339 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:15.145339 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:15.145339 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:15.145339 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:15.145339 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:15.145339 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:15.145339 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:15.145339 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:15.145339 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:15.145339 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:15.145339 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:15.145339 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:15.146585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:15.146585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:15.146585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:15.146585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:15.146585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:15.146585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:15.146585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:15.146585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:15.146585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:15.146585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:15.146585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:15.146585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:15.146585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:15.146585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:15.146585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:15.146585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:15.146585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:15.147655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:15.147655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:15.147655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:15.153967 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 379/741] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:15.153967 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4634fd7-5c2b-4899-b38a-57c86077edba None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:15.154578 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 362/741] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:14 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:14:15.155547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2846ce3-f3d2-48b5-a5ef-70bef0ef565f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:15.185838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:15.297463 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2846ce3-f3d2-48b5-a5ef-70bef0ef565f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:15.301148 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4634fd7-5c2b-4899-b38a-57c86077edba None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:15.341725 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b8520-1800-4ae3-b86e-0de3b85d01c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:15.342317 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b8520-1800-4ae3-b86e-0de3b85d01c6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:15.342589 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b8520-1800-4ae3-b86e-0de3b85d01c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:15.342854 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b8520-1800-4ae3-b86e-0de3b85d01c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:15.343482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b8520-1800-4ae3-b86e-0de3b85d01c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:15.343778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b8520-1800-4ae3-b86e-0de3b85d01c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:15.345321 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b8520-1800-4ae3-b86e-0de3b85d01c6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:15.345853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d6cf7-b77b-4ed2-baad-4c23d8a2f508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:15.346937 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d6cf7-b77b-4ed2-baad-4c23d8a2f508 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:15.347426 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d6cf7-b77b-4ed2-baad-4c23d8a2f508 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:15.348342 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d6cf7-b77b-4ed2-baad-4c23d8a2f508 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:15.349307 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d6cf7-b77b-4ed2-baad-4c23d8a2f508 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:15.349853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d6cf7-b77b-4ed2-baad-4c23d8a2f508 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:15.351438 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d6cf7-b77b-4ed2-baad-4c23d8a2f508 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:15.361483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 363/742] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:15.363022 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8b7f4-35c5-4cb3-b6b3-76adac3761f1 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:15.363492 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8b7f4-35c5-4cb3-b6b3-76adac3761f1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:15.364143 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8b7f4-35c5-4cb3-b6b3-76adac3761f1 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:15.365564 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 364/743] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:15.366122 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8b7f4-35c5-4cb3-b6b3-76adac3761f1 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:15.379546 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 380/744] 10.222.0.94 () {56 vars in 1149 bytes} [Thu Sep 1 17:14:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:15.380796 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9820aee-259c-4c26-8d18-03666e6d5a59 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:15.381080 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9820aee-259c-4c26-8d18-03666e6d5a59 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:15.381348 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9820aee-259c-4c26-8d18-03666e6d5a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:15.409736 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c9820aee-259c-4c26-8d18-03666e6d5a59 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:15.411031 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c9820aee-259c-4c26-8d18-03666e6d5a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:15.456505 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:15.475281 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:15.486058 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8b7f4-35c5-4cb3-b6b3-76adac3761f1 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:15.496319 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 381/745] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:15 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 17:14:15.498073 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9820aee-259c-4c26-8d18-03666e6d5a59 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:15.520173 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d37695-2148-401a-9029-c1a51725375d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:15.520914 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d37695-2148-401a-9029-c1a51725375d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:15.521257 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d37695-2148-401a-9029-c1a51725375d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:15.521630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d37695-2148-401a-9029-c1a51725375d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:15.533426 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d37695-2148-401a-9029-c1a51725375d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:15.535005 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d37695-2148-401a-9029-c1a51725375d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:15.554278 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-f8d37695-2148-401a-9029-c1a51725375d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:15.554278 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:15.554278 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:15.554278 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:15.554278 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:15.554278 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:15.554278 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:15.554278 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:15.554278 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:15.554278 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:15.554278 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:15.554278 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:15.554278 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:14:15.554278 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:14:15.554278 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:14:15.555172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:14:15.555172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:15.555172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:15.555172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:15.555172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:15.555172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:15.555172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:15.555172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:15.555172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:15.555172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:15.555172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:15.555172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:15.555172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:15.555172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:15.555172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:15.555172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:15.555172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:15.556159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:14:15.556159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:14:15.556159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:14:15.556159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:14:15.556159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:14:15.556159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:14:15.556159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:15.556159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:15.559080 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 365/746] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:14:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:15.560106 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d37695-2148-401a-9029-c1a51725375d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:15.645152 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9820aee-259c-4c26-8d18-03666e6d5a59 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:15.680629 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d37695-2148-401a-9029-c1a51725375d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:15.683356 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8e063-07fe-47ef-b287-45c1291dac1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:15.684303 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8e063-07fe-47ef-b287-45c1291dac1a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:15.685364 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8e063-07fe-47ef-b287-45c1291dac1a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:15.685905 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8e063-07fe-47ef-b287-45c1291dac1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:15.718699 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28667be8-8ced-4ac2-9099-7a2c1e7e472f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:15.719318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28667be8-8ced-4ac2-9099-7a2c1e7e472f None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:15.719567 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28667be8-8ced-4ac2-9099-7a2c1e7e472f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:15.719833 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28667be8-8ced-4ac2-9099-7a2c1e7e472f None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:15.720568 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28667be8-8ced-4ac2-9099-7a2c1e7e472f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:15.721982 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28667be8-8ced-4ac2-9099-7a2c1e7e472f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:15.725304 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:15.745454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 366/747] 10.222.0.94 () {60 vars in 1141 bytes} [Thu Sep 1 17:14:15 2022] POST /identity/v3/services => generated 240 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:14:15.745454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28667be8-8ced-4ac2-9099-7a2c1e7e472f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:15.752862 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:15.791628 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8e063-07fe-47ef-b287-45c1291dac1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:15.793131 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8e063-07fe-47ef-b287-45c1291dac1a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:15.880364 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28667be8-8ced-4ac2-9099-7a2c1e7e472f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:15.912188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 382/748] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:14:15 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 17:14:15.912944 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8e063-07fe-47ef-b287-45c1291dac1a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:15.928487 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2d89f-a5df-4f03-b572-337c1bf58115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:15.929266 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2d89f-a5df-4f03-b572-337c1bf58115 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:15.929701 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2d89f-a5df-4f03-b572-337c1bf58115 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:15.929977 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2d89f-a5df-4f03-b572-337c1bf58115 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:15.930686 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2d89f-a5df-4f03-b572-337c1bf58115 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:15.932472 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2d89f-a5df-4f03-b572-337c1bf58115 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:15.935390 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2d89f-a5df-4f03-b572-337c1bf58115 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:15.951160 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 367/749] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:14:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:15.952101 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2d89f-a5df-4f03-b572-337c1bf58115 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:16.018273 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:16.019605 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:16.040699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8e063-07fe-47ef-b287-45c1291dac1a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:16.079714 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31076872-fa25-4f22-bc91-5ae5e04d3566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:16.080347 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31076872-fa25-4f22-bc91-5ae5e04d3566 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:16.080619 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31076872-fa25-4f22-bc91-5ae5e04d3566 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:16.080904 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31076872-fa25-4f22-bc91-5ae5e04d3566 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:16.081508 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31076872-fa25-4f22-bc91-5ae5e04d3566 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:16.082874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31076872-fa25-4f22-bc91-5ae5e04d3566 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:16.086071 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2d89f-a5df-4f03-b572-337c1bf58115 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:16.091737 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-31076872-fa25-4f22-bc91-5ae5e04d3566 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 17:14:16.091737 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:16.091737 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:14:16.091737 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:14:16.091737 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:14:16.091737 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:14:16.091737 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:14:16.091737 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:16.091737 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 17:14:16.091737 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:16.091737 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:14:16.091737 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:16.091737 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:16.091737 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:16.091737 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:16.091737 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:16.091737 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:16.092906 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:16.092906 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:16.092906 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:16.092906 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:16.092906 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:16.092906 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:16.092906 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:14:16.092906 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:14:16.092906 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:14:16.092906 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:14:16.092906 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:16.092906 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:16.092906 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:16.092906 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:16.092906 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:16.092906 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:16.093971 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:16.093971 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:16.093971 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:16.093971 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:16.093971 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:16.093971 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:16.093971 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:16.093971 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:16.093971 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:16.093971 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:16.093971 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:14:16.093971 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:16.093971 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 17:14:16.093971 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:16.094835 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 383/750] 10.222.0.94 () {56 vars in 1129 bytes} [Thu Sep 1 17:14:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:16.095595 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31076872-fa25-4f22-bc91-5ae5e04d3566 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:16.128759 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b58e0-6096-44d1-9d44-e24f4d4e3073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:16.129520 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b58e0-6096-44d1-9d44-e24f4d4e3073 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:16.129862 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b58e0-6096-44d1-9d44-e24f4d4e3073 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:16.130198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b58e0-6096-44d1-9d44-e24f4d4e3073 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:16.141905 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b58e0-6096-44d1-9d44-e24f4d4e3073 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:16.143321 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b58e0-6096-44d1-9d44-e24f4d4e3073 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:16.157913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-410b58e0-6096-44d1-9d44-e24f4d4e3073 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:16.157913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:16.157913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:16.157913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:16.157913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:16.157913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:16.157913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:16.157913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:16.157913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:16.157913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:16.157913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:16.157913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:16.157913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:16.157913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:16.157913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:16.157913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:16.158895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:16.158895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:16.158895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:16.158895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:16.158895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:16.158895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:16.158895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:16.158895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:16.158895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:16.158895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:16.158895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:16.158895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:16.158895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:16.158895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:16.158895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:16.158895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:16.158895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:16.159784 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:16.159784 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:16.159784 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:16.159784 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 368/751] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:16.160296 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcbd8d-b8fc-4af0-ab7c-6c816854e10d None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:16.160517 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcbd8d-b8fc-4af0-ab7c-6c816854e10d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:16.160789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcbd8d-b8fc-4af0-ab7c-6c816854e10d None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:16.165449 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 369/752] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:16.165449 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcbd8d-b8fc-4af0-ab7c-6c816854e10d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:16.209013 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31076872-fa25-4f22-bc91-5ae5e04d3566 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:16.243431 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea707a-d7c8-4d5d-bec0-f3c952e643a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:16.244347 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea707a-d7c8-4d5d-bec0-f3c952e643a3 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:16.244800 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea707a-d7c8-4d5d-bec0-f3c952e643a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:16.245259 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea707a-d7c8-4d5d-bec0-f3c952e643a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:16.246180 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea707a-d7c8-4d5d-bec0-f3c952e643a3 None admin] RBAC: Adding query filter params (role.id=70f911a75b7b40a19f65857b9d19cfad, scope.project.id=c8f9428f37354c82ac52b6b8eccc424a, user.id=af7ebf43f36c4862a3c527941e033666) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:16.246680 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea707a-d7c8-4d5d-bec0-f3c952e643a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:16.248345 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea707a-d7c8-4d5d-bec0-f3c952e643a3 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:16.254243 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 384/753] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:14:16 2022] GET /identity/v3/role_assignments?user.id=af7ebf43f36c4862a3c527941e033666&scope.project.id=c8f9428f37354c82ac52b6b8eccc424a&role.id=70f911a75b7b40a19f65857b9d19cfad => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:16.255239 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea707a-d7c8-4d5d-bec0-f3c952e643a3 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:16.277833 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:16.284734 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcbd8d-b8fc-4af0-ab7c-6c816854e10d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:16.286918 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:16.329655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cae94a-8e82-4d95-aa5c-bbe5e44d0d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:16.330294 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cae94a-8e82-4d95-aa5c-bbe5e44d0d3f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:16.330575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cae94a-8e82-4d95-aa5c-bbe5e44d0d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:16.330852 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cae94a-8e82-4d95-aa5c-bbe5e44d0d3f None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:16.331530 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cae94a-8e82-4d95-aa5c-bbe5e44d0d3f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:16.331922 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cae94a-8e82-4d95-aa5c-bbe5e44d0d3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:16.333443 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cae94a-8e82-4d95-aa5c-bbe5e44d0d3f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:16.344220 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 370/754] 10.222.0.94 () {56 vars in 1124 bytes} [Thu Sep 1 17:14:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:16.346090 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d87cb-9659-49d7-8c21-4dd0a66eb117 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:16.346388 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d87cb-9659-49d7-8c21-4dd0a66eb117 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:16.346668 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d87cb-9659-49d7-8c21-4dd0a66eb117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:16.379501 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-429d87cb-9659-49d7-8c21-4dd0a66eb117 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:16.380762 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-429d87cb-9659-49d7-8c21-4dd0a66eb117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:16.404653 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea707a-d7c8-4d5d-bec0-f3c952e643a3 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:16.442959 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5c29d-c929-4864-8735-75aa0c769715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:16.443568 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5c29d-c929-4864-8735-75aa0c769715 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:16.443846 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5c29d-c929-4864-8735-75aa0c769715 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:16.444121 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5c29d-c929-4864-8735-75aa0c769715 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:16.444767 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5c29d-c929-4864-8735-75aa0c769715 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:16.445069 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5c29d-c929-4864-8735-75aa0c769715 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:16.446505 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5c29d-c929-4864-8735-75aa0c769715 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:16.463723 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 385/755] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:16.464638 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5c29d-c929-4864-8735-75aa0c769715 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:16.472526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 371/756] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:16.473749 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d87cb-9659-49d7-8c21-4dd0a66eb117 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:16.582692 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d87cb-9659-49d7-8c21-4dd0a66eb117 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:16.585722 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:16.619387 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cedb6e-0e4f-4504-b563-575241959076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:16.620136 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cedb6e-0e4f-4504-b563-575241959076 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:16.620422 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cedb6e-0e4f-4504-b563-575241959076 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:16.620698 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cedb6e-0e4f-4504-b563-575241959076 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:16.628246 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cedb6e-0e4f-4504-b563-575241959076 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:16.629727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cedb6e-0e4f-4504-b563-575241959076 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:16.643607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-a7cedb6e-0e4f-4504-b563-575241959076 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:16.643607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:16.643607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:16.643607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:16.643607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:16.643607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:16.643607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:16.643607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:16.643607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:16.643607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:16.643607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:16.643607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:16.643607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:14:16.643607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:14:16.643607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:14:16.644612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:14:16.644612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:16.644612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:16.644612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:16.644612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:16.644612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:16.644612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:16.644612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:16.644612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:16.644612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:16.644612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:16.644612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:16.644612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:16.644612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:16.644612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:16.644612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:16.644612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:16.645555 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:14:16.645555 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:14:16.645555 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:14:16.645555 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:14:16.645555 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:14:16.645555 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:14:16.645555 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:16.645555 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:16.645555 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 372/757] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:14:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:16.650458 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cedb6e-0e4f-4504-b563-575241959076 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:16.714526 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:16.773508 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5c29d-c929-4864-8735-75aa0c769715 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:16.806955 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cedb6e-0e4f-4504-b563-575241959076 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:16.816010 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c8e273-6027-4390-bb80-64bf9e11391a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:16.816622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8e273-6027-4390-bb80-64bf9e11391a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:16.816903 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8e273-6027-4390-bb80-64bf9e11391a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:16.817173 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8e273-6027-4390-bb80-64bf9e11391a None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:16.817837 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c8e273-6027-4390-bb80-64bf9e11391a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:16.818137 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c8e273-6027-4390-bb80-64bf9e11391a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:16.819504 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c8e273-6027-4390-bb80-64bf9e11391a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:16.824753 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 386/758] 10.222.0.94 () {56 vars in 1124 bytes} [Thu Sep 1 17:14:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:16.826132 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c8e273-6027-4390-bb80-64bf9e11391a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:16.847332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826be53-c7e6-4aba-8bef-3be9f1259222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:16.848377 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826be53-c7e6-4aba-8bef-3be9f1259222 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:16.848725 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826be53-c7e6-4aba-8bef-3be9f1259222 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:16.849283 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826be53-c7e6-4aba-8bef-3be9f1259222 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:16.850015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826be53-c7e6-4aba-8bef-3be9f1259222 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:16.850480 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826be53-c7e6-4aba-8bef-3be9f1259222 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:16.852527 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826be53-c7e6-4aba-8bef-3be9f1259222 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:16.868892 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 373/759] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:14:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:16.869763 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826be53-c7e6-4aba-8bef-3be9f1259222 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:16.892797 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:16.955171 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c8e273-6027-4390-bb80-64bf9e11391a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:16.992246 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826be53-c7e6-4aba-8bef-3be9f1259222 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:16.993159 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99760e18-a8a7-449b-8658-070a29ad27ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:16.993824 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99760e18-a8a7-449b-8658-070a29ad27ee None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:16.994102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99760e18-a8a7-449b-8658-070a29ad27ee None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:16.994387 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99760e18-a8a7-449b-8658-070a29ad27ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:16.998786 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:17.012475 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99760e18-a8a7-449b-8658-070a29ad27ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:14:17.018186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-99760e18-a8a7-449b-8658-070a29ad27ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:14:17.018186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:17.018186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:17.018186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:17.018186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:17.018186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:17.018186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:17.018186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:17.018186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:17.018186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:17.018186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:17.018186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:17.018186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:14:17.018186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:14:17.018186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:14:17.018186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:14:17.019346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:14:17.019346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:14:17.019346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:14:17.019346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:14:17.019346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:17.019346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:17.019346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:17.019346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:17.019346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:17.019346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:17.019346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:17.019346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:17.019346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:17.019346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:17.019346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:17.019346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:17.020267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:17.020267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:17.020267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:17.020267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:17.020267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:14:17.020267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:14:17.020267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:14:17.020267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:14:17.020267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:14:17.020267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:14:17.020267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:14:17.020267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:17.024232 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 387/760] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:14:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:17.025082 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99760e18-a8a7-449b-8658-070a29ad27ee None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:17.044519 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d511ba2-082c-44df-ab92-3ea8dde31296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:17.045706 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d511ba2-082c-44df-ab92-3ea8dde31296 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:17.046162 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d511ba2-082c-44df-ab92-3ea8dde31296 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:17.046605 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d511ba2-082c-44df-ab92-3ea8dde31296 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:17.047448 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d511ba2-082c-44df-ab92-3ea8dde31296 None admin] RBAC: Adding query filter params (interface=public, service_id=8ba7e5a470d44a7f90026601d21e079e, region_id=RegionOne) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:17.048323 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d511ba2-082c-44df-ab92-3ea8dde31296 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:17.050164 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d511ba2-082c-44df-ab92-3ea8dde31296 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:17.060753 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 374/761] 10.222.0.94 () {56 vars in 1251 bytes} [Thu Sep 1 17:14:16 2022] GET /identity/v3/endpoints?service_id=8ba7e5a470d44a7f90026601d21e079e&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:17.062521 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d511ba2-082c-44df-ab92-3ea8dde31296 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:17.132291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99760e18-a8a7-449b-8658-070a29ad27ee None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:17.169032 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8319789-5f9e-4c73-99cd-183fb871ff62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:17.170198 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8319789-5f9e-4c73-99cd-183fb871ff62 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:17.170479 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8319789-5f9e-4c73-99cd-183fb871ff62 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:17.170751 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8319789-5f9e-4c73-99cd-183fb871ff62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:17.171716 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8319789-5f9e-4c73-99cd-183fb871ff62 None admin] RBAC: Adding query filter params (role.id=e903cb11e2bf466fa1b3fae894847c3e, scope.project.id=c8f9428f37354c82ac52b6b8eccc424a, user.id=9e7444bc40314e73b282217bbb94798d) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:17.171835 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8319789-5f9e-4c73-99cd-183fb871ff62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:17.173203 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8319789-5f9e-4c73-99cd-183fb871ff62 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:17.174714 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:17.185538 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 388/762] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:14:17 2022] GET /identity/v3/role_assignments?user.id=9e7444bc40314e73b282217bbb94798d&scope.project.id=c8f9428f37354c82ac52b6b8eccc424a&role.id=e903cb11e2bf466fa1b3fae894847c3e => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:17.185538 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8319789-5f9e-4c73-99cd-183fb871ff62 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:17.220709 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d511ba2-082c-44df-ab92-3ea8dde31296 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:17.273221 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603017d-d139-498f-8e79-5c32d428b670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:17.274014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603017d-d139-498f-8e79-5c32d428b670 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:17.274165 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603017d-d139-498f-8e79-5c32d428b670 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:17.274323 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603017d-d139-498f-8e79-5c32d428b670 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:17.275008 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603017d-d139-498f-8e79-5c32d428b670 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:17.275309 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603017d-d139-498f-8e79-5c32d428b670 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:17.276705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603017d-d139-498f-8e79-5c32d428b670 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:17.287001 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:17.304150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 375/763] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:14:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:17.314485 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603017d-d139-498f-8e79-5c32d428b670 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:17.355528 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8319789-5f9e-4c73-99cd-183fb871ff62 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:17.401700 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4238c-af65-49de-a487-1fda2ae9fd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:17.402316 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4238c-af65-49de-a487-1fda2ae9fd5c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:17.402597 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4238c-af65-49de-a487-1fda2ae9fd5c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:17.402978 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4238c-af65-49de-a487-1fda2ae9fd5c None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:17.404137 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4238c-af65-49de-a487-1fda2ae9fd5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:17.405749 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4238c-af65-49de-a487-1fda2ae9fd5c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:17.411793 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 389/764] 10.222.0.94 () {56 vars in 1087 bytes} [Thu Sep 1 17:14:17 2022] GET /identity/v3/services => generated 772 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:17.456230 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603017d-d139-498f-8e79-5c32d428b670 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:17.500649 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17055d4a-06e9-4325-9242-2ec5b5b4ce32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:17.501288 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17055d4a-06e9-4325-9242-2ec5b5b4ce32 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:17.501590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17055d4a-06e9-4325-9242-2ec5b5b4ce32 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:17.501855 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17055d4a-06e9-4325-9242-2ec5b5b4ce32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:17.513268 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17055d4a-06e9-4325-9242-2ec5b5b4ce32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:17.514896 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17055d4a-06e9-4325-9242-2ec5b5b4ce32 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:17.516913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:17.530999 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-17055d4a-06e9-4325-9242-2ec5b5b4ce32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:17.530999 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:17.530999 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:17.530999 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:17.530999 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:17.530999 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:17.530999 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:17.530999 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:17.530999 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:17.530999 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:17.530999 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:17.530999 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:17.530999 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:17.530999 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:17.530999 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:17.530999 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:17.532015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:17.532015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:17.532015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:17.532015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:17.532015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:17.532015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:17.532015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:17.532015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:17.532015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:17.532015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:17.532015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:17.532015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:17.532015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:17.532015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:17.532015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:17.532015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:17.532015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:17.532951 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:17.532951 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:17.532951 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:17.532951 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 376/765] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:17.541684 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4238c-af65-49de-a487-1fda2ae9fd5c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:17.694150 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4238c-af65-49de-a487-1fda2ae9fd5c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:17.718562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:17.729683 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afdbbf1-8c10-45e7-8c49-84d18d2e6eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:17.730296 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afdbbf1-8c10-45e7-8c49-84d18d2e6eaf None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:17.730576 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afdbbf1-8c10-45e7-8c49-84d18d2e6eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:17.730850 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afdbbf1-8c10-45e7-8c49-84d18d2e6eaf None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:17.731498 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afdbbf1-8c10-45e7-8c49-84d18d2e6eaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:17.732321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afdbbf1-8c10-45e7-8c49-84d18d2e6eaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:17.733746 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afdbbf1-8c10-45e7-8c49-84d18d2e6eaf None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:17.746083 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 390/766] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:17.752054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17055d4a-06e9-4325-9242-2ec5b5b4ce32 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:17.892239 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17055d4a-06e9-4325-9242-2ec5b5b4ce32 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:17.935361 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ed115-5a18-4168-8d09-8fa7ff043729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:17.936321 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ed115-5a18-4168-8d09-8fa7ff043729 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:17.936779 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ed115-5a18-4168-8d09-8fa7ff043729 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:17.937227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ed115-5a18-4168-8d09-8fa7ff043729 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:17.945270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ed115-5a18-4168-8d09-8fa7ff043729 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:17.946985 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ed115-5a18-4168-8d09-8fa7ff043729 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:17.959365 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-ad6ed115-5a18-4168-8d09-8fa7ff043729 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:14:17.959365 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:17.959365 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:17.959365 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:17.959365 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:17.959365 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:17.959365 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:17.959365 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:17.959365 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:17.959365 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:17.959365 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:17.959365 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:17.959365 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:14:17.959365 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:14:17.959365 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:14:17.959365 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:14:17.960423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:17.960423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:17.960423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:14:17.960423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:17.960423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:14:17.960423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:17.960423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:17.960423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:17.960423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:17.960423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:17.960423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:17.960423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:17.960423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:17.960423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:17.960423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:17.960423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:17.960423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:17.960423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:17.961380 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:17.961380 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:17.961380 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:14:17.961380 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:14:17.961380 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:14:17.961380 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:14:17.961380 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:14:17.961380 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:14:17.961380 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:14:17.961380 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:17.963636 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 377/767] 10.222.0.94 () {56 vars in 1093 bytes} [Thu Sep 1 17:14:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:14:17.970518 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afdbbf1-8c10-45e7-8c49-84d18d2e6eaf None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:18.010377 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b4dd1-5103-46c4-919c-b0773fbd5a89 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:18.010826 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b4dd1-5103-46c4-919c-b0773fbd5a89 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:18.011210 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b4dd1-5103-46c4-919c-b0773fbd5a89 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:18.014470 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 378/768] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:14:18.022240 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6f3c1-3c6a-4d4c-b141-98d3ea749331 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:18.022655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6f3c1-3c6a-4d4c-b141-98d3ea749331 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:18.023036 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6f3c1-3c6a-4d4c-b141-98d3ea749331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:18.061451 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f1a6f3c1-3c6a-4d4c-b141-98d3ea749331 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:18.061451 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f1a6f3c1-3c6a-4d4c-b141-98d3ea749331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:18.114789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:18.130323 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afdbbf1-8c10-45e7-8c49-84d18d2e6eaf None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:18.140729 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 379/769] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:18.185467 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22410018-96fd-4518-bdb6-fe7481fea714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:18.186467 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22410018-96fd-4518-bdb6-fe7481fea714 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:18.186949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22410018-96fd-4518-bdb6-fe7481fea714 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:18.187449 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22410018-96fd-4518-bdb6-fe7481fea714 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:18.188450 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22410018-96fd-4518-bdb6-fe7481fea714 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:18.189008 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22410018-96fd-4518-bdb6-fe7481fea714 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:18.190671 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22410018-96fd-4518-bdb6-fe7481fea714 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:18.211991 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 391/770] 10.222.0.94 () {56 vars in 1133 bytes} [Thu Sep 1 17:14:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:18.217954 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6f3c1-3c6a-4d4c-b141-98d3ea749331 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:18.333323 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6f3c1-3c6a-4d4c-b141-98d3ea749331 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:18.377103 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310169ee-6903-476c-808d-74366e721e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:18.378110 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310169ee-6903-476c-808d-74366e721e0d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:18.378619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310169ee-6903-476c-808d-74366e721e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:18.379124 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310169ee-6903-476c-808d-74366e721e0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:18.392835 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310169ee-6903-476c-808d-74366e721e0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:18.394651 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310169ee-6903-476c-808d-74366e721e0d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:18.412567 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-310169ee-6903-476c-808d-74366e721e0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:18.412567 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:18.412567 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:18.412567 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:18.412567 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:18.412567 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:18.412567 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:18.412567 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:18.412567 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:18.412567 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:18.412567 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:18.412567 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:18.412567 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:18.412567 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:18.412567 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:18.412567 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:18.413576 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:18.413576 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:18.413576 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:18.413576 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:18.413576 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:18.413576 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:18.413576 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:18.413576 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:18.413576 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:18.413576 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:18.413576 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:18.413576 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:18.413576 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:18.413576 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:18.413576 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:18.413576 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:18.413576 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:18.414502 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:18.414502 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:18.414502 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:18.416286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 380/771] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:18.423326 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22410018-96fd-4518-bdb6-fe7481fea714 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:18.472518 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:18.497080 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa87b7-26f2-4c59-86b2-73acb7699a2d None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:18.497969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa87b7-26f2-4c59-86b2-73acb7699a2d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:18.498251 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa87b7-26f2-4c59-86b2-73acb7699a2d None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:18.499585 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 381/772] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:14:18.505156 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d6897-b219-4b4b-98a1-1127ebfec791 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:18.505459 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d6897-b219-4b4b-98a1-1127ebfec791 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:18.505776 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d6897-b219-4b4b-98a1-1127ebfec791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:18.527509 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5d3d6897-b219-4b4b-98a1-1127ebfec791 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:18.528783 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5d3d6897-b219-4b4b-98a1-1127ebfec791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:18.540118 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22410018-96fd-4518-bdb6-fe7481fea714 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:18.566125 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:18.580299 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603c5e0-3dd0-4151-b2fa-b3c7bb678d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:18.580915 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603c5e0-3dd0-4151-b2fa-b3c7bb678d55 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:18.581196 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603c5e0-3dd0-4151-b2fa-b3c7bb678d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:18.581496 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603c5e0-3dd0-4151-b2fa-b3c7bb678d55 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:18.582176 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603c5e0-3dd0-4151-b2fa-b3c7bb678d55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:18.582563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603c5e0-3dd0-4151-b2fa-b3c7bb678d55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:18.584010 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603c5e0-3dd0-4151-b2fa-b3c7bb678d55 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:18.596993 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 392/773] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:18.597864 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603c5e0-3dd0-4151-b2fa-b3c7bb678d55 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:18.621769 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 382/774] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:18.622977 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d6897-b219-4b4b-98a1-1127ebfec791 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:18.731180 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d6897-b219-4b4b-98a1-1127ebfec791 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:18.735856 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603c5e0-3dd0-4151-b2fa-b3c7bb678d55 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:18.737581 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:18.789794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bdd94-c092-4202-aae4-c7d70667fec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:18.790432 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bdd94-c092-4202-aae4-c7d70667fec6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:18.790715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bdd94-c092-4202-aae4-c7d70667fec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:18.790990 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bdd94-c092-4202-aae4-c7d70667fec6 None admin] PATH_INFO: `/v3/services/network` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:18.791576 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1bdd94-c092-4202-aae4-c7d70667fec6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:18.792949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1bdd94-c092-4202-aae4-c7d70667fec6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:18.794561 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bbaa1-0a1d-4248-97a7-70de5b4dff1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:18.795185 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bbaa1-0a1d-4248-97a7-70de5b4dff1d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:18.795520 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bbaa1-0a1d-4248-97a7-70de5b4dff1d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:18.795792 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bbaa1-0a1d-4248-97a7-70de5b4dff1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:18.804836 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2bbaa1-0a1d-4248-97a7-70de5b4dff1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:18.806574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2bbaa1-0a1d-4248-97a7-70de5b4dff1d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:18.812788 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-9e1bdd94-c092-4202-aae4-c7d70667fec6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 17:14:18.812788 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:18.812788 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:14:18.812788 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:14:18.812788 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:14:18.812788 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:14:18.812788 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:14:18.812788 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:18.812788 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 17:14:18.812788 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:18.812788 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:14:18.812788 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:18.812788 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:18.812788 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:18.812788 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:18.812788 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:18.812788 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:18.813782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:18.813782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:18.813782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:18.813782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:18.813782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:18.813782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:18.813782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:14:18.813782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:14:18.813782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:14:18.813782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:14:18.813782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:18.813782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:18.813782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:18.813782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:18.813782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:18.813782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:18.814654 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:18.814654 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:18.814654 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:18.814654 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:18.814654 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:18.814654 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:18.814654 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:18.814654 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:18.814654 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:18.814654 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:18.814654 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:14:18.814654 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:18.814654 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 17:14:18.814654 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:18.816002 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 393/775] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:14:18 2022] GET /identity/v3/services/network => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:18.821679 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bdd94-c092-4202-aae4-c7d70667fec6 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:18.833962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-ed2bbaa1-0a1d-4248-97a7-70de5b4dff1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:18.833962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:18.833962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:18.833962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:18.833962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:18.833962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:18.833962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:18.833962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:18.833962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:18.833962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:18.833962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:18.833962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:18.833962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:14:18.833962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:14:18.833962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:14:18.837115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:14:18.837115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:18.837115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:18.837115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:18.837115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:18.837115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:18.837115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:18.837115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:18.837115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:18.837115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:18.837115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:18.837115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:18.837115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:18.837115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:18.837115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:18.837115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:18.837115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:18.839311 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:14:18.839311 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:14:18.839311 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:14:18.839311 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:14:18.839311 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:14:18.839311 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:14:18.839311 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:18.839311 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:18.839311 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 383/776] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:14:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:18.845895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bbaa1-0a1d-4248-97a7-70de5b4dff1d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:18.887974 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:19.011226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bdd94-c092-4202-aae4-c7d70667fec6 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:19.022324 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bbaa1-0a1d-4248-97a7-70de5b4dff1d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:19.057825 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76175c-be1d-4610-a748-3dbede6ad1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:19.058866 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76175c-be1d-4610-a748-3dbede6ad1f7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:19.059368 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76175c-be1d-4610-a748-3dbede6ad1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:19.059880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76175c-be1d-4610-a748-3dbede6ad1f7 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:19.060720 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76175c-be1d-4610-a748-3dbede6ad1f7 None admin] RBAC: Adding query filter params (name=network) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:19.061256 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76175c-be1d-4610-a748-3dbede6ad1f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:19.062854 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76175c-be1d-4610-a748-3dbede6ad1f7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:19.063034 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af01f3b-d432-4aba-b795-aa647603059c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:19.063638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af01f3b-d432-4aba-b795-aa647603059c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:19.063918 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af01f3b-d432-4aba-b795-aa647603059c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:19.064180 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af01f3b-d432-4aba-b795-aa647603059c None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:19.064988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af01f3b-d432-4aba-b795-aa647603059c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:19.065297 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af01f3b-d432-4aba-b795-aa647603059c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:19.066842 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af01f3b-d432-4aba-b795-aa647603059c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:19.074201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 394/777] 10.222.0.94 () {56 vars in 1112 bytes} [Thu Sep 1 17:14:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:19.075869 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76175c-be1d-4610-a748-3dbede6ad1f7 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:19.080766 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 384/778] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:14:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:19.081620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af01f3b-d432-4aba-b795-aa647603059c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:19.109684 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:19.174096 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:19.186251 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76175c-be1d-4610-a748-3dbede6ad1f7 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:19.190302 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af01f3b-d432-4aba-b795-aa647603059c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:19.223493 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc9265-2c91-45fc-9673-bc10ff253703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:19.224506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc9265-2c91-45fc-9673-bc10ff253703 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:19.224992 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc9265-2c91-45fc-9673-bc10ff253703 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:19.225459 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc9265-2c91-45fc-9673-bc10ff253703 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:19.227866 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edb080-0833-406b-a3b5-b1053311c195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:19.228675 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edb080-0833-406b-a3b5-b1053311c195 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:19.229070 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edb080-0833-406b-a3b5-b1053311c195 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:19.229501 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edb080-0833-406b-a3b5-b1053311c195 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:19.230234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edb080-0833-406b-a3b5-b1053311c195 None admin] RBAC: Adding query filter params (type=network) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:19.230654 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edb080-0833-406b-a3b5-b1053311c195 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:19.232660 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edb080-0833-406b-a3b5-b1053311c195 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:19.238120 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc9265-2c91-45fc-9673-bc10ff253703 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:14:19.244058 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 385/779] 10.222.0.94 () {56 vars in 1112 bytes} [Thu Sep 1 17:14:19 2022] GET /identity/v3/services?type=network => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:19.244058 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edb080-0833-406b-a3b5-b1053311c195 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:19.248958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-b0fc9265-2c91-45fc-9673-bc10ff253703 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:14:19.248958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:19.248958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:19.248958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:19.248958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:19.248958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:19.248958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:19.248958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:19.248958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:19.248958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:19.248958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:19.248958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:19.248958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:14:19.248958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:14:19.248958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:14:19.248958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:14:19.249996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:14:19.249996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:14:19.249996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:14:19.249996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:14:19.249996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:19.249996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:19.249996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:19.249996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:19.249996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:19.249996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:19.249996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:19.249996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:19.249996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:19.249996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:19.249996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:19.249996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:19.250848 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:19.250848 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:19.250848 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:19.250848 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:19.250848 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:14:19.250848 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:14:19.250848 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:14:19.250848 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:14:19.250848 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:14:19.250848 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:14:19.250848 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:14:19.250848 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:19.262147 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 395/780] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:14:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:19.263860 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc9265-2c91-45fc-9673-bc10ff253703 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:19.351126 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edb080-0833-406b-a3b5-b1053311c195 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:19.364422 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:19.375551 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc9265-2c91-45fc-9673-bc10ff253703 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:19.391094 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae966fb-f95b-458f-b43d-2b0d1f939cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:19.391762 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae966fb-f95b-458f-b43d-2b0d1f939cfb None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:19.392042 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae966fb-f95b-458f-b43d-2b0d1f939cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:19.392722 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae966fb-f95b-458f-b43d-2b0d1f939cfb None admin] PATH_INFO: `/v3/projects/c8f9428f37354c82ac52b6b8eccc424a/users/8b7fa3c4c5d94b3c9b7f17dde35d39a0/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:19.394400 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae966fb-f95b-458f-b43d-2b0d1f939cfb None admin] RBAC: Authorizing `identity:create_grant(project_id=c8f9428f37354c82ac52b6b8eccc424a, user_id=8b7fa3c4c5d94b3c9b7f17dde35d39a0, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:19.395962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae966fb-f95b-458f-b43d-2b0d1f939cfb None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:19.413207 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 386/781] 10.222.0.94 () {58 vars in 1439 bytes} [Thu Sep 1 17:14:19 2022] PUT /identity/v3/projects/c8f9428f37354c82ac52b6b8eccc424a/users/8b7fa3c4c5d94b3c9b7f17dde35d39a0/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:14:19.413882 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae966fb-f95b-458f-b43d-2b0d1f939cfb None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:19.418716 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd6434-796e-4b18-99f1-1fcacdd8c762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:19.420352 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd6434-796e-4b18-99f1-1fcacdd8c762 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:19.420844 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd6434-796e-4b18-99f1-1fcacdd8c762 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:19.421358 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd6434-796e-4b18-99f1-1fcacdd8c762 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:19.422363 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd6434-796e-4b18-99f1-1fcacdd8c762 None admin] RBAC: Adding query filter params (interface=public, service_id=98f2ac6a41a645f1b587f88c83f0485b, region_id=RegionOne) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:19.422910 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd6434-796e-4b18-99f1-1fcacdd8c762 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:19.425605 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd6434-796e-4b18-99f1-1fcacdd8c762 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:19.430297 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:19.445098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 396/782] 10.222.0.94 () {56 vars in 1251 bytes} [Thu Sep 1 17:14:19 2022] GET /identity/v3/endpoints?service_id=98f2ac6a41a645f1b587f88c83f0485b&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:19.460489 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd6434-796e-4b18-99f1-1fcacdd8c762 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:19.541444 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae966fb-f95b-458f-b43d-2b0d1f939cfb None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:19.594538 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ba2ba-1ed6-4e1e-b0ae-bbc8ac97e99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:19.595168 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ba2ba-1ed6-4e1e-b0ae-bbc8ac97e99d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:19.595446 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ba2ba-1ed6-4e1e-b0ae-bbc8ac97e99d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:19.595716 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ba2ba-1ed6-4e1e-b0ae-bbc8ac97e99d None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:19.596389 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ba2ba-1ed6-4e1e-b0ae-bbc8ac97e99d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:19.596690 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ba2ba-1ed6-4e1e-b0ae-bbc8ac97e99d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:19.598080 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ba2ba-1ed6-4e1e-b0ae-bbc8ac97e99d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:19.607505 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 387/783] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:14:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:19.608731 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f9140-5051-43ae-9d80-48d8d23d27b4 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:19.609017 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f9140-5051-43ae-9d80-48d8d23d27b4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:19.609290 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f9140-5051-43ae-9d80-48d8d23d27b4 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:19.609888 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd6434-796e-4b18-99f1-1fcacdd8c762 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:19.615045 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 388/784] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:19.616397 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c306ec-b3d6-46d1-b55a-1326ce94e3a8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:19.616685 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c306ec-b3d6-46d1-b55a-1326ce94e3a8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:19.616954 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c306ec-b3d6-46d1-b55a-1326ce94e3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:19.635908 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e6c306ec-b3d6-46d1-b55a-1326ce94e3a8 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:19.637453 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e6c306ec-b3d6-46d1-b55a-1326ce94e3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:19.654071 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd12520-3032-46ac-a5ce-1fc8cb786580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:19.654694 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd12520-3032-46ac-a5ce-1fc8cb786580 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:19.654977 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd12520-3032-46ac-a5ce-1fc8cb786580 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:19.655250 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd12520-3032-46ac-a5ce-1fc8cb786580 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:19.656174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd12520-3032-46ac-a5ce-1fc8cb786580 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:19.657740 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd12520-3032-46ac-a5ce-1fc8cb786580 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:19.664629 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 397/785] 10.222.0.94 () {56 vars in 1087 bytes} [Thu Sep 1 17:14:19 2022] GET /identity/v3/services => generated 772 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:19.670077 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd12520-3032-46ac-a5ce-1fc8cb786580 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:19.694888 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:19.795437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 389/786] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:19.797918 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd12520-3032-46ac-a5ce-1fc8cb786580 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:19.843470 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4b620-09d1-40f4-a203-64989cac84d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:19.844167 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4b620-09d1-40f4-a203-64989cac84d9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:19.844443 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4b620-09d1-40f4-a203-64989cac84d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:19.844712 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4b620-09d1-40f4-a203-64989cac84d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:19.858015 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4b620-09d1-40f4-a203-64989cac84d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:19.859514 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4b620-09d1-40f4-a203-64989cac84d9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:19.878896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-7fb4b620-09d1-40f4-a203-64989cac84d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:19.878896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:19.878896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:19.878896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:19.878896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:19.878896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:19.878896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:19.878896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:19.878896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:19.878896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:19.878896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:19.878896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:19.878896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:19.878896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:19.878896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:19.878896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:19.879898 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:19.879898 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:19.879898 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:19.879898 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:19.879898 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:19.879898 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:19.879898 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:19.879898 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:19.879898 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:19.879898 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:19.879898 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:19.879898 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:19.879898 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:19.879898 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:19.879898 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:19.879898 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:19.879898 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:19.880836 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:19.880836 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:19.880836 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:19.880836 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 398/787] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:19.887495 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c306ec-b3d6-46d1-b55a-1326ce94e3a8 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:19.890505 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:19.915677 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b0b8d-12cb-4678-be24-a9083becf42f None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:19.916002 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b0b8d-12cb-4678-be24-a9083becf42f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:19.916274 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b0b8d-12cb-4678-be24-a9083becf42f None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:19.918042 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 399/788] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:14:19.923668 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c5dbd-7997-4283-a616-53e7bad8ce0f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:19.923951 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c5dbd-7997-4283-a616-53e7bad8ce0f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:19.924225 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c5dbd-7997-4283-a616-53e7bad8ce0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:19.944780 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-af4c5dbd-7997-4283-a616-53e7bad8ce0f None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:19.945996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-af4c5dbd-7997-4283-a616-53e7bad8ce0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:20.014450 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c306ec-b3d6-46d1-b55a-1326ce94e3a8 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:20.019746 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:20.026518 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 400/789] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:20.061469 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e076ef8-2b46-450e-ae79-8062741bc9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:20.062402 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e076ef8-2b46-450e-ae79-8062741bc9b2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:20.062910 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e076ef8-2b46-450e-ae79-8062741bc9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:20.063383 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e076ef8-2b46-450e-ae79-8062741bc9b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:20.064225 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e076ef8-2b46-450e-ae79-8062741bc9b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:20.064727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e076ef8-2b46-450e-ae79-8062741bc9b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:20.066340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e076ef8-2b46-450e-ae79-8062741bc9b2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:20.079359 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 390/790] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:20.084527 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c5dbd-7997-4283-a616-53e7bad8ce0f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:20.138736 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e076ef8-2b46-450e-ae79-8062741bc9b2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:20.211979 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:20.258479 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c5dbd-7997-4283-a616-53e7bad8ce0f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:20.279121 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e076ef8-2b46-450e-ae79-8062741bc9b2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:20.331019 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e12e2-1ec8-459a-adcf-e922d80023ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:20.332039 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e12e2-1ec8-459a-adcf-e922d80023ae None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:20.332550 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e12e2-1ec8-459a-adcf-e922d80023ae None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:20.334811 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e12e2-1ec8-459a-adcf-e922d80023ae None admin] PATH_INFO: `/v3/users/swift` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:20.339731 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4522d-8bdc-44df-a268-497264e22737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:20.340371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4522d-8bdc-44df-a268-497264e22737 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:20.340654 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4522d-8bdc-44df-a268-497264e22737 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:20.341490 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4522d-8bdc-44df-a268-497264e22737 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:20.345054 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e12e2-1ec8-459a-adcf-e922d80023ae None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:20.346914 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e12e2-1ec8-459a-adcf-e922d80023ae None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:20.353834 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4522d-8bdc-44df-a268-497264e22737 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:14:20.359521 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-36a4522d-8bdc-44df-a268-497264e22737 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:14:20.359521 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:20.359521 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:20.359521 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:20.359521 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:20.359521 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:20.359521 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:20.359521 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:20.359521 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:20.359521 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:20.359521 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:20.359521 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:20.359521 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:14:20.359521 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:14:20.359521 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:14:20.359521 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:14:20.360490 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:14:20.360490 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:14:20.360490 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:14:20.360490 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:14:20.360490 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:20.360490 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:20.360490 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:20.360490 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:20.360490 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:20.360490 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:20.360490 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:20.360490 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:20.360490 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:20.360490 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:20.360490 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:20.360490 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:20.361380 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:20.361380 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:20.361380 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:20.361380 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:20.361380 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:14:20.361380 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:14:20.361380 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:14:20.361380 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:14:20.361380 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:14:20.361380 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:14:20.361380 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:14:20.361380 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:20.363466 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-207e12e2-1ec8-459a-adcf-e922d80023ae None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 17:14:20.363466 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:20.363466 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:20.363466 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:20.363466 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:20.363466 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:20.363466 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:20.363466 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:20.363466 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:20.363466 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:20.363466 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:20.363466 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:20.363466 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:14:20.363466 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:14:20.363466 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:14:20.363466 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:14:20.364392 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:20.364392 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:20.364392 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:14:20.364392 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:20.364392 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:14:20.364392 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:20.364392 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:20.364392 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:20.364392 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:20.364392 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:20.364392 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:20.364392 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:20.364392 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:20.364392 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:20.364392 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:20.364392 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:20.364392 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:20.364392 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:20.365341 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:20.365341 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:20.365341 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:14:20.365341 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:14:20.365341 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:14:20.365341 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:14:20.365341 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:14:20.365341 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:14:20.365341 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 17:14:20.365341 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:20.365919 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 391/791] 10.222.0.94 () {56 vars in 1102 bytes} [Thu Sep 1 17:14:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:14:20.366425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4522d-8bdc-44df-a268-497264e22737 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:20.368134 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 401/792] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:14:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:20.369319 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e12e2-1ec8-459a-adcf-e922d80023ae None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:20.443043 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:20.499094 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e12e2-1ec8-459a-adcf-e922d80023ae None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:20.503922 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4522d-8bdc-44df-a268-497264e22737 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:20.537972 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:20.548643 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd5072-8ca4-4e05-abdc-0f01ac0fe87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:20.549266 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd5072-8ca4-4e05-abdc-0f01ac0fe87a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:20.549580 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd5072-8ca4-4e05-abdc-0f01ac0fe87a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:20.549906 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd5072-8ca4-4e05-abdc-0f01ac0fe87a None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:20.550514 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd5072-8ca4-4e05-abdc-0f01ac0fe87a None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:20.550820 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd5072-8ca4-4e05-abdc-0f01ac0fe87a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:20.552337 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd5072-8ca4-4e05-abdc-0f01ac0fe87a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:20.554885 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10bd1c-596c-4c82-8a8b-f3e09ab9dfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:20.555748 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10bd1c-596c-4c82-8a8b-f3e09ab9dfd2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:20.556256 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10bd1c-596c-4c82-8a8b-f3e09ab9dfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:20.556726 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10bd1c-596c-4c82-8a8b-f3e09ab9dfd2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:20.557563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10bd1c-596c-4c82-8a8b-f3e09ab9dfd2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:20.559138 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10bd1c-596c-4c82-8a8b-f3e09ab9dfd2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:20.566018 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 402/793] 10.222.0.94 () {56 vars in 1103 bytes} [Thu Sep 1 17:14:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:20.566918 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd5072-8ca4-4e05-abdc-0f01ac0fe87a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:20.571572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-eb10bd1c-596c-4c82-8a8b-f3e09ab9dfd2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 17:14:20.571572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:20.571572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:14:20.571572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:14:20.571572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:14:20.571572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:14:20.571572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:14:20.571572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:20.571572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 17:14:20.571572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:20.571572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:14:20.571572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:20.571572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:20.571572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:20.571572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:20.571572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:20.571572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:20.572574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:20.572574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:20.572574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:20.572574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:20.572574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:20.572574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:20.572574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:14:20.572574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:14:20.572574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:14:20.572574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:14:20.572574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:20.572574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:20.572574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:20.572574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:20.572574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:20.572574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:20.573496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:20.573496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:20.573496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:20.573496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:20.573496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:20.573496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:20.573496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:20.573496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:20.573496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:20.573496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:20.573496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:14:20.573496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:20.573496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 17:14:20.573496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:20.576852 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 392/794] 10.222.0.94 () {56 vars in 1129 bytes} [Thu Sep 1 17:14:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:20.577961 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10bd1c-596c-4c82-8a8b-f3e09ab9dfd2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:20.680791 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd5072-8ca4-4e05-abdc-0f01ac0fe87a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:20.687057 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10bd1c-596c-4c82-8a8b-f3e09ab9dfd2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:20.709963 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:20.720320 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fa235-0dbf-4df5-b5e6-a1b2f3e5fa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:20.720933 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fa235-0dbf-4df5-b5e6-a1b2f3e5fa96 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:20.721212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fa235-0dbf-4df5-b5e6-a1b2f3e5fa96 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:20.721577 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fa235-0dbf-4df5-b5e6-a1b2f3e5fa96 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:20.722479 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fa235-0dbf-4df5-b5e6-a1b2f3e5fa96 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:20.722799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fa235-0dbf-4df5-b5e6-a1b2f3e5fa96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:20.724249 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fa235-0dbf-4df5-b5e6-a1b2f3e5fa96 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:20.726240 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3dad0-66c9-4b64-95b6-c79f9b1d13e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:20.727119 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3dad0-66c9-4b64-95b6-c79f9b1d13e7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:20.727598 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3dad0-66c9-4b64-95b6-c79f9b1d13e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:20.728079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3dad0-66c9-4b64-95b6-c79f9b1d13e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:20.739912 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3dad0-66c9-4b64-95b6-c79f9b1d13e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:20.741649 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3dad0-66c9-4b64-95b6-c79f9b1d13e7 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:20.747762 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 403/795] 10.222.0.94 () {56 vars in 1135 bytes} [Thu Sep 1 17:14:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:20.749026 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fa235-0dbf-4df5-b5e6-a1b2f3e5fa96 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:20.757197 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-73f3dad0-66c9-4b64-95b6-c79f9b1d13e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:20.757197 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:20.757197 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:20.757197 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:20.757197 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:20.757197 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:20.757197 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:20.757197 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:20.757197 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:20.757197 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:20.757197 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:20.757197 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:20.757197 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:20.757197 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:20.757197 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:20.757197 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:20.758178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:20.758178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:20.758178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:20.758178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:20.758178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:20.758178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:20.758178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:20.758178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:20.758178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:20.758178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:20.758178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:20.758178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:20.758178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:20.758178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:20.758178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:20.758178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:20.758178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:20.759078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:20.759078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:20.759078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:20.761096 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 393/796] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:20.762122 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3dad0-66c9-4b64-95b6-c79f9b1d13e7 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:20.816130 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:20.873524 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fa235-0dbf-4df5-b5e6-a1b2f3e5fa96 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:20.899814 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3dad0-66c9-4b64-95b6-c79f9b1d13e7 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:20.913328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5492ef1-6092-4c54-b0ba-b16a1ace5887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:20.914257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5492ef1-6092-4c54-b0ba-b16a1ace5887 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:20.914748 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5492ef1-6092-4c54-b0ba-b16a1ace5887 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:20.915243 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5492ef1-6092-4c54-b0ba-b16a1ace5887 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:20.916243 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5492ef1-6092-4c54-b0ba-b16a1ace5887 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:20.916819 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5492ef1-6092-4c54-b0ba-b16a1ace5887 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:20.918419 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5492ef1-6092-4c54-b0ba-b16a1ace5887 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:20.924380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 404/797] 10.222.0.94 () {56 vars in 1124 bytes} [Thu Sep 1 17:14:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:20.925480 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5492ef1-6092-4c54-b0ba-b16a1ace5887 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:20.940301 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437c7c0-dd19-4ccd-84e0-6d955645af4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:20.940857 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437c7c0-dd19-4ccd-84e0-6d955645af4c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:20.941131 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437c7c0-dd19-4ccd-84e0-6d955645af4c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:20.941434 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437c7c0-dd19-4ccd-84e0-6d955645af4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:20.955699 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2437c7c0-dd19-4ccd-84e0-6d955645af4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:20.957163 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2437c7c0-dd19-4ccd-84e0-6d955645af4c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:20.972718 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-2437c7c0-dd19-4ccd-84e0-6d955645af4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:20.972718 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:20.972718 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:20.972718 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:20.972718 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:20.972718 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:20.972718 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:20.972718 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:20.972718 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:20.972718 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:20.972718 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:20.972718 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:20.972718 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:20.972718 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:20.972718 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:20.972718 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:20.973774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:20.973774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:20.973774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:20.973774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:20.973774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:20.973774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:20.973774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:20.973774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:20.973774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:20.973774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:20.973774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:20.973774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:20.973774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:20.973774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:20.973774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:20.973774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:20.973774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:20.975350 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:20.975350 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:20.975350 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:20.975350 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 394/798] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:20.975350 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437c7c0-dd19-4ccd-84e0-6d955645af4c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:20.985821 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:21.056152 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5492ef1-6092-4c54-b0ba-b16a1ace5887 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:21.081031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:21.093732 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437c7c0-dd19-4ccd-84e0-6d955645af4c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:21.099834 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bc972-abaf-403f-941b-f4745b345407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:21.100685 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bc972-abaf-403f-941b-f4745b345407 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:21.101684 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bc972-abaf-403f-941b-f4745b345407 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:21.101984 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bc972-abaf-403f-941b-f4745b345407 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:21.102649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970bc972-abaf-403f-941b-f4745b345407 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:21.102958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970bc972-abaf-403f-941b-f4745b345407 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:21.104337 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970bc972-abaf-403f-941b-f4745b345407 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:21.116941 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 405/799] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:21.117807 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bc972-abaf-403f-941b-f4745b345407 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:21.139328 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36268d97-1c90-4d6a-a970-6427eef21094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:21.140666 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36268d97-1c90-4d6a-a970-6427eef21094 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:21.141425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36268d97-1c90-4d6a-a970-6427eef21094 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:21.141925 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36268d97-1c90-4d6a-a970-6427eef21094 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:21.142902 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36268d97-1c90-4d6a-a970-6427eef21094 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:21.143711 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36268d97-1c90-4d6a-a970-6427eef21094 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:21.145749 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36268d97-1c90-4d6a-a970-6427eef21094 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:21.152619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 395/800] 10.222.0.94 () {56 vars in 1124 bytes} [Thu Sep 1 17:14:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:21.154650 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36268d97-1c90-4d6a-a970-6427eef21094 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:21.224161 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bc972-abaf-403f-941b-f4745b345407 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:21.226541 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:21.271728 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77bb4d-adf0-4dad-9eaf-dd8df9469071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:21.272540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77bb4d-adf0-4dad-9eaf-dd8df9469071 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:21.272884 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77bb4d-adf0-4dad-9eaf-dd8df9469071 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:21.273534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77bb4d-adf0-4dad-9eaf-dd8df9469071 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:21.274510 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77bb4d-adf0-4dad-9eaf-dd8df9469071 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:21.274885 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77bb4d-adf0-4dad-9eaf-dd8df9469071 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:21.276341 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77bb4d-adf0-4dad-9eaf-dd8df9469071 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:21.276892 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36268d97-1c90-4d6a-a970-6427eef21094 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:21.292213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 406/801] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:21.293447 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77bb4d-adf0-4dad-9eaf-dd8df9469071 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:21.313826 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2601b-b0c8-48b9-855f-a9af6f653781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:21.314748 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2601b-b0c8-48b9-855f-a9af6f653781 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:21.315236 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2601b-b0c8-48b9-855f-a9af6f653781 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:21.315778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2601b-b0c8-48b9-855f-a9af6f653781 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:21.326272 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2601b-b0c8-48b9-855f-a9af6f653781 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:21.328946 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2601b-b0c8-48b9-855f-a9af6f653781 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:21.343743 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-57d2601b-b0c8-48b9-855f-a9af6f653781 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 17:14:21.343743 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:21.343743 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:21.343743 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:21.343743 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:21.343743 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:21.343743 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:21.343743 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:21.343743 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:21.343743 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:21.343743 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:21.343743 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:21.343743 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:14:21.343743 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:14:21.343743 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:14:21.343743 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:14:21.344733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:21.344733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:21.344733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:14:21.344733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:21.344733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:14:21.344733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:21.344733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:21.344733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:21.344733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:21.344733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:21.344733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:21.344733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:21.344733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:21.344733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:21.344733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:21.344733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:21.344733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:21.344733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:21.345753 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:21.345753 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:21.345753 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:14:21.345753 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:14:21.345753 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:14:21.345753 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:14:21.345753 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:14:21.345753 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:14:21.345753 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 17:14:21.345753 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:21.347064 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 396/802] 10.222.0.94 () {56 vars in 1117 bytes} [Thu Sep 1 17:14:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:21.347781 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2601b-b0c8-48b9-855f-a9af6f653781 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:21.373777 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:21.422940 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77bb4d-adf0-4dad-9eaf-dd8df9469071 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:21.460668 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236d7e4-00cd-41f5-8e35-c7d6e09427f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:21.461338 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236d7e4-00cd-41f5-8e35-c7d6e09427f1 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:21.461575 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236d7e4-00cd-41f5-8e35-c7d6e09427f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:21.461882 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236d7e4-00cd-41f5-8e35-c7d6e09427f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:21.462557 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a236d7e4-00cd-41f5-8e35-c7d6e09427f1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:21.463927 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a236d7e4-00cd-41f5-8e35-c7d6e09427f1 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:21.491469 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2601b-b0c8-48b9-855f-a9af6f653781 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:21.493873 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 407/803] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:14:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:14:21.494845 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236d7e4-00cd-41f5-8e35-c7d6e09427f1 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:21.536326 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:21.552530 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5978e4-f97b-4ee3-a82e-eee6d4794124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:21.553694 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5978e4-f97b-4ee3-a82e-eee6d4794124 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:21.554227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5978e4-f97b-4ee3-a82e-eee6d4794124 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:21.554704 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5978e4-f97b-4ee3-a82e-eee6d4794124 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:21.562697 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5978e4-f97b-4ee3-a82e-eee6d4794124 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:21.564685 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5978e4-f97b-4ee3-a82e-eee6d4794124 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:21.578969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-2c5978e4-f97b-4ee3-a82e-eee6d4794124 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:21.578969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:21.578969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:21.578969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:21.578969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:21.578969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:21.578969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:21.578969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:21.578969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:21.578969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:21.578969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:21.578969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:21.578969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:14:21.578969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:14:21.578969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:14:21.579967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:14:21.579967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:21.579967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:21.579967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:21.579967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:21.579967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:21.579967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:21.579967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:21.579967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:21.579967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:21.579967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:21.579967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:21.579967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:21.579967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:21.579967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:21.579967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:21.579967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:21.580925 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:14:21.580925 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:14:21.580925 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:14:21.580925 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:14:21.580925 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:14:21.580925 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:14:21.580925 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:21.580925 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:21.580925 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 397/804] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:14:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:21.582195 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215a069-8ad3-4308-8ae8-36cc6927e406 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:21.582549 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215a069-8ad3-4308-8ae8-36cc6927e406 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:21.582895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215a069-8ad3-4308-8ae8-36cc6927e406 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:21.588180 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 398/805] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:21.588180 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215a069-8ad3-4308-8ae8-36cc6927e406 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:21.660432 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236d7e4-00cd-41f5-8e35-c7d6e09427f1 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:21.680490 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:21.705299 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29798376-6674-49bf-b10a-88264d4ee328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:21.705969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29798376-6674-49bf-b10a-88264d4ee328 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:21.706248 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29798376-6674-49bf-b10a-88264d4ee328 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:21.706520 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29798376-6674-49bf-b10a-88264d4ee328 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:21.707261 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29798376-6674-49bf-b10a-88264d4ee328 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:21.707566 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29798376-6674-49bf-b10a-88264d4ee328 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:21.709016 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29798376-6674-49bf-b10a-88264d4ee328 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:21.725766 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215a069-8ad3-4308-8ae8-36cc6927e406 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:21.732810 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 408/806] 10.222.0.94 () {56 vars in 1149 bytes} [Thu Sep 1 17:14:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:21.734738 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d6082-d4af-4d1d-96a4-91f2bf13b19e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:21.735190 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d6082-d4af-4d1d-96a4-91f2bf13b19e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:21.735612 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d6082-d4af-4d1d-96a4-91f2bf13b19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:21.757080 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ad6d6082-d4af-4d1d-96a4-91f2bf13b19e None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:21.758962 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ad6d6082-d4af-4d1d-96a4-91f2bf13b19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:21.768318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f73a7-0d07-4b12-a536-de58e98bc9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:21.769345 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f73a7-0d07-4b12-a536-de58e98bc9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:21.769669 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f73a7-0d07-4b12-a536-de58e98bc9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:21.769941 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f73a7-0d07-4b12-a536-de58e98bc9a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:21.770641 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8f73a7-0d07-4b12-a536-de58e98bc9a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:21.770944 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8f73a7-0d07-4b12-a536-de58e98bc9a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:21.773077 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8f73a7-0d07-4b12-a536-de58e98bc9a3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:21.792181 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 399/807] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:14:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:21.792181 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f73a7-0d07-4b12-a536-de58e98bc9a3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:21.842593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 409/808] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:21.848040 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d6082-d4af-4d1d-96a4-91f2bf13b19e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:21.865716 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:21.926458 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f73a7-0d07-4b12-a536-de58e98bc9a3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:21.958038 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:21.966511 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a195e-e947-4f86-8875-3e98a9e884af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:21.967198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a195e-e947-4f86-8875-3e98a9e884af None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:21.967567 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a195e-e947-4f86-8875-3e98a9e884af None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:21.967753 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a195e-e947-4f86-8875-3e98a9e884af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:21.976595 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d6082-d4af-4d1d-96a4-91f2bf13b19e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:21.979364 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a195e-e947-4f86-8875-3e98a9e884af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:21.980915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a195e-e947-4f86-8875-3e98a9e884af None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:21.999619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-f14a195e-e947-4f86-8875-3e98a9e884af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:21.999619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:21.999619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:21.999619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:21.999619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:21.999619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:21.999619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:21.999619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:21.999619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:21.999619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:21.999619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:21.999619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:21.999619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:21.999619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:21.999619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:21.999619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:22.000740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:22.000740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:22.000740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:22.000740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:22.000740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:22.000740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:22.000740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:22.000740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:22.000740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:22.000740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:22.000740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:22.000740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:22.000740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:22.000740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:22.000740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:22.000740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:22.000740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:22.001711 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:22.001711 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:22.001711 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:22.001711 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 400/809] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:22.002453 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382874ce-8556-469d-832e-c50af5c99391 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:22.002740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382874ce-8556-469d-832e-c50af5c99391 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:22.003015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382874ce-8556-469d-832e-c50af5c99391 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:22.008625 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 401/810] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:22.009304 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382874ce-8556-469d-832e-c50af5c99391 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:22.021701 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3de7f-1ee2-4585-bb0e-faf0b79d719e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:22.022955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3de7f-1ee2-4585-bb0e-faf0b79d719e None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:22.023438 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3de7f-1ee2-4585-bb0e-faf0b79d719e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:22.024174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3de7f-1ee2-4585-bb0e-faf0b79d719e None admin] PATH_INFO: `/v3/projects/c8f9428f37354c82ac52b6b8eccc424a/users/af7ebf43f36c4862a3c527941e033666/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:22.026776 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3de7f-1ee2-4585-bb0e-faf0b79d719e None admin] RBAC: Authorizing `identity:create_grant(project_id=c8f9428f37354c82ac52b6b8eccc424a, user_id=af7ebf43f36c4862a3c527941e033666, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:22.029130 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3de7f-1ee2-4585-bb0e-faf0b79d719e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:22.053439 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 410/811] 10.222.0.94 () {58 vars in 1439 bytes} [Thu Sep 1 17:14:21 2022] PUT /identity/v3/projects/c8f9428f37354c82ac52b6b8eccc424a/users/af7ebf43f36c4862a3c527941e033666/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:14:22.056473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05bca5-fde7-4e3a-99d9-92ef26f17ef9 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:22.056473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05bca5-fde7-4e3a-99d9-92ef26f17ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:22.056473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05bca5-fde7-4e3a-99d9-92ef26f17ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:22.097961 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-7e05bca5-fde7-4e3a-99d9-92ef26f17ef9 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:22.100439 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7e05bca5-fde7-4e3a-99d9-92ef26f17ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:22.163799 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382874ce-8556-469d-832e-c50af5c99391 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:22.202300 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:22.204315 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614539e0-1b73-455c-8784-59593f17c756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:22.204315 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614539e0-1b73-455c-8784-59593f17c756 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:22.204634 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614539e0-1b73-455c-8784-59593f17c756 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:22.205387 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614539e0-1b73-455c-8784-59593f17c756 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:22.206497 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614539e0-1b73-455c-8784-59593f17c756 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:22.207217 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614539e0-1b73-455c-8784-59593f17c756 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:22.208733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614539e0-1b73-455c-8784-59593f17c756 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:22.209215 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 411/812] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:22.210106 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05bca5-fde7-4e3a-99d9-92ef26f17ef9 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:22.226020 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 402/813] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:22.235086 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614539e0-1b73-455c-8784-59593f17c756 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:22.296634 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:22.325945 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05bca5-fde7-4e3a-99d9-92ef26f17ef9 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:22.368330 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614539e0-1b73-455c-8784-59593f17c756 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:22.421459 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb05583-bebf-4e84-9ea7-df40cbfd9752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:22.422116 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb05583-bebf-4e84-9ea7-df40cbfd9752 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:22.422396 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb05583-bebf-4e84-9ea7-df40cbfd9752 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:22.422672 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb05583-bebf-4e84-9ea7-df40cbfd9752 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:22.424738 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6ce9d-fba8-43ce-9f96-22f3627bcbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:22.425366 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6ce9d-fba8-43ce-9f96-22f3627bcbe1 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:22.425667 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6ce9d-fba8-43ce-9f96-22f3627bcbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:22.425936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6ce9d-fba8-43ce-9f96-22f3627bcbe1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:22.438629 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6ce9d-fba8-43ce-9f96-22f3627bcbe1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:22.444240 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6ce9d-fba8-43ce-9f96-22f3627bcbe1 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:22.446589 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb05583-bebf-4e84-9ea7-df40cbfd9752 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:14:22.460484 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-ccb05583-bebf-4e84-9ea7-df40cbfd9752 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:14:22.460484 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:22.460484 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:22.460484 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:22.460484 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:22.460484 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:22.460484 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:22.460484 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:22.460484 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:22.460484 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:22.460484 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:22.460484 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:22.460484 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:14:22.460484 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:14:22.460484 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:14:22.460484 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:14:22.461925 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:14:22.461925 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:14:22.461925 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:14:22.461925 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:14:22.461925 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:22.461925 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:22.461925 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:22.461925 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:22.461925 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:22.461925 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:22.461925 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:22.461925 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:22.461925 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:22.461925 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:22.461925 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:22.461925 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:22.462792 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:22.462792 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:22.462792 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:22.462792 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:22.462792 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:14:22.462792 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:14:22.462792 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:14:22.462792 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:14:22.462792 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:14:22.462792 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:14:22.462792 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:14:22.462792 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:22.462792 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 412/814] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:14:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:22.464713 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-e9f6ce9d-fba8-43ce-9f96-22f3627bcbe1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:22.464713 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:22.464713 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:22.464713 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:22.464713 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:22.464713 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:22.464713 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:22.464713 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:22.464713 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:22.464713 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:22.464713 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:22.464713 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:22.464713 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:14:22.464713 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:14:22.464713 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:14:22.467433 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:14:22.467433 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:22.467433 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:22.467433 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:22.467433 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:22.467433 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:22.467433 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:22.467433 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:22.467433 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:22.467433 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:22.467433 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:22.467433 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:22.467433 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:22.467433 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:22.467433 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:22.467433 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:22.467433 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:22.469534 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:14:22.469534 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:14:22.469534 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:14:22.469534 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:14:22.469534 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:14:22.469534 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:14:22.469534 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:22.469534 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:22.469534 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 403/815] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:14:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:14:22.472317 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6ce9d-fba8-43ce-9f96-22f3627bcbe1 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:22.472517 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb05583-bebf-4e84-9ea7-df40cbfd9752 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:22.576975 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:22.588719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6ce9d-fba8-43ce-9f96-22f3627bcbe1 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:22.590564 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:22.628098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb05583-bebf-4e84-9ea7-df40cbfd9752 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:22.644033 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8fb7b5-713a-4fca-8c2b-e93a42aeface None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:22.645041 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fb7b5-713a-4fca-8c2b-e93a42aeface None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:22.645334 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fb7b5-713a-4fca-8c2b-e93a42aeface None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:22.645789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fb7b5-713a-4fca-8c2b-e93a42aeface None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:22.646490 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8fb7b5-713a-4fca-8c2b-e93a42aeface None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:22.646796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8fb7b5-713a-4fca-8c2b-e93a42aeface None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:22.648342 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8fb7b5-713a-4fca-8c2b-e93a42aeface None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:22.661786 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 404/816] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:14:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:22.662629 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8fb7b5-713a-4fca-8c2b-e93a42aeface None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:22.671253 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e3c7f-3d7e-4e72-b76c-c195fe6d28c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:22.671958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e3c7f-3d7e-4e72-b76c-c195fe6d28c7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:22.672237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e3c7f-3d7e-4e72-b76c-c195fe6d28c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:22.672503 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e3c7f-3d7e-4e72-b76c-c195fe6d28c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:22.673165 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e3c7f-3d7e-4e72-b76c-c195fe6d28c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:22.673594 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e3c7f-3d7e-4e72-b76c-c195fe6d28c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:22.675061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e3c7f-3d7e-4e72-b76c-c195fe6d28c7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:22.684106 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 413/817] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:14:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:22.685687 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e3c7f-3d7e-4e72-b76c-c195fe6d28c7 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:22.798665 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8fb7b5-713a-4fca-8c2b-e93a42aeface None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:22.808370 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e3c7f-3d7e-4e72-b76c-c195fe6d28c7 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:22.831621 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:22.849705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e75947-ffce-4478-a920-ac3c5deec159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:22.850334 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e75947-ffce-4478-a920-ac3c5deec159 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:22.850606 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e75947-ffce-4478-a920-ac3c5deec159 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:22.850871 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e75947-ffce-4478-a920-ac3c5deec159 None admin] PATH_INFO: `/v3/services/network` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:22.851445 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e75947-ffce-4478-a920-ac3c5deec159 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:22.852799 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e75947-ffce-4478-a920-ac3c5deec159 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:22.853728 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a405fca-787d-4f23-bae1-97d3dc5f1d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:22.854373 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a405fca-787d-4f23-bae1-97d3dc5f1d70 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:22.854641 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a405fca-787d-4f23-bae1-97d3dc5f1d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:22.854906 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a405fca-787d-4f23-bae1-97d3dc5f1d70 None admin] PATH_INFO: `/v3/projects/c8f9428f37354c82ac52b6b8eccc424a/users/9e7444bc40314e73b282217bbb94798d/roles/e903cb11e2bf466fa1b3fae894847c3e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:22.865896 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-96e75947-ffce-4478-a920-ac3c5deec159 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 17:14:22.865896 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:22.865896 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:14:22.865896 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:14:22.865896 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:14:22.865896 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:14:22.865896 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:14:22.865896 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:22.865896 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 17:14:22.865896 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:22.865896 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:14:22.865896 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:22.865896 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:22.865896 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:22.865896 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:22.865896 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:22.865896 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:22.866901 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:22.866901 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:22.866901 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:22.866901 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:22.866901 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:22.866901 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:22.866901 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:14:22.866901 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:14:22.866901 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:14:22.866901 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:14:22.866901 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:22.866901 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:22.866901 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:22.866901 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:22.866901 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:22.866901 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:22.867778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:22.867778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:22.867778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:22.867778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:22.867778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:22.867778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:22.867778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:22.867778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:22.867778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:22.867778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:22.867778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:14:22.867778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:22.867778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 17:14:22.867778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:22.871076 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 405/818] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:14:22 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:22.872057 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e75947-ffce-4478-a920-ac3c5deec159 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:22.878711 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a405fca-787d-4f23-bae1-97d3dc5f1d70 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8f9428f37354c82ac52b6b8eccc424a, user_id=9e7444bc40314e73b282217bbb94798d, role_id=e903cb11e2bf466fa1b3fae894847c3e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:22.881747 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a405fca-787d-4f23-bae1-97d3dc5f1d70 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:22.906112 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:22.906319 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 414/819] 10.222.0.94 () {58 vars in 1439 bytes} [Thu Sep 1 17:14:22 2022] PUT /identity/v3/projects/c8f9428f37354c82ac52b6b8eccc424a/users/9e7444bc40314e73b282217bbb94798d/roles/e903cb11e2bf466fa1b3fae894847c3e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:14:22.907773 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a405fca-787d-4f23-bae1-97d3dc5f1d70 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:23.012599 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e75947-ffce-4478-a920-ac3c5deec159 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:23.058304 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be36b9-abd3-44a7-bd7d-380fa36e528b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:23.059356 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be36b9-abd3-44a7-bd7d-380fa36e528b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:23.060503 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be36b9-abd3-44a7-bd7d-380fa36e528b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:23.061048 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be36b9-abd3-44a7-bd7d-380fa36e528b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:23.075463 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be36b9-abd3-44a7-bd7d-380fa36e528b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:23.077297 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be36b9-abd3-44a7-bd7d-380fa36e528b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:23.095682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-f9be36b9-abd3-44a7-bd7d-380fa36e528b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:23.095682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:23.095682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:23.095682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:23.095682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:23.095682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:23.095682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:23.095682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:23.095682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:23.095682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:23.095682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:23.095682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:23.095682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:23.095682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:23.095682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:23.095682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:23.096675 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:23.096675 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:23.096675 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:23.096675 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:23.096675 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:23.096675 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:23.096675 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:23.096675 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:23.096675 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:23.096675 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:23.096675 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:23.096675 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:23.096675 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:23.096675 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:23.096675 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:23.096675 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:23.096675 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:23.097633 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:23.097633 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:23.097633 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:23.101866 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 406/820] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:23.105048 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be36b9-abd3-44a7-bd7d-380fa36e528b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:23.128851 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a405fca-787d-4f23-bae1-97d3dc5f1d70 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:23.173743 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849fbb2-bff1-4913-bdc7-260c975ffc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:23.174729 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849fbb2-bff1-4913-bdc7-260c975ffc89 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:23.175214 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849fbb2-bff1-4913-bdc7-260c975ffc89 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:23.175703 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849fbb2-bff1-4913-bdc7-260c975ffc89 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:23.176543 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849fbb2-bff1-4913-bdc7-260c975ffc89 None admin] RBAC: Adding query filter params (name=network) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:23.177062 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849fbb2-bff1-4913-bdc7-260c975ffc89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:23.178700 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849fbb2-bff1-4913-bdc7-260c975ffc89 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:23.184574 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 415/821] 10.222.0.94 () {56 vars in 1112 bytes} [Thu Sep 1 17:14:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:23.191314 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849fbb2-bff1-4913-bdc7-260c975ffc89 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:23.228398 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:23.234817 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:23.257841 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be36b9-abd3-44a7-bd7d-380fa36e528b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:23.299971 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57cf10-91f8-434b-b3bb-c3ae0702f4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:23.301606 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57cf10-91f8-434b-b3bb-c3ae0702f4ea None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:23.303407 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57cf10-91f8-434b-b3bb-c3ae0702f4ea None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:23.304626 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57cf10-91f8-434b-b3bb-c3ae0702f4ea None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:23.306065 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57cf10-91f8-434b-b3bb-c3ae0702f4ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:23.306733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57cf10-91f8-434b-b3bb-c3ae0702f4ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:23.311204 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57cf10-91f8-434b-b3bb-c3ae0702f4ea None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:23.334562 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 407/822] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:23.341904 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57cf10-91f8-434b-b3bb-c3ae0702f4ea None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:23.381747 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849fbb2-bff1-4913-bdc7-260c975ffc89 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:23.448385 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa6612-8909-4998-aa7a-b8b079880f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:23.450073 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa6612-8909-4998-aa7a-b8b079880f97 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:23.451222 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa6612-8909-4998-aa7a-b8b079880f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:23.451702 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa6612-8909-4998-aa7a-b8b079880f97 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:23.452721 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa6612-8909-4998-aa7a-b8b079880f97 None admin] RBAC: Adding query filter params (type=network) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:23.454585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa6612-8909-4998-aa7a-b8b079880f97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:23.456178 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa6612-8909-4998-aa7a-b8b079880f97 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:23.468708 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 416/823] 10.222.0.94 () {56 vars in 1112 bytes} [Thu Sep 1 17:14:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:23.474860 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa6612-8909-4998-aa7a-b8b079880f97 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:23.526735 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57cf10-91f8-434b-b3bb-c3ae0702f4ea None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:23.606491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12279ba7-d60e-4601-a9ce-d9151f85df16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:23.607138 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12279ba7-d60e-4601-a9ce-d9151f85df16 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:23.607417 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12279ba7-d60e-4601-a9ce-d9151f85df16 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:23.607688 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12279ba7-d60e-4601-a9ce-d9151f85df16 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:23.624198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12279ba7-d60e-4601-a9ce-d9151f85df16 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:23.627329 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12279ba7-d60e-4601-a9ce-d9151f85df16 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:23.632284 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:23.649330 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-12279ba7-d60e-4601-a9ce-d9151f85df16 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:14:23.649330 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:23.649330 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:23.649330 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:23.649330 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:23.649330 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:23.649330 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:23.649330 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:23.649330 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:23.649330 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:23.649330 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:23.649330 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:23.649330 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:14:23.649330 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:14:23.649330 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:14:23.649330 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:14:23.650396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:23.650396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:23.650396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:14:23.650396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:23.650396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:14:23.650396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:23.650396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:23.650396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:23.650396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:23.650396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:23.650396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:23.650396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:23.650396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:23.650396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:23.650396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:23.650396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:23.650396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:23.650396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:23.651357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:23.651357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:23.651357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:14:23.651357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:14:23.651357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:14:23.651357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:14:23.651357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:14:23.651357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:14:23.651357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:14:23.651357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:23.651900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:23.653471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 408/824] 10.222.0.94 () {56 vars in 1093 bytes} [Thu Sep 1 17:14:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:23.654326 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5359572-6e26-4302-8d6c-610adb5c43df None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:23.654609 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5359572-6e26-4302-8d6c-610adb5c43df None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:23.657452 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa6612-8909-4998-aa7a-b8b079880f97 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:23.657598 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5359572-6e26-4302-8d6c-610adb5c43df None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:23.657598 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 409/825] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:23.662318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5359572-6e26-4302-8d6c-610adb5c43df None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:23.693220 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd790e-afbb-4f61-a6e8-833a512739df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:23.693860 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd790e-afbb-4f61-a6e8-833a512739df None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:23.694290 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd790e-afbb-4f61-a6e8-833a512739df None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:23.694566 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd790e-afbb-4f61-a6e8-833a512739df None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:23.695359 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd790e-afbb-4f61-a6e8-833a512739df None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:23.696731 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd790e-afbb-4f61-a6e8-833a512739df None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:23.719791 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 417/826] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:14:23 2022] POST /identity/v3/endpoints => generated 337 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:14:23.721165 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff8db9-57ac-4692-8c4e-c7a2c788d98e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:23.721480 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff8db9-57ac-4692-8c4e-c7a2c788d98e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:23.721759 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff8db9-57ac-4692-8c4e-c7a2c788d98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:23.742686 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e0ff8db9-57ac-4692-8c4e-c7a2c788d98e None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:23.744013 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e0ff8db9-57ac-4692-8c4e-c7a2c788d98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:23.821888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5359572-6e26-4302-8d6c-610adb5c43df None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:23.874434 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 418/827] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:23.883745 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36194bbc-933b-4a2c-9783-e92c4c5640aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:23.884290 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36194bbc-933b-4a2c-9783-e92c4c5640aa None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:23.884564 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36194bbc-933b-4a2c-9783-e92c4c5640aa None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:23.884831 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36194bbc-933b-4a2c-9783-e92c4c5640aa None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:23.885589 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36194bbc-933b-4a2c-9783-e92c4c5640aa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:23.885957 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36194bbc-933b-4a2c-9783-e92c4c5640aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:23.887378 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36194bbc-933b-4a2c-9783-e92c4c5640aa None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:23.907234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 410/828] 10.222.0.94 () {56 vars in 1133 bytes} [Thu Sep 1 17:14:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:23.914968 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff8db9-57ac-4692-8c4e-c7a2c788d98e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:24.002260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:24.027923 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff8db9-57ac-4692-8c4e-c7a2c788d98e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:24.064380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd9836-dbc4-4944-add8-ac51bae4c98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:24.064993 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd9836-dbc4-4944-add8-ac51bae4c98e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:24.065271 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd9836-dbc4-4944-add8-ac51bae4c98e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:24.065572 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd9836-dbc4-4944-add8-ac51bae4c98e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:24.140027 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd9836-dbc4-4944-add8-ac51bae4c98e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:24.141419 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd9836-dbc4-4944-add8-ac51bae4c98e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:24.181969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36194bbc-933b-4a2c-9783-e92c4c5640aa None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:24.241686 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:24.258123 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:24.264936 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 419/829] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:14:23 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 17:14:24.271664 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd9836-dbc4-4944-add8-ac51bae4c98e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:24.323150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36194bbc-933b-4a2c-9783-e92c4c5640aa None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:24.367568 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97181c-3831-4bc3-85c0-708633f5a69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:24.368203 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97181c-3831-4bc3-85c0-708633f5a69b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:24.368477 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97181c-3831-4bc3-85c0-708633f5a69b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:24.368744 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97181c-3831-4bc3-85c0-708633f5a69b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:24.369321 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97181c-3831-4bc3-85c0-708633f5a69b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:24.370711 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97181c-3831-4bc3-85c0-708633f5a69b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:24.381547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-5f97181c-3831-4bc3-85c0-708633f5a69b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 17:14:24.381547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:24.381547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:14:24.381547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:14:24.381547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:14:24.381547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:14:24.381547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:14:24.381547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:24.381547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 17:14:24.381547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:24.381547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:14:24.381547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:24.381547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:24.381547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:24.381547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:24.381547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:24.381547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:24.382569 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:24.382569 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:24.382569 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:24.382569 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:24.382569 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:24.382569 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:24.382569 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:14:24.382569 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:14:24.382569 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:14:24.382569 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:14:24.382569 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:24.382569 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:24.382569 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:24.382569 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:24.382569 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:24.382569 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:24.383511 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:24.383511 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:24.383511 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:24.383511 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:24.383511 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:24.383511 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:24.383511 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:24.383511 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:24.383511 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:24.383511 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:24.383511 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:14:24.383511 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:24.383511 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 17:14:24.383511 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:24.383511 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 411/830] 10.222.0.94 () {56 vars in 1114 bytes} [Thu Sep 1 17:14:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:24.384315 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd9836-dbc4-4944-add8-ac51bae4c98e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:24.384399 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ebcee-bdf3-4a88-8cac-e51f80f6ebc1 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:24.384399 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ebcee-bdf3-4a88-8cac-e51f80f6ebc1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:24.385300 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ebcee-bdf3-4a88-8cac-e51f80f6ebc1 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:24.386761 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 412/831] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:24.390374 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ebcee-bdf3-4a88-8cac-e51f80f6ebc1 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:24.419742 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39799604-636c-4925-b63e-cde6934bc8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:24.420656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39799604-636c-4925-b63e-cde6934bc8d3 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:24.421013 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39799604-636c-4925-b63e-cde6934bc8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:24.421289 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39799604-636c-4925-b63e-cde6934bc8d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:24.431774 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39799604-636c-4925-b63e-cde6934bc8d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:24.433213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39799604-636c-4925-b63e-cde6934bc8d3 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:24.451555 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-39799604-636c-4925-b63e-cde6934bc8d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:24.451555 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:24.451555 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:24.451555 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:24.451555 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:24.451555 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:24.451555 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:24.451555 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:24.451555 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:24.451555 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:24.451555 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:24.451555 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:24.451555 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:24.451555 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:24.451555 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:24.451555 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:24.452670 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:24.452670 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:24.452670 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:24.452670 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:24.452670 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:24.452670 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:24.452670 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:24.452670 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:24.452670 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:24.452670 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:24.452670 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:24.452670 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:24.452670 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:24.452670 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:24.452670 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:24.452670 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:24.452670 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:24.453893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:24.453893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:24.453893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:24.453893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 420/832] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:24.454132 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8abe4-44d7-4961-b50d-8830369ab38e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:24.454393 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8abe4-44d7-4961-b50d-8830369ab38e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:24.454666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8abe4-44d7-4961-b50d-8830369ab38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:24.476328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-14b8abe4-44d7-4961-b50d-8830369ab38e None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:24.479871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-14b8abe4-44d7-4961-b50d-8830369ab38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:24.508426 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ebcee-bdf3-4a88-8cac-e51f80f6ebc1 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:24.511293 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:24.530930 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:24.552495 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591bbd31-4f86-43cb-8e08-9cf43c14baee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:24.553100 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bbd31-4f86-43cb-8e08-9cf43c14baee None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:24.553378 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bbd31-4f86-43cb-8e08-9cf43c14baee None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:24.553684 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bbd31-4f86-43cb-8e08-9cf43c14baee None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:24.554310 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591bbd31-4f86-43cb-8e08-9cf43c14baee None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:24.554624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591bbd31-4f86-43cb-8e08-9cf43c14baee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:24.555958 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591bbd31-4f86-43cb-8e08-9cf43c14baee None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:24.559545 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 421/833] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:24.560571 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8abe4-44d7-4961-b50d-8830369ab38e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:24.565332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 413/834] 10.222.0.94 () {56 vars in 1114 bytes} [Thu Sep 1 17:14:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:24.566195 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591bbd31-4f86-43cb-8e08-9cf43c14baee None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:24.680589 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591bbd31-4f86-43cb-8e08-9cf43c14baee None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:24.687677 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8abe4-44d7-4961-b50d-8830369ab38e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:24.717082 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13524e-6674-4ca2-8509-999d9e379bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:24.717481 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13524e-6674-4ca2-8509-999d9e379bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:24.717834 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13524e-6674-4ca2-8509-999d9e379bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:24.718211 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13524e-6674-4ca2-8509-999d9e379bd0 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:24.718901 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13524e-6674-4ca2-8509-999d9e379bd0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:24.719241 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13524e-6674-4ca2-8509-999d9e379bd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:24.720660 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13524e-6674-4ca2-8509-999d9e379bd0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:24.733727 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8ec7e-6076-4e63-b011-979dce95f09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:24.733940 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 414/835] 10.222.0.94 () {56 vars in 1114 bytes} [Thu Sep 1 17:14:24 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:24.734794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8ec7e-6076-4e63-b011-979dce95f09e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:24.735255 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8ec7e-6076-4e63-b011-979dce95f09e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:24.735721 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8ec7e-6076-4e63-b011-979dce95f09e None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:24.736586 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8ec7e-6076-4e63-b011-979dce95f09e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:24.737076 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8ec7e-6076-4e63-b011-979dce95f09e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:24.738750 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8ec7e-6076-4e63-b011-979dce95f09e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:24.753134 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 422/836] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:24.762575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13524e-6674-4ca2-8509-999d9e379bd0 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:24.816288 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:24.841631 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8ec7e-6076-4e63-b011-979dce95f09e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:24.895377 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13524e-6674-4ca2-8509-999d9e379bd0 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:24.941579 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbfa7b-cfc5-4330-9b7e-e0229079b0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:24.942148 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbfa7b-cfc5-4330-9b7e-e0229079b0c8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:24.942428 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbfa7b-cfc5-4330-9b7e-e0229079b0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:24.942705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbfa7b-cfc5-4330-9b7e-e0229079b0c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:24.951035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbfa7b-cfc5-4330-9b7e-e0229079b0c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:24.952517 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbfa7b-cfc5-4330-9b7e-e0229079b0c8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:24.965680 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-10cbfa7b-cfc5-4330-9b7e-e0229079b0c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:24.965680 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:24.965680 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:24.965680 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:24.965680 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:24.965680 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:24.965680 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:24.965680 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:24.965680 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:24.965680 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:24.965680 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:24.965680 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:24.965680 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:14:24.965680 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:14:24.965680 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:14:24.966708 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:14:24.966708 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:24.966708 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:24.966708 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:24.966708 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:24.966708 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:24.966708 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:24.966708 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:24.966708 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:24.966708 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:24.966708 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:24.966708 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:24.966708 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:24.966708 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:24.966708 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:24.966708 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:24.966708 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:24.967627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:14:24.967627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:14:24.967627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:14:24.967627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:14:24.967627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:14:24.967627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:14:24.967627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:24.967627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:24.971747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 415/837] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:14:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:24.973021 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbfa7b-cfc5-4330-9b7e-e0229079b0c8 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:25.012036 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:25.083095 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbfa7b-cfc5-4330-9b7e-e0229079b0c8 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:25.085975 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8ec7e-6076-4e63-b011-979dce95f09e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:25.092691 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:25.122755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2326ef-6720-401b-9d6d-ee7603b36c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:25.123382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2326ef-6720-401b-9d6d-ee7603b36c48 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:25.123664 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2326ef-6720-401b-9d6d-ee7603b36c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:25.123945 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2326ef-6720-401b-9d6d-ee7603b36c48 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:25.124482 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b662da-e2e4-48df-b6f3-5330ac4c4728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:25.124692 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2326ef-6720-401b-9d6d-ee7603b36c48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:25.124957 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2326ef-6720-401b-9d6d-ee7603b36c48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:25.125816 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b662da-e2e4-48df-b6f3-5330ac4c4728 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:25.126321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b662da-e2e4-48df-b6f3-5330ac4c4728 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:25.126424 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2326ef-6720-401b-9d6d-ee7603b36c48 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:25.126872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b662da-e2e4-48df-b6f3-5330ac4c4728 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:25.138274 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b662da-e2e4-48df-b6f3-5330ac4c4728 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:14:25.143321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-58b662da-e2e4-48df-b6f3-5330ac4c4728 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:14:25.143321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:25.143321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:25.143321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:25.143321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:25.143321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:25.143321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:25.143321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:25.143321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:25.143321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:25.143321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:25.143321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:25.143321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:14:25.143321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:14:25.143321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:14:25.143321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:14:25.144253 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:14:25.144253 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:14:25.144253 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:14:25.144253 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:14:25.144253 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:25.144253 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:25.144253 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:25.144253 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:25.144253 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:25.144253 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:25.144253 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:25.144253 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:25.144253 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:25.144253 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:25.144253 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:25.144253 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:25.145111 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:25.145111 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:25.145111 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:25.145111 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:25.145111 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:14:25.145111 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:14:25.145111 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:14:25.145111 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:14:25.145111 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:14:25.145111 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:14:25.145111 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:14:25.145111 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:25.146930 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 416/838] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:14:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:25.148155 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 423/839] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:14:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:14:25.148330 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2326ef-6720-401b-9d6d-ee7603b36c48 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:25.151205 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561eab3-467c-4bc1-b84c-ec0a006eab62 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:25.151486 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561eab3-467c-4bc1-b84c-ec0a006eab62 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:25.151758 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561eab3-467c-4bc1-b84c-ec0a006eab62 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:25.156748 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 424/840] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:25.157546 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4561eab3-467c-4bc1-b84c-ec0a006eab62 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:25.251458 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2326ef-6720-401b-9d6d-ee7603b36c48 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:25.255142 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:25.275738 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4561eab3-467c-4bc1-b84c-ec0a006eab62 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:25.287276 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb283612-7dd9-4a7d-8943-6e9c9fe7d666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:25.287882 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb283612-7dd9-4a7d-8943-6e9c9fe7d666 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:25.288162 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb283612-7dd9-4a7d-8943-6e9c9fe7d666 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:25.288437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb283612-7dd9-4a7d-8943-6e9c9fe7d666 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:25.289199 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb283612-7dd9-4a7d-8943-6e9c9fe7d666 None admin] RBAC: Adding query filter params (role.id=70f911a75b7b40a19f65857b9d19cfad, scope.project.id=c8f9428f37354c82ac52b6b8eccc424a, user.id=8b7fa3c4c5d94b3c9b7f17dde35d39a0) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:25.289535 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb283612-7dd9-4a7d-8943-6e9c9fe7d666 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:25.291034 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb283612-7dd9-4a7d-8943-6e9c9fe7d666 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:25.298128 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 417/841] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:14:25 2022] GET /identity/v3/role_assignments?user.id=8b7fa3c4c5d94b3c9b7f17dde35d39a0&scope.project.id=c8f9428f37354c82ac52b6b8eccc424a&role.id=70f911a75b7b40a19f65857b9d19cfad => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:25.299966 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19ae0a-3fdc-4334-81e4-c73c7d22d336 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:25.300812 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19ae0a-3fdc-4334-81e4-c73c7d22d336 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:25.301295 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19ae0a-3fdc-4334-81e4-c73c7d22d336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:25.313419 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b6ce7-3114-4c2e-bd2d-8b9e82a30f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:25.314059 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b6ce7-3114-4c2e-bd2d-8b9e82a30f42 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:25.314339 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b6ce7-3114-4c2e-bd2d-8b9e82a30f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:25.314609 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b6ce7-3114-4c2e-bd2d-8b9e82a30f42 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:25.315304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b6ce7-3114-4c2e-bd2d-8b9e82a30f42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:25.315608 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b6ce7-3114-4c2e-bd2d-8b9e82a30f42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:25.317055 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b6ce7-3114-4c2e-bd2d-8b9e82a30f42 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:25.327247 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3d19ae0a-3fdc-4334-81e4-c73c7d22d336 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:25.329142 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3d19ae0a-3fdc-4334-81e4-c73c7d22d336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:25.333046 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 425/842] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:14:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:25.335466 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b6ce7-3114-4c2e-bd2d-8b9e82a30f42 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:25.361270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:25.422009 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 418/843] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:25.463830 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b6ce7-3114-4c2e-bd2d-8b9e82a30f42 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:25.499011 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578471e-2591-4f9e-a9b8-923f27cff77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:25.499718 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578471e-2591-4f9e-a9b8-923f27cff77b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:25.499972 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578471e-2591-4f9e-a9b8-923f27cff77b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:25.500243 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578471e-2591-4f9e-a9b8-923f27cff77b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:25.511491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578471e-2591-4f9e-a9b8-923f27cff77b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:25.512945 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578471e-2591-4f9e-a9b8-923f27cff77b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:25.522961 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:25.531960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-0578471e-2591-4f9e-a9b8-923f27cff77b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:25.531960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:25.531960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:25.531960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:25.531960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:25.531960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:25.531960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:25.531960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:25.531960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:25.531960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:25.531960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:25.531960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:25.531960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:25.531960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:25.531960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:25.531960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:25.532954 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:25.532954 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:25.532954 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:25.532954 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:25.532954 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:25.532954 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:25.532954 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:25.532954 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:25.532954 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:25.532954 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:25.532954 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:25.532954 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:25.532954 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:25.532954 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:25.532954 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:25.532954 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:25.532954 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:25.533873 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:25.533873 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:25.533873 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:25.537473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 426/844] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:14:25.539346 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19ae0a-3fdc-4334-81e4-c73c7d22d336 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:25.643871 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19ae0a-3fdc-4334-81e4-c73c7d22d336 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:25.679113 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b53ed8-d5d0-4b7e-a1df-f040a1664003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:25.679725 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b53ed8-d5d0-4b7e-a1df-f040a1664003 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:25.680006 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b53ed8-d5d0-4b7e-a1df-f040a1664003 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:25.680280 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b53ed8-d5d0-4b7e-a1df-f040a1664003 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:25.680926 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b53ed8-d5d0-4b7e-a1df-f040a1664003 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:25.681230 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b53ed8-d5d0-4b7e-a1df-f040a1664003 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:25.682695 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b53ed8-d5d0-4b7e-a1df-f040a1664003 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:25.691958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578471e-2591-4f9e-a9b8-923f27cff77b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:25.699813 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 419/845] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:25.701118 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b53ed8-d5d0-4b7e-a1df-f040a1664003 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:25.723930 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:25.797308 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578471e-2591-4f9e-a9b8-923f27cff77b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:25.810505 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b53ed8-d5d0-4b7e-a1df-f040a1664003 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:25.836903 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5d8cb-7902-4fe6-bad7-d93848b732fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:25.837597 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5d8cb-7902-4fe6-bad7-d93848b732fd None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:25.837876 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5d8cb-7902-4fe6-bad7-d93848b732fd None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:25.838145 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5d8cb-7902-4fe6-bad7-d93848b732fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:25.847970 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec64c98-4d6c-4f9a-a06e-897752f6cdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:25.848599 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec64c98-4d6c-4f9a-a06e-897752f6cdf4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:25.848879 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec64c98-4d6c-4f9a-a06e-897752f6cdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:25.849153 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec64c98-4d6c-4f9a-a06e-897752f6cdf4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:25.849849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d5d8cb-7902-4fe6-bad7-d93848b732fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:14:25.855380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-13d5d8cb-7902-4fe6-bad7-d93848b732fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:14:25.855380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:25.855380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:25.855380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:25.855380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:25.855380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:25.855380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:25.855380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:25.855380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:25.855380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:25.855380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:25.855380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:25.855380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:14:25.855380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:14:25.855380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:14:25.855380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:14:25.857037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:14:25.857037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:14:25.857037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:14:25.857037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:14:25.857037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:25.857037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:25.857037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:25.857037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:25.857037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:25.857037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:25.857037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:25.857037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:25.857037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:25.857037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:25.857037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:25.857037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:25.858502 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:25.858502 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:25.858502 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:25.858502 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:25.858502 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:14:25.858502 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:14:25.858502 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:14:25.858502 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:14:25.858502 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:14:25.858502 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:14:25.858502 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:14:25.858502 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:25.858502 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 427/846] 10.222.0.94 () {56 vars in 1102 bytes} [Thu Sep 1 17:14:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:14:25.859345 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec64c98-4d6c-4f9a-a06e-897752f6cdf4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:25.865424 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec64c98-4d6c-4f9a-a06e-897752f6cdf4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:25.866366 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5d8cb-7902-4fe6-bad7-d93848b732fd None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:25.871425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-3ec64c98-4d6c-4f9a-a06e-897752f6cdf4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 17:14:25.871425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:25.871425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:25.871425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:25.871425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:25.871425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:25.871425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:25.871425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:25.871425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:25.871425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:25.871425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:25.871425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:25.871425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:14:25.871425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:14:25.871425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:14:25.871425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:14:25.872620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:25.872620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:25.872620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:14:25.872620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:25.872620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:14:25.872620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:25.872620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:25.872620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:25.872620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:25.872620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:25.872620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:25.872620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:25.872620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:25.872620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:25.872620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:25.872620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:25.872620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:25.872620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:25.873885 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:25.873885 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:25.873885 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:14:25.873885 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:14:25.873885 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:14:25.873885 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:14:25.873885 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:14:25.873885 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:14:25.873885 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 17:14:25.873885 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:25.873885 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 420/847] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:14:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:25.879401 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec64c98-4d6c-4f9a-a06e-897752f6cdf4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:25.941788 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:25.971804 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:25.984844 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5d8cb-7902-4fe6-bad7-d93848b732fd None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:25.991799 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec64c98-4d6c-4f9a-a06e-897752f6cdf4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:26.019757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003c9ed-cd4e-43a6-8a1b-3b86111bc4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:26.020468 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003c9ed-cd4e-43a6-8a1b-3b86111bc4ca None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:26.020812 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003c9ed-cd4e-43a6-8a1b-3b86111bc4ca None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:26.021150 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003c9ed-cd4e-43a6-8a1b-3b86111bc4ca None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:26.021906 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003c9ed-cd4e-43a6-8a1b-3b86111bc4ca None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:26.022272 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003c9ed-cd4e-43a6-8a1b-3b86111bc4ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:26.023758 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003c9ed-cd4e-43a6-8a1b-3b86111bc4ca None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:26.028509 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188149a-4b17-49b0-b53e-9d2d346e42b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:26.029641 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188149a-4b17-49b0-b53e-9d2d346e42b3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:26.029923 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188149a-4b17-49b0-b53e-9d2d346e42b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:26.030312 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188149a-4b17-49b0-b53e-9d2d346e42b3 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:26.031046 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188149a-4b17-49b0-b53e-9d2d346e42b3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:26.031355 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188149a-4b17-49b0-b53e-9d2d346e42b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:26.032783 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188149a-4b17-49b0-b53e-9d2d346e42b3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:26.033690 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 428/848] 10.222.0.94 () {56 vars in 1103 bytes} [Thu Sep 1 17:14:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:26.038842 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003c9ed-cd4e-43a6-8a1b-3b86111bc4ca None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:26.051854 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 421/849] 10.222.0.94 () {56 vars in 1135 bytes} [Thu Sep 1 17:14:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:26.057708 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188149a-4b17-49b0-b53e-9d2d346e42b3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:26.162433 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003c9ed-cd4e-43a6-8a1b-3b86111bc4ca None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:26.166402 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188149a-4b17-49b0-b53e-9d2d346e42b3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:26.185434 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:26.196973 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bcaf42-3b31-4a45-8c8f-10e408b37b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:26.197636 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bcaf42-3b31-4a45-8c8f-10e408b37b52 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:26.197914 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bcaf42-3b31-4a45-8c8f-10e408b37b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:26.198182 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bcaf42-3b31-4a45-8c8f-10e408b37b52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:26.208869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd148891-df83-4bd4-8c70-57ebc345ae46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:26.209787 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd148891-df83-4bd4-8c70-57ebc345ae46 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:26.210050 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bcaf42-3b31-4a45-8c8f-10e408b37b52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:26.210498 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd148891-df83-4bd4-8c70-57ebc345ae46 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:26.210973 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd148891-df83-4bd4-8c70-57ebc345ae46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:26.211496 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bcaf42-3b31-4a45-8c8f-10e408b37b52 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:26.215151 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:26.226304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-06bcaf42-3b31-4a45-8c8f-10e408b37b52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:26.226304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:26.226304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:26.226304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:26.226304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:26.226304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:26.226304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:26.226304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:26.226304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:26.226304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:26.226304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:26.226304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:26.226304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:26.226304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:26.226304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:26.226304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:26.227360 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:26.227360 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:26.227360 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:26.227360 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:26.227360 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:26.227360 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:26.227360 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:26.227360 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:26.227360 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:26.227360 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:26.227360 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:26.227360 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:26.227360 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:26.227360 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:26.227360 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:26.227360 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:26.227360 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:26.228273 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:26.228273 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:26.228273 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:26.232322 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 429/850] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:26.233179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bcaf42-3b31-4a45-8c8f-10e408b37b52 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:26.294334 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd148891-df83-4bd4-8c70-57ebc345ae46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:26.296717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd148891-df83-4bd4-8c70-57ebc345ae46 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:26.335663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bcaf42-3b31-4a45-8c8f-10e408b37b52 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:26.369193 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371b082-867b-448e-856f-3bc32b15bfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:26.369851 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371b082-867b-448e-856f-3bc32b15bfdf None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:26.370129 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371b082-867b-448e-856f-3bc32b15bfdf None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:26.370395 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371b082-867b-448e-856f-3bc32b15bfdf None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:26.371312 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371b082-867b-448e-856f-3bc32b15bfdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:26.371312 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371b082-867b-448e-856f-3bc32b15bfdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:26.373297 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371b082-867b-448e-856f-3bc32b15bfdf None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:26.391112 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 430/851] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:26.392036 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371b082-867b-448e-856f-3bc32b15bfdf None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:26.412896 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 422/852] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:14:26 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 17:14:26.419359 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd148891-df83-4bd4-8c70-57ebc345ae46 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:26.438064 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:26.456958 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:26.515636 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371b082-867b-448e-856f-3bc32b15bfdf None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:26.527559 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd148891-df83-4bd4-8c70-57ebc345ae46 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:26.560532 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe8833-c5cf-4bdf-95d0-f0516fa528a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:26.561570 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe8833-c5cf-4bdf-95d0-f0516fa528a3 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:26.562081 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe8833-c5cf-4bdf-95d0-f0516fa528a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:26.562576 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe8833-c5cf-4bdf-95d0-f0516fa528a3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:26.565853 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6f3b9-84f1-42b8-b362-892088d0200c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:26.566656 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6f3b9-84f1-42b8-b362-892088d0200c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:26.566769 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6f3b9-84f1-42b8-b362-892088d0200c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:26.567024 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6f3b9-84f1-42b8-b362-892088d0200c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:26.571773 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe8833-c5cf-4bdf-95d0-f0516fa528a3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:26.573517 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe8833-c5cf-4bdf-95d0-f0516fa528a3 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:26.579140 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6f3b9-84f1-42b8-b362-892088d0200c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:26.580614 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6f3b9-84f1-42b8-b362-892088d0200c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:26.587336 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-a3fe8833-c5cf-4bdf-95d0-f0516fa528a3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 17:14:26.587336 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:26.587336 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:26.587336 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:26.587336 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:26.587336 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:26.587336 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:26.587336 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:26.587336 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:26.587336 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:26.587336 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:26.587336 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:26.587336 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:14:26.587336 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:14:26.587336 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:14:26.587336 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:14:26.588267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:26.588267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:26.588267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:14:26.588267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:26.588267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:14:26.588267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:26.588267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:26.588267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:26.588267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:26.588267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:26.588267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:26.588267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:26.588267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:26.588267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:26.588267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:26.588267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:26.588267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:26.588267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:26.589226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:26.589226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:26.589226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:14:26.589226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:14:26.589226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:14:26.589226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:14:26.589226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:14:26.589226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:14:26.589226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 17:14:26.589226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:26.596867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 431/853] 10.222.0.94 () {56 vars in 1117 bytes} [Thu Sep 1 17:14:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:26.598015 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe8833-c5cf-4bdf-95d0-f0516fa528a3 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:26.598227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-fdb6f3b9-84f1-42b8-b362-892088d0200c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:26.598227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:26.598227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:26.598227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:26.598227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:26.598227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:26.598227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:26.598227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:26.598227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:26.598227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:26.598227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:26.598227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:26.598227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:26.598227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:26.598227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:26.598227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:26.599213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:26.599213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:26.599213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:26.599213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:26.599213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:26.599213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:26.599213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:26.599213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:26.599213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:26.599213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:26.599213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:26.599213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:26.599213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:26.599213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:26.599213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:26.599213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:26.599213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:26.600161 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:26.600161 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:26.600161 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:26.603908 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 423/854] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:26.605775 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6f3b9-84f1-42b8-b362-892088d0200c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:26.697213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:26.701677 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:26.709835 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe8833-c5cf-4bdf-95d0-f0516fa528a3 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:26.713889 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6f3b9-84f1-42b8-b362-892088d0200c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:26.747255 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013e7e9-7137-493d-a85c-b60565f7053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:26.748238 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013e7e9-7137-493d-a85c-b60565f7053c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:26.748773 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013e7e9-7137-493d-a85c-b60565f7053c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:26.749319 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013e7e9-7137-493d-a85c-b60565f7053c None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:26.750394 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013e7e9-7137-493d-a85c-b60565f7053c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:26.750892 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013e7e9-7137-493d-a85c-b60565f7053c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:26.751824 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa309e88-386b-4a0c-a425-77fc8f0cd63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:26.752501 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa309e88-386b-4a0c-a425-77fc8f0cd63b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:26.752851 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa309e88-386b-4a0c-a425-77fc8f0cd63b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:26.753199 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa309e88-386b-4a0c-a425-77fc8f0cd63b None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:26.753305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013e7e9-7137-493d-a85c-b60565f7053c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:26.753950 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa309e88-386b-4a0c-a425-77fc8f0cd63b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:26.754323 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa309e88-386b-4a0c-a425-77fc8f0cd63b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:26.755879 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa309e88-386b-4a0c-a425-77fc8f0cd63b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:26.769617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 424/855] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:26.771145 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785abad-2ab9-4d7e-a68c-0786ba0c4bd1 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:26.771499 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785abad-2ab9-4d7e-a68c-0786ba0c4bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:26.771847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785abad-2ab9-4d7e-a68c-0786ba0c4bd1 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:26.773381 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 425/856] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:26.778265 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 432/857] 10.222.0.94 () {56 vars in 1149 bytes} [Thu Sep 1 17:14:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:26.778467 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785abad-2ab9-4d7e-a68c-0786ba0c4bd1 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:26.779926 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb8307-51b7-45ae-a309-2eb0b1faac9b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:26.780215 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb8307-51b7-45ae-a309-2eb0b1faac9b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:26.780491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb8307-51b7-45ae-a309-2eb0b1faac9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:26.798541 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-abeb8307-51b7-45ae-a309-2eb0b1faac9b None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:26.799868 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-abeb8307-51b7-45ae-a309-2eb0b1faac9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:26.878451 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 433/858] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:26.879535 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb8307-51b7-45ae-a309-2eb0b1faac9b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:26.880632 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785abad-2ab9-4d7e-a68c-0786ba0c4bd1 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:26.926951 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc046824-d0dd-4727-ac4f-4729acbc4c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:26.927970 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc046824-d0dd-4727-ac4f-4729acbc4c8f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:26.928461 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc046824-d0dd-4727-ac4f-4729acbc4c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:26.928950 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc046824-d0dd-4727-ac4f-4729acbc4c8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:26.936995 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc046824-d0dd-4727-ac4f-4729acbc4c8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:26.938746 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc046824-d0dd-4727-ac4f-4729acbc4c8f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:26.950969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-dc046824-d0dd-4727-ac4f-4729acbc4c8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:26.950969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:26.950969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:26.950969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:26.950969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:26.950969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:26.950969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:26.950969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:26.950969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:26.950969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:26.950969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:26.950969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:26.950969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:14:26.950969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:14:26.950969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:14:26.951887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:14:26.951887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:26.951887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:26.951887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:26.951887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:26.951887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:26.951887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:26.951887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:26.951887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:26.951887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:26.951887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:26.951887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:26.951887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:26.951887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:26.951887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:26.951887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:26.951887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:26.952784 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:14:26.952784 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:14:26.952784 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:14:26.952784 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:14:26.952784 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:14:26.952784 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:14:26.952784 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:26.952784 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:26.959895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 426/859] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:14:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:26.960965 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc046824-d0dd-4727-ac4f-4729acbc4c8f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:26.974449 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:26.994806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:27.019554 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb8307-51b7-45ae-a309-2eb0b1faac9b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:27.063233 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33815410-7f35-4178-8108-554f90e141bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:27.063878 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33815410-7f35-4178-8108-554f90e141bf None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:27.064160 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33815410-7f35-4178-8108-554f90e141bf None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:27.064436 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33815410-7f35-4178-8108-554f90e141bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:27.075261 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc046824-d0dd-4727-ac4f-4729acbc4c8f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:27.115179 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135eabe-f501-4243-bc4e-1615a090aacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:27.116113 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135eabe-f501-4243-bc4e-1615a090aacd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:27.116402 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135eabe-f501-4243-bc4e-1615a090aacd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:27.116683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135eabe-f501-4243-bc4e-1615a090aacd None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:27.117566 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5135eabe-f501-4243-bc4e-1615a090aacd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:27.117992 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5135eabe-f501-4243-bc4e-1615a090aacd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:27.119594 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5135eabe-f501-4243-bc4e-1615a090aacd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:27.136115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 427/860] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:14:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:27.141796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135eabe-f501-4243-bc4e-1615a090aacd None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:27.144964 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33815410-7f35-4178-8108-554f90e141bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:27.147427 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33815410-7f35-4178-8108-554f90e141bf None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:27.218434 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:27.231699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:27.256701 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 434/861] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:14:26 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 17:14:27.256701 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33815410-7f35-4178-8108-554f90e141bf None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:27.265613 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135eabe-f501-4243-bc4e-1615a090aacd None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:27.304755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e750be1-c170-42c0-b898-be041bf6ffe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:27.305501 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e750be1-c170-42c0-b898-be041bf6ffe2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:27.306062 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e750be1-c170-42c0-b898-be041bf6ffe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:27.306337 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e750be1-c170-42c0-b898-be041bf6ffe2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:27.307063 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e750be1-c170-42c0-b898-be041bf6ffe2 None admin] RBAC: Adding query filter params (role.id=70f911a75b7b40a19f65857b9d19cfad, scope.project.id=c8f9428f37354c82ac52b6b8eccc424a, user.id=af7ebf43f36c4862a3c527941e033666) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:27.307370 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e750be1-c170-42c0-b898-be041bf6ffe2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:27.308990 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e750be1-c170-42c0-b898-be041bf6ffe2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:27.315440 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 428/862] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:14:27 2022] GET /identity/v3/role_assignments?user.id=af7ebf43f36c4862a3c527941e033666&scope.project.id=c8f9428f37354c82ac52b6b8eccc424a&role.id=70f911a75b7b40a19f65857b9d19cfad => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:27.316243 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e750be1-c170-42c0-b898-be041bf6ffe2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:27.365169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33815410-7f35-4178-8108-554f90e141bf None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:27.402189 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67438402-f15d-4ff5-ab59-28d6e5f65c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:27.402812 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67438402-f15d-4ff5-ab59-28d6e5f65c6e None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:27.403093 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67438402-f15d-4ff5-ab59-28d6e5f65c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:27.403389 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67438402-f15d-4ff5-ab59-28d6e5f65c6e None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:27.404071 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67438402-f15d-4ff5-ab59-28d6e5f65c6e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:27.405493 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67438402-f15d-4ff5-ab59-28d6e5f65c6e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:27.423477 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 435/863] 10.222.0.94 () {60 vars in 1141 bytes} [Thu Sep 1 17:14:27 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:14:27.425184 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0475a9a-58ed-41fb-a65e-c0118f48ab87 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:27.425561 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0475a9a-58ed-41fb-a65e-c0118f48ab87 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:27.425815 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0475a9a-58ed-41fb-a65e-c0118f48ab87 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:27.427406 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 436/864] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:27.433120 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5113e86-5b23-45e0-a5e0-f37b233a7981 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:27.433387 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5113e86-5b23-45e0-a5e0-f37b233a7981 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:27.433698 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5113e86-5b23-45e0-a5e0-f37b233a7981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:27.439770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e750be1-c170-42c0-b898-be041bf6ffe2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:27.454814 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b5113e86-5b23-45e0-a5e0-f37b233a7981 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:27.456056 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b5113e86-5b23-45e0-a5e0-f37b233a7981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:27.478736 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:27.497752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:27.502063 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0f3ca-9d4f-4b91-b8fa-c20baf86f4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:27.502777 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0f3ca-9d4f-4b91-b8fa-c20baf86f4be None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:27.503090 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0f3ca-9d4f-4b91-b8fa-c20baf86f4be None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:27.503362 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0f3ca-9d4f-4b91-b8fa-c20baf86f4be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:27.520824 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0f3ca-9d4f-4b91-b8fa-c20baf86f4be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:27.522625 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0f3ca-9d4f-4b91-b8fa-c20baf86f4be None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:27.539575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-aab0f3ca-9d4f-4b91-b8fa-c20baf86f4be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:27.539575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:27.539575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:27.539575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:27.539575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:27.539575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:27.539575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:27.539575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:27.539575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:27.539575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:27.539575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:27.539575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:27.539575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:27.539575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:27.539575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:27.539575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:27.540757 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:27.540757 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:27.540757 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:27.540757 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:27.540757 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:27.540757 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:27.540757 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:27.540757 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:27.540757 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:27.540757 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:27.540757 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:27.540757 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:27.540757 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:27.540757 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:27.540757 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:27.540757 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:27.540757 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:27.541734 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:27.541734 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:27.541734 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:27.545623 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 429/865] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:27.548239 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0f3ca-9d4f-4b91-b8fa-c20baf86f4be None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:27.555441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 437/866] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:27 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:14:27.661628 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0f3ca-9d4f-4b91-b8fa-c20baf86f4be None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:27.696915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be88e8c-7895-4441-b619-88bdac8ffc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:27.697856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be88e8c-7895-4441-b619-88bdac8ffc13 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:27.698344 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be88e8c-7895-4441-b619-88bdac8ffc13 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:27.698860 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be88e8c-7895-4441-b619-88bdac8ffc13 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:27.699735 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be88e8c-7895-4441-b619-88bdac8ffc13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:27.700742 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be88e8c-7895-4441-b619-88bdac8ffc13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:27.702315 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be88e8c-7895-4441-b619-88bdac8ffc13 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:27.717562 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 430/867] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:27.722915 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5113e86-5b23-45e0-a5e0-f37b233a7981 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:27.827226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5113e86-5b23-45e0-a5e0-f37b233a7981 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:27.837719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be88e8c-7895-4441-b619-88bdac8ffc13 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:27.866779 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82add7b1-7222-4054-9978-93be03a4f788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:27.867541 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82add7b1-7222-4054-9978-93be03a4f788 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:27.867820 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82add7b1-7222-4054-9978-93be03a4f788 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:27.868246 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82add7b1-7222-4054-9978-93be03a4f788 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:27.878239 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82add7b1-7222-4054-9978-93be03a4f788 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:27.879696 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82add7b1-7222-4054-9978-93be03a4f788 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:27.898443 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-82add7b1-7222-4054-9978-93be03a4f788 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:27.898443 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:27.898443 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:27.898443 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:27.898443 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:27.898443 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:27.898443 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:27.898443 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:27.898443 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:27.898443 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:27.898443 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:27.898443 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:27.898443 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:14:27.898443 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:14:27.898443 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:14:27.899407 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:14:27.899407 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:27.899407 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:27.899407 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:27.899407 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:27.899407 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:27.899407 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:27.899407 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:27.899407 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:27.899407 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:27.899407 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:27.899407 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:27.899407 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:27.899407 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:27.899407 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:27.899407 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:27.899407 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:27.900496 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:14:27.900496 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:14:27.900496 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:14:27.900496 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:14:27.900496 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:14:27.900496 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:14:27.900496 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:27.900496 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:27.900948 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:27.901025 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 438/868] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:14:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:27.906544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82add7b1-7222-4054-9978-93be03a4f788 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:27.945172 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:27.953088 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be88e8c-7895-4441-b619-88bdac8ffc13 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:28.001027 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd492d-a550-48e3-ad35-888f7edbb0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:28.002662 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd492d-a550-48e3-ad35-888f7edbb0a2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:28.002948 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd492d-a550-48e3-ad35-888f7edbb0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:28.003224 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd492d-a550-48e3-ad35-888f7edbb0a2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:28.003829 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd492d-a550-48e3-ad35-888f7edbb0a2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:28.005219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd492d-a550-48e3-ad35-888f7edbb0a2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:28.017619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-87bd492d-a550-48e3-ad35-888f7edbb0a2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 17:14:28.017619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:28.017619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:14:28.017619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:14:28.017619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:14:28.017619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:14:28.017619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:14:28.017619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:28.017619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 17:14:28.017619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:28.017619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:14:28.017619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:28.017619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:28.017619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:28.017619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:28.017619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:28.018811 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:28.018811 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:28.018811 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:28.018811 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:28.018811 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:28.018811 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:28.018811 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:28.018811 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:14:28.018811 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:14:28.018811 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:14:28.018811 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:14:28.018811 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:28.018811 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:28.018811 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:28.018811 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:28.018811 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:28.018811 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:28.020118 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:28.020118 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:28.020118 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:28.020118 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:28.020118 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:28.020118 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:28.020118 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:28.020118 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:28.020118 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:28.020118 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:28.020118 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:14:28.020118 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:28.020118 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 17:14:28.020118 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:28.020118 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 431/869] 10.222.0.94 () {56 vars in 1132 bytes} [Thu Sep 1 17:14:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:28.024709 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd492d-a550-48e3-ad35-888f7edbb0a2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:28.040676 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82add7b1-7222-4054-9978-93be03a4f788 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:28.083888 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eae3b2-6938-4c0a-b32c-c3dd68a39688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:28.084496 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eae3b2-6938-4c0a-b32c-c3dd68a39688 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:28.084772 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eae3b2-6938-4c0a-b32c-c3dd68a39688 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:28.085043 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eae3b2-6938-4c0a-b32c-c3dd68a39688 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:28.085771 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eae3b2-6938-4c0a-b32c-c3dd68a39688 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:28.086070 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eae3b2-6938-4c0a-b32c-c3dd68a39688 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:28.087792 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eae3b2-6938-4c0a-b32c-c3dd68a39688 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:28.100578 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 439/870] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:14:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:28.106917 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eae3b2-6938-4c0a-b32c-c3dd68a39688 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:28.156480 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd492d-a550-48e3-ad35-888f7edbb0a2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:28.159749 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:28.195348 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1a2d8-6fce-4282-888d-2ed822c0c4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:28.195962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1a2d8-6fce-4282-888d-2ed822c0c4a4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:28.196368 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1a2d8-6fce-4282-888d-2ed822c0c4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:28.196727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1a2d8-6fce-4282-888d-2ed822c0c4a4 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:28.197493 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1a2d8-6fce-4282-888d-2ed822c0c4a4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:28.197997 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1a2d8-6fce-4282-888d-2ed822c0c4a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:28.199528 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1a2d8-6fce-4282-888d-2ed822c0c4a4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:28.205434 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 432/871] 10.222.0.94 () {56 vars in 1126 bytes} [Thu Sep 1 17:14:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:28.210587 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1a2d8-6fce-4282-888d-2ed822c0c4a4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:28.215291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:28.228199 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eae3b2-6938-4c0a-b32c-c3dd68a39688 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:28.272350 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1145a-db5e-4adb-952b-3afac1a30371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:28.273332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1145a-db5e-4adb-952b-3afac1a30371 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:28.274297 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1145a-db5e-4adb-952b-3afac1a30371 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:28.274780 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1145a-db5e-4adb-952b-3afac1a30371 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:28.275993 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1145a-db5e-4adb-952b-3afac1a30371 None admin] RBAC: Adding query filter params (role.id=e903cb11e2bf466fa1b3fae894847c3e, scope.project.id=c8f9428f37354c82ac52b6b8eccc424a, user.id=9e7444bc40314e73b282217bbb94798d) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:28.276673 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1145a-db5e-4adb-952b-3afac1a30371 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:28.279028 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1145a-db5e-4adb-952b-3afac1a30371 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:28.293913 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 440/872] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:14:28 2022] GET /identity/v3/role_assignments?user.id=9e7444bc40314e73b282217bbb94798d&scope.project.id=c8f9428f37354c82ac52b6b8eccc424a&role.id=e903cb11e2bf466fa1b3fae894847c3e => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:28.333892 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1a2d8-6fce-4282-888d-2ed822c0c4a4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:28.370756 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63302ab6-3101-4cd2-a47e-0ddc61e6fd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:28.371378 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63302ab6-3101-4cd2-a47e-0ddc61e6fd9c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:28.371651 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63302ab6-3101-4cd2-a47e-0ddc61e6fd9c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:28.371916 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63302ab6-3101-4cd2-a47e-0ddc61e6fd9c None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:28.372624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63302ab6-3101-4cd2-a47e-0ddc61e6fd9c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:28.372922 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63302ab6-3101-4cd2-a47e-0ddc61e6fd9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:28.374392 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63302ab6-3101-4cd2-a47e-0ddc61e6fd9c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:28.379921 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 433/873] 10.222.0.94 () {56 vars in 1126 bytes} [Thu Sep 1 17:14:28 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:29.326963 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7edf3-2348-4641-9fda-f9da06a34316 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:29.327494 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7edf3-2348-4641-9fda-f9da06a34316 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:29.327494 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7edf3-2348-4641-9fda-f9da06a34316 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:29.329226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 441/874] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:29.335771 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238aaf5-577d-4fac-8975-29da8ddea8c8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:29.336260 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238aaf5-577d-4fac-8975-29da8ddea8c8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:29.336341 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238aaf5-577d-4fac-8975-29da8ddea8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:29.358412 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a238aaf5-577d-4fac-8975-29da8ddea8c8 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:29.359596 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a238aaf5-577d-4fac-8975-29da8ddea8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:29.388407 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:29.432580 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 434/875] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:29 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:29.502596 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90a620-9db7-4dbe-afd1-50751241b8ee None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:29.502935 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90a620-9db7-4dbe-afd1-50751241b8ee None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:29.503145 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90a620-9db7-4dbe-afd1-50751241b8ee None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:29.504849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 442/876] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:29.510848 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fd245-734c-45de-ba28-c54237d62881 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:29.511490 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fd245-734c-45de-ba28-c54237d62881 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:29.511967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fd245-734c-45de-ba28-c54237d62881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:29.531283 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5f5fd245-734c-45de-ba28-c54237d62881 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:29.532821 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5f5fd245-734c-45de-ba28-c54237d62881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:29.600853 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 435/877] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:29 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:29.713085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90a620-9db7-4dbe-afd1-50751241b8ee None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:29.824529 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90a620-9db7-4dbe-afd1-50751241b8ee None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:29.859634 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc041c17-2629-4af1-8fb8-b076f9a7f7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:29.860185 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc041c17-2629-4af1-8fb8-b076f9a7f7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:29.860459 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc041c17-2629-4af1-8fb8-b076f9a7f7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:29.860727 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc041c17-2629-4af1-8fb8-b076f9a7f7d3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:29.861299 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc041c17-2629-4af1-8fb8-b076f9a7f7d3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:29.862713 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc041c17-2629-4af1-8fb8-b076f9a7f7d3 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:29.871845 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-fc041c17-2629-4af1-8fb8-b076f9a7f7d3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 17:14:29.871845 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:29.871845 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:14:29.871845 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:14:29.871845 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:14:29.871845 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:14:29.871845 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:14:29.871845 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:29.871845 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 17:14:29.871845 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:29.871845 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:14:29.871845 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:29.871845 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:29.871845 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:29.871845 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:29.871845 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:29.871845 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:29.872948 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:29.872948 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:29.872948 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:29.872948 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:29.872948 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:29.872948 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:29.872948 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:14:29.872948 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:14:29.872948 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:14:29.872948 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:14:29.872948 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:29.872948 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:29.872948 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:29.872948 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:29.872948 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:29.872948 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:29.873855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:29.873855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:29.873855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:29.873855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:29.873855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:29.873855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:29.873855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:29.873855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:29.873855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:29.873855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:29.873855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:14:29.873855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:29.873855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 17:14:29.873855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:29.873855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 443/878] 10.222.0.94 () {56 vars in 1126 bytes} [Thu Sep 1 17:14:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:29.878855 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5fd245-734c-45de-ba28-c54237d62881 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:29.882446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc041c17-2629-4af1-8fb8-b076f9a7f7d3 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:29.911614 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:29.996709 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:30.005525 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc041c17-2629-4af1-8fb8-b076f9a7f7d3 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:30.009814 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5fd245-734c-45de-ba28-c54237d62881 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:30.042003 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf32ce9-7da0-42f3-b0eb-090c5fa5fb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:30.042578 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf32ce9-7da0-42f3-b0eb-090c5fa5fb66 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:30.042853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf32ce9-7da0-42f3-b0eb-090c5fa5fb66 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:30.043119 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf32ce9-7da0-42f3-b0eb-090c5fa5fb66 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:30.043744 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf32ce9-7da0-42f3-b0eb-090c5fa5fb66 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:30.044102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf32ce9-7da0-42f3-b0eb-090c5fa5fb66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:30.045827 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf32ce9-7da0-42f3-b0eb-090c5fa5fb66 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:30.051003 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 444/879] 10.222.0.94 () {56 vars in 1122 bytes} [Thu Sep 1 17:14:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:30.056395 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf32ce9-7da0-42f3-b0eb-090c5fa5fb66 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:30.056519 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fc7eb-62c8-469b-8eb9-e653a34f8ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:30.057109 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fc7eb-62c8-469b-8eb9-e653a34f8ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:30.057560 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fc7eb-62c8-469b-8eb9-e653a34f8ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:30.057841 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fc7eb-62c8-469b-8eb9-e653a34f8ef8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:30.058436 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fc7eb-62c8-469b-8eb9-e653a34f8ef8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:30.060608 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fc7eb-62c8-469b-8eb9-e653a34f8ef8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:30.070286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-992fc7eb-62c8-469b-8eb9-e653a34f8ef8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 17:14:30.070286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:30.070286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:14:30.070286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:14:30.070286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:14:30.070286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:14:30.070286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:14:30.070286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:30.070286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 17:14:30.070286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:30.070286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:14:30.070286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:30.070286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:30.070286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:30.070286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:30.070286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:30.070286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:30.071333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:30.071333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:30.071333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:30.071333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:30.071333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:30.071333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:30.071333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:14:30.071333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:14:30.071333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:14:30.071333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:14:30.071333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:30.071333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:30.071333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:30.071333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:30.071333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:30.071333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:30.072210 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:30.072210 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:30.072210 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:30.072210 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:30.072210 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:30.072210 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:30.072210 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:30.072210 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:30.072210 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:30.072210 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:30.072210 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:14:30.072210 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:30.072210 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 17:14:30.072210 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:30.076382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 436/880] 10.222.0.94 () {56 vars in 1114 bytes} [Thu Sep 1 17:14:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:30.077900 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fc7eb-62c8-469b-8eb9-e653a34f8ef8 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:30.170054 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:30.185522 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fc7eb-62c8-469b-8eb9-e653a34f8ef8 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:30.192038 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf32ce9-7da0-42f3-b0eb-090c5fa5fb66 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:30.223035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f9d04-ddfc-4d4b-8499-d6eeb0abdf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:30.223658 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f9d04-ddfc-4d4b-8499-d6eeb0abdf1d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:30.223940 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f9d04-ddfc-4d4b-8499-d6eeb0abdf1d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:30.224217 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f9d04-ddfc-4d4b-8499-d6eeb0abdf1d None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:30.224854 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f9d04-ddfc-4d4b-8499-d6eeb0abdf1d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:30.225151 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f9d04-ddfc-4d4b-8499-d6eeb0abdf1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:30.226903 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f9d04-ddfc-4d4b-8499-d6eeb0abdf1d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:30.236994 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 437/881] 10.222.0.94 () {56 vars in 1114 bytes} [Thu Sep 1 17:14:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:30.238454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f9d04-ddfc-4d4b-8499-d6eeb0abdf1d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:30.239064 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064886f7-5616-4866-9a87-0b1c337dc544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:30.239904 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064886f7-5616-4866-9a87-0b1c337dc544 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:30.240384 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064886f7-5616-4866-9a87-0b1c337dc544 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:30.240877 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064886f7-5616-4866-9a87-0b1c337dc544 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:30.241933 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064886f7-5616-4866-9a87-0b1c337dc544 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:30.243311 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064886f7-5616-4866-9a87-0b1c337dc544 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:30.244930 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064886f7-5616-4866-9a87-0b1c337dc544 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:30.251746 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 445/882] 10.222.0.94 () {56 vars in 1122 bytes} [Thu Sep 1 17:14:30 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:30.276243 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:30.366386 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f9d04-ddfc-4d4b-8499-d6eeb0abdf1d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:30.373018 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bdeab-f7e8-451c-b7af-dc838981fd3c None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:30.373579 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bdeab-f7e8-451c-b7af-dc838981fd3c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:30.373579 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bdeab-f7e8-451c-b7af-dc838981fd3c None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:30.375207 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 446/883] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:14:30.380715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb952a-aa28-4eb3-9f90-8e5dc34c4713 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:30.380999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb952a-aa28-4eb3-9f90-8e5dc34c4713 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:30.381213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb952a-aa28-4eb3-9f90-8e5dc34c4713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:30.401356 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-18cb952a-aa28-4eb3-9f90-8e5dc34c4713 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:30.402717 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-18cb952a-aa28-4eb3-9f90-8e5dc34c4713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:30.405367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc1602-60ef-42f2-b4ef-fc57bd557621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:30.406019 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc1602-60ef-42f2-b4ef-fc57bd557621 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:30.406304 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc1602-60ef-42f2-b4ef-fc57bd557621 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:30.406578 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc1602-60ef-42f2-b4ef-fc57bd557621 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:30.407226 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc1602-60ef-42f2-b4ef-fc57bd557621 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:30.407536 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc1602-60ef-42f2-b4ef-fc57bd557621 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:30.409442 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc1602-60ef-42f2-b4ef-fc57bd557621 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:30.414211 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 438/884] 10.222.0.94 () {56 vars in 1114 bytes} [Thu Sep 1 17:14:30 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:30.420729 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db43d86-7848-4ebc-a784-f6cfc9a0ef7a None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:30.420957 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db43d86-7848-4ebc-a784-f6cfc9a0ef7a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:30.421239 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db43d86-7848-4ebc-a784-f6cfc9a0ef7a None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:30.422878 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 439/885] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:30.423549 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db43d86-7848-4ebc-a784-f6cfc9a0ef7a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:30.489555 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 447/886] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:30 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:30.490862 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aeff5e-d03b-447f-971b-3b049386d8f3 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:30.491150 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aeff5e-d03b-447f-971b-3b049386d8f3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:30.491423 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aeff5e-d03b-447f-971b-3b049386d8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:30.509586 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-93aeff5e-d03b-447f-971b-3b049386d8f3 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:30.510797 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-93aeff5e-d03b-447f-971b-3b049386d8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:30.515723 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:30.539539 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db43d86-7848-4ebc-a784-f6cfc9a0ef7a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:30.578859 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db81d51-501c-4bd0-8fb6-8f084fd50a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:30.579570 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db81d51-501c-4bd0-8fb6-8f084fd50a36 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:30.579857 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db81d51-501c-4bd0-8fb6-8f084fd50a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:30.580134 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db81d51-501c-4bd0-8fb6-8f084fd50a36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:30.580842 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db81d51-501c-4bd0-8fb6-8f084fd50a36 None admin] RBAC: Adding query filter params (interface=public, service_id=d556789564bf4ba7b1d8a19287e2c271, region_id=RegionOne) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:30.581255 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db81d51-501c-4bd0-8fb6-8f084fd50a36 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:30.582659 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db81d51-501c-4bd0-8fb6-8f084fd50a36 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:30.584104 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 448/887] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:30 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:30.588243 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 440/888] 10.222.0.94 () {56 vars in 1251 bytes} [Thu Sep 1 17:14:30 2022] GET /identity/v3/endpoints?service_id=d556789564bf4ba7b1d8a19287e2c271&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:30.593700 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aeff5e-d03b-447f-971b-3b049386d8f3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:30.604258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:30.696637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aeff5e-d03b-447f-971b-3b049386d8f3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:30.735667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a3d48-9cdc-4271-9f57-633d580493a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:30.736287 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a3d48-9cdc-4271-9f57-633d580493a4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:30.736569 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a3d48-9cdc-4271-9f57-633d580493a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:30.736843 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a3d48-9cdc-4271-9f57-633d580493a4 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:30.737556 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a3d48-9cdc-4271-9f57-633d580493a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:30.738938 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a3d48-9cdc-4271-9f57-633d580493a4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:30.744833 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 449/889] 10.222.0.94 () {56 vars in 1087 bytes} [Thu Sep 1 17:14:30 2022] GET /identity/v3/services => generated 1011 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:14:30.790882 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db81d51-501c-4bd0-8fb6-8f084fd50a36 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:30.865123 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a3d48-9cdc-4271-9f57-633d580493a4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:30.905605 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db81d51-501c-4bd0-8fb6-8f084fd50a36 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:30.945847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f47db-90d6-4136-9160-328f70aa18d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:30.946918 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f47db-90d6-4136-9160-328f70aa18d1 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:30.947421 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f47db-90d6-4136-9160-328f70aa18d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:30.947892 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f47db-90d6-4136-9160-328f70aa18d1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:30.949645 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:30.961858 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f47db-90d6-4136-9160-328f70aa18d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:14:30.968462 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-770f47db-90d6-4136-9160-328f70aa18d1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 17:14:30.968462 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:30.968462 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:30.968462 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:30.968462 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:30.968462 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:30.968462 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:30.968462 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:30.968462 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:30.968462 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:30.968462 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:30.968462 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:30.968462 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:14:30.968462 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:14:30.968462 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:14:30.968462 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:14:30.969428 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:14:30.969428 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:14:30.969428 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:14:30.969428 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:14:30.969428 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:30.969428 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:30.969428 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:30.969428 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:30.969428 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:30.969428 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:30.969428 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:30.969428 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:30.969428 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:30.969428 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:30.969428 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:30.969428 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:30.970482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:30.970482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:30.970482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:30.970482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:30.970482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:14:30.970482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:14:30.970482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:14:30.970482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:14:30.970482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:14:30.970482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:14:30.970482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 17:14:30.970482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:30.970482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 441/890] 10.222.0.94 () {56 vars in 1120 bytes} [Thu Sep 1 17:14:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:30.977949 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f47db-90d6-4136-9160-328f70aa18d1 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:30.987163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a3d48-9cdc-4271-9f57-633d580493a4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:30.988948 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:31.038970 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb18a6-b3af-4c01-98fa-7d42d678222f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:31.040148 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb18a6-b3af-4c01-98fa-7d42d678222f None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:31.040953 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb18a6-b3af-4c01-98fa-7d42d678222f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:31.041382 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb18a6-b3af-4c01-98fa-7d42d678222f None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:31.042236 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb18a6-b3af-4c01-98fa-7d42d678222f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:31.044443 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb18a6-b3af-4c01-98fa-7d42d678222f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:31.066103 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 450/891] 10.222.0.94 () {60 vars in 1141 bytes} [Thu Sep 1 17:14:30 2022] POST /identity/v3/services => generated 269 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:14:31.106276 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f47db-90d6-4136-9160-328f70aa18d1 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:31.153161 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b42ef-e651-4590-a4e0-b8d791804845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:31.154178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b42ef-e651-4590-a4e0-b8d791804845 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:31.154611 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b42ef-e651-4590-a4e0-b8d791804845 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:31.155064 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b42ef-e651-4590-a4e0-b8d791804845 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:31.155897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b42ef-e651-4590-a4e0-b8d791804845 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:31.156354 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b42ef-e651-4590-a4e0-b8d791804845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:31.158024 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b42ef-e651-4590-a4e0-b8d791804845 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:31.168130 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 442/892] 10.222.0.94 () {56 vars in 1115 bytes} [Thu Sep 1 17:14:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:31.174570 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb18a6-b3af-4c01-98fa-7d42d678222f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:31.287445 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb18a6-b3af-4c01-98fa-7d42d678222f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:31.317490 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:31.322883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b419c47-a851-4a5a-8f29-372b0be46e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:31.323912 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b419c47-a851-4a5a-8f29-372b0be46e71 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:31.324370 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b419c47-a851-4a5a-8f29-372b0be46e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:31.324646 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b419c47-a851-4a5a-8f29-372b0be46e71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:31.336487 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b419c47-a851-4a5a-8f29-372b0be46e71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:31.338008 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b419c47-a851-4a5a-8f29-372b0be46e71 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:31.352724 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-9b419c47-a851-4a5a-8f29-372b0be46e71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:31.352724 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:31.352724 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:31.352724 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:31.352724 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:31.352724 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:31.352724 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:31.352724 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:31.352724 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:31.352724 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:31.352724 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:31.352724 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:31.352724 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:31.352724 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:31.352724 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:31.352724 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:31.353775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:31.353775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:31.353775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:31.353775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:31.353775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:31.353775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:31.353775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:31.353775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:31.353775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:31.353775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:31.353775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:31.353775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:31.353775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:31.353775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:31.353775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:31.353775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:31.353775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:31.354680 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:31.354680 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:31.354680 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:31.354680 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 451/893] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:31.360406 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b42ef-e651-4590-a4e0-b8d791804845 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:31.436349 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:31.474496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b42ef-e651-4590-a4e0-b8d791804845 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:31.509806 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ac247-2d07-417f-bd67-0bbef66b0e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:31.510723 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ac247-2d07-417f-bd67-0bbef66b0e79 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:31.511186 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ac247-2d07-417f-bd67-0bbef66b0e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:31.511637 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ac247-2d07-417f-bd67-0bbef66b0e79 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:31.512465 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ac247-2d07-417f-bd67-0bbef66b0e79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:31.513028 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ac247-2d07-417f-bd67-0bbef66b0e79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:31.514598 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ac247-2d07-417f-bd67-0bbef66b0e79 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:31.527423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 443/894] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:31.533666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b419c47-a851-4a5a-8f29-372b0be46e71 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:31.642906 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b419c47-a851-4a5a-8f29-372b0be46e71 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:31.678043 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c0904-0286-4032-b16c-ec4cdc4efccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:31.679060 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c0904-0286-4032-b16c-ec4cdc4efccd None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:31.679598 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c0904-0286-4032-b16c-ec4cdc4efccd None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:31.680113 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c0904-0286-4032-b16c-ec4cdc4efccd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:31.688108 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c0904-0286-4032-b16c-ec4cdc4efccd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:31.689789 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c0904-0286-4032-b16c-ec4cdc4efccd None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:31.701217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-2a1c0904-0286-4032-b16c-ec4cdc4efccd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 17:14:31.701217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:31.701217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:31.701217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:31.701217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:31.701217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:31.701217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:31.701217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:31.701217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:31.701217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:31.701217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:31.701217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:31.701217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:14:31.701217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:14:31.701217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:14:31.701217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:14:31.702192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:31.702192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:31.702192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:14:31.702192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:31.702192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:14:31.702192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:31.702192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:31.702192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:31.702192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:31.702192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:31.702192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:31.702192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:31.702192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:31.702192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:31.702192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:31.702192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:31.702192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:31.702192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:31.703166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:31.703166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:31.703166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:14:31.703166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:14:31.703166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:14:31.703166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:14:31.703166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:14:31.703166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:14:31.703166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 17:14:31.703166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:31.705881 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 452/895] 10.222.0.94 () {56 vars in 1117 bytes} [Thu Sep 1 17:14:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:31.717457 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ac247-2d07-417f-bd67-0bbef66b0e79 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:31.827049 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ac247-2d07-417f-bd67-0bbef66b0e79 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:31.853564 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:31.863240 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0da6ad-efb1-4f3a-8331-213b925cb3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:31.863856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0da6ad-efb1-4f3a-8331-213b925cb3b1 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:31.864139 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0da6ad-efb1-4f3a-8331-213b925cb3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:31.864413 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0da6ad-efb1-4f3a-8331-213b925cb3b1 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:31.865145 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0da6ad-efb1-4f3a-8331-213b925cb3b1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:31.865483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0da6ad-efb1-4f3a-8331-213b925cb3b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:31.866912 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0da6ad-efb1-4f3a-8331-213b925cb3b1 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:31.884987 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 444/896] 10.222.0.94 () {56 vars in 1149 bytes} [Thu Sep 1 17:14:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:31.893910 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c0904-0286-4032-b16c-ec4cdc4efccd None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:31.941478 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:32.005837 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c0904-0286-4032-b16c-ec4cdc4efccd None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:32.040374 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c40ecc-40e5-479f-95b2-9fa564dbff99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:32.040988 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c40ecc-40e5-479f-95b2-9fa564dbff99 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:32.041265 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c40ecc-40e5-479f-95b2-9fa564dbff99 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:32.041578 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c40ecc-40e5-479f-95b2-9fa564dbff99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:32.114515 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c40ecc-40e5-479f-95b2-9fa564dbff99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:32.116189 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c40ecc-40e5-479f-95b2-9fa564dbff99 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:32.161088 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:32.217784 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 453/897] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:14:31 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 17:14:32.229435 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0da6ad-efb1-4f3a-8331-213b925cb3b1 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:32.275113 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce6757-5600-4fdd-b335-22605465f814 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:32.275765 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce6757-5600-4fdd-b335-22605465f814 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:32.276217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce6757-5600-4fdd-b335-22605465f814 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:32.278052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 454/898] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:14:32.283613 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197c0da-ba5d-4aa2-8981-da0789a06a57 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:32.284003 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197c0da-ba5d-4aa2-8981-da0789a06a57 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:32.284372 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197c0da-ba5d-4aa2-8981-da0789a06a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:32.305314 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c197c0da-ba5d-4aa2-8981-da0789a06a57 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:32.306859 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c197c0da-ba5d-4aa2-8981-da0789a06a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:32.347298 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0da6ad-efb1-4f3a-8331-213b925cb3b1 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:32.384357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aeaec4-d0d2-4929-a182-05be1cc1e82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:32.385337 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aeaec4-d0d2-4929-a182-05be1cc1e82d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:32.385828 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aeaec4-d0d2-4929-a182-05be1cc1e82d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:32.386305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aeaec4-d0d2-4929-a182-05be1cc1e82d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:32.397535 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 455/899] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:32 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:14:32.405395 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aeaec4-d0d2-4929-a182-05be1cc1e82d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:32.407123 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aeaec4-d0d2-4929-a182-05be1cc1e82d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:32.422602 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-d9aeaec4-d0d2-4929-a182-05be1cc1e82d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:32.422602 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:32.422602 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:32.422602 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:32.422602 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:32.422602 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:32.422602 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:32.422602 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:32.422602 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:32.422602 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:32.422602 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:32.422602 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:32.422602 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:32.422602 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:32.422602 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:32.422602 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:32.423575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:32.423575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:32.423575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:32.423575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:32.423575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:32.423575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:32.423575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:32.423575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:32.423575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:32.423575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:32.423575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:32.423575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:32.423575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:32.423575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:32.423575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:32.423575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:32.423575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:32.424520 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:32.424520 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:32.424520 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:32.431260 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 445/900] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:32.434269 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197c0da-ba5d-4aa2-8981-da0789a06a57 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:32.511653 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:32.552547 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197c0da-ba5d-4aa2-8981-da0789a06a57 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:32.588849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83508774-3f3a-42c0-bd77-81cc9f2cd5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:32.589898 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83508774-3f3a-42c0-bd77-81cc9f2cd5ac None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:32.590390 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83508774-3f3a-42c0-bd77-81cc9f2cd5ac None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:32.590900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83508774-3f3a-42c0-bd77-81cc9f2cd5ac None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:32.591893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83508774-3f3a-42c0-bd77-81cc9f2cd5ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:32.592388 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83508774-3f3a-42c0-bd77-81cc9f2cd5ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:32.593974 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83508774-3f3a-42c0-bd77-81cc9f2cd5ac None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:32.606947 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 456/901] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:32.613451 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aeaec4-d0d2-4929-a182-05be1cc1e82d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:32.649984 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:32.705610 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83508774-3f3a-42c0-bd77-81cc9f2cd5ac None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:32.725976 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aeaec4-d0d2-4929-a182-05be1cc1e82d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:32.765302 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded58799-2af6-4270-9ccb-5410e837f7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:32.765968 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded58799-2af6-4270-9ccb-5410e837f7a6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:32.766247 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded58799-2af6-4270-9ccb-5410e837f7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:32.766519 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded58799-2af6-4270-9ccb-5410e837f7a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:32.774074 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded58799-2af6-4270-9ccb-5410e837f7a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:32.775660 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded58799-2af6-4270-9ccb-5410e837f7a6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:32.789031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-ded58799-2af6-4270-9ccb-5410e837f7a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:32.789031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:32.789031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:32.789031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:32.789031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:32.789031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:32.789031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:32.789031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:32.789031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:32.789031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:32.789031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:32.789031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:32.789031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:14:32.789031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:14:32.789031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:14:32.790014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:14:32.790014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:32.790014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:32.790014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:32.790014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:32.790014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:32.790014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:32.790014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:32.790014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:32.790014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:32.790014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:32.790014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:32.790014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:32.790014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:32.790014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:32.790014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:32.790014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:32.790951 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:14:32.790951 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:14:32.790951 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:14:32.790951 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:14:32.790951 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:14:32.790951 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:14:32.790951 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:32.790951 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:32.795533 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 446/902] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:14:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:32.804276 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded58799-2af6-4270-9ccb-5410e837f7a6 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:32.825751 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83508774-3f3a-42c0-bd77-81cc9f2cd5ac None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:32.863010 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f61114-a92d-47a3-ad70-c17ffebb8281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:32.863623 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f61114-a92d-47a3-ad70-c17ffebb8281 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:32.863903 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f61114-a92d-47a3-ad70-c17ffebb8281 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:32.864175 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f61114-a92d-47a3-ad70-c17ffebb8281 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:32.864830 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f61114-a92d-47a3-ad70-c17ffebb8281 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:32.866227 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f61114-a92d-47a3-ad70-c17ffebb8281 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:32.869790 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:32.882293 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 457/903] 10.222.0.94 () {60 vars in 1141 bytes} [Thu Sep 1 17:14:32 2022] POST /identity/v3/services => generated 241 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:14:32.883510 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338a32b-8cde-4401-b11b-fe1a292709d7 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:32.883795 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338a32b-8cde-4401-b11b-fe1a292709d7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:32.884069 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338a32b-8cde-4401-b11b-fe1a292709d7 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:32.889638 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 458/904] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:32.891059 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a6116-fffc-40c7-8b2d-a0fd91649b4b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:32.891352 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a6116-fffc-40c7-8b2d-a0fd91649b4b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:32.891633 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a6116-fffc-40c7-8b2d-a0fd91649b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:32.911752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2e9a6116-fffc-40c7-8b2d-a0fd91649b4b None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:32.912995 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2e9a6116-fffc-40c7-8b2d-a0fd91649b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:32.926113 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:32.931790 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded58799-2af6-4270-9ccb-5410e837f7a6 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:32.983183 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3388ed4-603a-4141-8ec4-36c836b44553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:32.983806 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3388ed4-603a-4141-8ec4-36c836b44553 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:32.984088 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3388ed4-603a-4141-8ec4-36c836b44553 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:32.984359 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3388ed4-603a-4141-8ec4-36c836b44553 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:32.985180 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3388ed4-603a-4141-8ec4-36c836b44553 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:32.985530 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3388ed4-603a-4141-8ec4-36c836b44553 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:32.987106 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3388ed4-603a-4141-8ec4-36c836b44553 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:33.004170 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 447/905] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:14:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:33.011329 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3388ed4-603a-4141-8ec4-36c836b44553 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:33.020677 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 459/906] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:33.092563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bc48b-e961-4d9d-9908-469e89143a3b None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:33.092916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bc48b-e961-4d9d-9908-469e89143a3b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:33.093116 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bc48b-e961-4d9d-9908-469e89143a3b None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:33.094479 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 460/907] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:14:33.099727 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba29cbc-d099-4c66-be27-a2c92826c2bf None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:33.100008 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba29cbc-d099-4c66-be27-a2c92826c2bf None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:33.100280 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba29cbc-d099-4c66-be27-a2c92826c2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:33.123339 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-9ba29cbc-d099-4c66-be27-a2c92826c2bf None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:33.124739 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9ba29cbc-d099-4c66-be27-a2c92826c2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:33.124902 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3388ed4-603a-4141-8ec4-36c836b44553 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:33.162633 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2af9e-7d26-47f9-9d7a-acc924e5865c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:33.163698 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2af9e-7d26-47f9-9d7a-acc924e5865c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:33.164157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2af9e-7d26-47f9-9d7a-acc924e5865c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:33.164434 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2af9e-7d26-47f9-9d7a-acc924e5865c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:33.165161 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2af9e-7d26-47f9-9d7a-acc924e5865c None admin] RBAC: Adding query filter params (role.id=9990ea7faa184ffb88d6994ef7e3eba1, scope.project.id=c8f9428f37354c82ac52b6b8eccc424a, user.id=9e7444bc40314e73b282217bbb94798d) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:33.165493 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2af9e-7d26-47f9-9d7a-acc924e5865c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:33.166923 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2af9e-7d26-47f9-9d7a-acc924e5865c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:33.174894 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 448/908] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:14:33 2022] GET /identity/v3/role_assignments?user.id=9e7444bc40314e73b282217bbb94798d&scope.project.id=c8f9428f37354c82ac52b6b8eccc424a&role.id=9990ea7faa184ffb88d6994ef7e3eba1 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:33.210464 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 461/909] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:33.295630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2af9e-7d26-47f9-9d7a-acc924e5865c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:33.316682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:33.402151 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2af9e-7d26-47f9-9d7a-acc924e5865c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:33.439972 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5604a77-48a2-480b-8122-2ce193fb2096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:33.440847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5604a77-48a2-480b-8122-2ce193fb2096 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:33.441278 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5604a77-48a2-480b-8122-2ce193fb2096 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:33.441716 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5604a77-48a2-480b-8122-2ce193fb2096 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:33.442467 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5604a77-48a2-480b-8122-2ce193fb2096 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:33.443976 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5604a77-48a2-480b-8122-2ce193fb2096 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:33.454347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-c5604a77-48a2-480b-8122-2ce193fb2096 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 17:14:33.454347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:33.454347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:14:33.454347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:14:33.454347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:14:33.454347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:14:33.454347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:14:33.454347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:33.454347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 17:14:33.454347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:33.454347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:14:33.454347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:33.454347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:33.454347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:33.454347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:33.454347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:33.454347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:33.455581 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:33.455581 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:33.455581 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:33.455581 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:33.455581 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:33.455581 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:33.455581 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:14:33.455581 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:14:33.455581 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:14:33.455581 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:14:33.455581 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:33.455581 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:33.455581 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:33.455581 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:33.455581 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:33.455581 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:33.456698 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:33.456698 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:33.456698 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:33.456698 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:33.456698 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:33.456698 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:33.456698 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:33.456698 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:33.456698 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:33.456698 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:33.456698 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:14:33.456698 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:33.456698 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 17:14:33.456698 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:33.459135 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 449/910] 10.222.0.94 () {56 vars in 1114 bytes} [Thu Sep 1 17:14:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:33.469478 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba29cbc-d099-4c66-be27-a2c92826c2bf None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:33.490392 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5604a77-48a2-480b-8122-2ce193fb2096 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:33.525562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:33.596926 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:33.599965 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba29cbc-d099-4c66-be27-a2c92826c2bf None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:33.623116 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5604a77-48a2-480b-8122-2ce193fb2096 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:33.647532 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344c3fc-4231-4aba-a964-0d7cbcc4f907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:33.649025 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344c3fc-4231-4aba-a964-0d7cbcc4f907 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:33.649730 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344c3fc-4231-4aba-a964-0d7cbcc4f907 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:33.650301 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344c3fc-4231-4aba-a964-0d7cbcc4f907 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:33.651424 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344c3fc-4231-4aba-a964-0d7cbcc4f907 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:33.652348 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344c3fc-4231-4aba-a964-0d7cbcc4f907 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:33.654645 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344c3fc-4231-4aba-a964-0d7cbcc4f907 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:33.665897 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 462/911] 10.222.0.94 () {56 vars in 1114 bytes} [Thu Sep 1 17:14:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:33.666856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba05f8-27c4-4df3-9d31-01baa5c96d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:33.667495 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba05f8-27c4-4df3-9d31-01baa5c96d38 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:33.667774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba05f8-27c4-4df3-9d31-01baa5c96d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:33.668101 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba05f8-27c4-4df3-9d31-01baa5c96d38 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:33.668379 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344c3fc-4231-4aba-a964-0d7cbcc4f907 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:33.668697 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba05f8-27c4-4df3-9d31-01baa5c96d38 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:33.670629 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba05f8-27c4-4df3-9d31-01baa5c96d38 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:33.681880 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-35ba05f8-27c4-4df3-9d31-01baa5c96d38 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 17:14:33.681880 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:33.681880 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:14:33.681880 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:14:33.681880 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:14:33.681880 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:14:33.681880 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:14:33.681880 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:33.681880 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 17:14:33.681880 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:33.681880 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:14:33.681880 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:33.681880 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:33.681880 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:33.681880 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:33.681880 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:33.682903 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:33.682903 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:33.682903 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:33.682903 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:33.682903 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:33.682903 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:33.682903 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:33.682903 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:14:33.682903 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:14:33.682903 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:14:33.682903 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:14:33.682903 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:33.682903 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:33.682903 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:33.682903 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:33.682903 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:33.682903 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:33.683856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:33.683856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:33.683856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:33.683856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:33.683856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:33.683856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:33.683856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:33.683856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:33.683856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:33.683856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:33.683856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:14:33.683856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:33.683856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 17:14:33.683856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:33.683856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 450/912] 10.222.0.94 () {56 vars in 1132 bytes} [Thu Sep 1 17:14:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:14:33.690199 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba05f8-27c4-4df3-9d31-01baa5c96d38 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:33.789109 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344c3fc-4231-4aba-a964-0d7cbcc4f907 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:33.808341 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:33.831719 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b43ab1-e8da-424f-b424-2ca2bf2c8fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:33.832309 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b43ab1-e8da-424f-b424-2ca2bf2c8fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:33.832578 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b43ab1-e8da-424f-b424-2ca2bf2c8fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:33.832854 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b43ab1-e8da-424f-b424-2ca2bf2c8fa7 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:33.833563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b43ab1-e8da-424f-b424-2ca2bf2c8fa7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:33.833874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b43ab1-e8da-424f-b424-2ca2bf2c8fa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:33.835255 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b43ab1-e8da-424f-b424-2ca2bf2c8fa7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:33.839582 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba05f8-27c4-4df3-9d31-01baa5c96d38 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:33.845262 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 463/913] 10.222.0.94 () {56 vars in 1114 bytes} [Thu Sep 1 17:14:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:33.846314 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b43ab1-e8da-424f-b424-2ca2bf2c8fa7 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:33.897664 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1b065-6ea5-4064-9900-6f22349942f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:33.898887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1b065-6ea5-4064-9900-6f22349942f6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:33.899823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1b065-6ea5-4064-9900-6f22349942f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:33.900401 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1b065-6ea5-4064-9900-6f22349942f6 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:33.901309 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1b065-6ea5-4064-9900-6f22349942f6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:33.902071 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1b065-6ea5-4064-9900-6f22349942f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:33.904007 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1b065-6ea5-4064-9900-6f22349942f6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:33.911281 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 451/914] 10.222.0.94 () {56 vars in 1126 bytes} [Thu Sep 1 17:14:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:33.917572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1b065-6ea5-4064-9900-6f22349942f6 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:33.936382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:33.961771 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b43ab1-e8da-424f-b424-2ca2bf2c8fa7 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:33.998987 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8293c-9768-4ee0-ac1e-2186b9b485a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:33.999696 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8293c-9768-4ee0-ac1e-2186b9b485a3 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:34.000036 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8293c-9768-4ee0-ac1e-2186b9b485a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:34.000372 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8293c-9768-4ee0-ac1e-2186b9b485a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:34.001048 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f8293c-9768-4ee0-ac1e-2186b9b485a3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:34.002472 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f8293c-9768-4ee0-ac1e-2186b9b485a3 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:34.025447 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 464/915] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:14:33 2022] POST /identity/v3/endpoints => generated 346 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:14:34.054288 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1b065-6ea5-4064-9900-6f22349942f6 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:34.107942 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9eced-2ee3-4363-90c3-6d66b15ab11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:34.108990 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9eced-2ee3-4363-90c3-6d66b15ab11b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:34.109544 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9eced-2ee3-4363-90c3-6d66b15ab11b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:34.109998 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9eced-2ee3-4363-90c3-6d66b15ab11b None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:34.110857 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9eced-2ee3-4363-90c3-6d66b15ab11b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:34.111321 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9eced-2ee3-4363-90c3-6d66b15ab11b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:34.113028 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9eced-2ee3-4363-90c3-6d66b15ab11b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:34.119739 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 452/916] 10.222.0.94 () {56 vars in 1126 bytes} [Thu Sep 1 17:14:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:34.126640 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8293c-9768-4ee0-ac1e-2186b9b485a3 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:34.172215 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:34.238552 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8293c-9768-4ee0-ac1e-2186b9b485a3 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:34.273969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4550ae-1d03-4934-8f22-55bfbcdc734f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:34.274584 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4550ae-1d03-4934-8f22-55bfbcdc734f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:34.274866 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4550ae-1d03-4934-8f22-55bfbcdc734f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:34.275137 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4550ae-1d03-4934-8f22-55bfbcdc734f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:34.275847 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4550ae-1d03-4934-8f22-55bfbcdc734f None admin] RBAC: Adding query filter params (interface=public, service_id=22e876ad4d674c119187a142224f9f0e, region_id=RegionOne) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:34.276159 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4550ae-1d03-4934-8f22-55bfbcdc734f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:34.277622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4550ae-1d03-4934-8f22-55bfbcdc734f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:34.283076 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 465/917] 10.222.0.94 () {56 vars in 1251 bytes} [Thu Sep 1 17:14:34 2022] GET /identity/v3/endpoints?service_id=22e876ad4d674c119187a142224f9f0e&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:34.288966 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9eced-2ee3-4363-90c3-6d66b15ab11b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:34.363395 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:34.400975 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9eced-2ee3-4363-90c3-6d66b15ab11b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:34.438386 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a8871-bd14-4982-8a24-b278f305efcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:34.439058 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a8871-bd14-4982-8a24-b278f305efcf None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:34.439343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a8871-bd14-4982-8a24-b278f305efcf None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:34.439616 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a8871-bd14-4982-8a24-b278f305efcf None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:34.440226 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a8871-bd14-4982-8a24-b278f305efcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:34.441612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a8871-bd14-4982-8a24-b278f305efcf None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:34.448100 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 453/918] 10.222.0.94 () {56 vars in 1087 bytes} [Thu Sep 1 17:14:34 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:14:34.949241 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea58f04-b8ce-40c0-b979-2a2ecabe9de3 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:34.949813 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea58f04-b8ce-40c0-b979-2a2ecabe9de3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:34.949813 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea58f04-b8ce-40c0-b979-2a2ecabe9de3 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:34.951399 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 466/919] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:34.956991 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aafabe-4ae6-49d4-8007-2846f51a35f2 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:34.957391 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aafabe-4ae6-49d4-8007-2846f51a35f2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:34.957705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aafabe-4ae6-49d4-8007-2846f51a35f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:34.976222 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-98aafabe-4ae6-49d4-8007-2846f51a35f2 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:34.977425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-98aafabe-4ae6-49d4-8007-2846f51a35f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:35.048779 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 454/920] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:35.137138 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde951a-e133-493d-9a77-b99c027cf630 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:35.137504 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde951a-e133-493d-9a77-b99c027cf630 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:35.138241 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde951a-e133-493d-9a77-b99c027cf630 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:35.139867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 467/921] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:35.145003 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6104b-a0a8-4b3e-ac62-98d244aa2473 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:35.145296 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6104b-a0a8-4b3e-ac62-98d244aa2473 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:35.145607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6104b-a0a8-4b3e-ac62-98d244aa2473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:35.164359 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-dce6104b-a0a8-4b3e-ac62-98d244aa2473 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:35.165614 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dce6104b-a0a8-4b3e-ac62-98d244aa2473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:35.229958 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:35.238224 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 455/922] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:35.330239 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde951a-e133-493d-9a77-b99c027cf630 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:35.432923 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde951a-e133-493d-9a77-b99c027cf630 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:35.435196 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:35.472326 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963ffaa-d195-41ae-b63f-e1acf8a98150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:35.472964 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963ffaa-d195-41ae-b63f-e1acf8a98150 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:35.473246 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963ffaa-d195-41ae-b63f-e1acf8a98150 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:35.473553 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963ffaa-d195-41ae-b63f-e1acf8a98150 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:35.474145 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963ffaa-d195-41ae-b63f-e1acf8a98150 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:35.475517 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963ffaa-d195-41ae-b63f-e1acf8a98150 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:35.484689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-d963ffaa-d195-41ae-b63f-e1acf8a98150 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 17:14:35.484689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:35.484689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:14:35.484689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:14:35.484689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:14:35.484689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:14:35.484689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:14:35.484689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:35.484689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 17:14:35.484689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:35.484689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:14:35.484689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:35.484689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:35.484689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:35.484689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:35.484689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:35.484689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:35.485767 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:35.485767 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:35.485767 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:35.485767 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:35.485767 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:35.485767 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:35.485767 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:14:35.485767 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:14:35.485767 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:14:35.485767 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:14:35.485767 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:35.485767 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:35.485767 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:35.485767 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:35.485767 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:35.485767 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:35.486752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:35.486752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:35.486752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:35.486752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:35.486752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:35.486752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:35.486752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:35.486752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:35.486752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:35.486752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:35.486752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:14:35.486752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:35.486752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 17:14:35.486752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:35.486752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 468/923] 10.222.0.94 () {56 vars in 1126 bytes} [Thu Sep 1 17:14:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:35.492003 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6104b-a0a8-4b3e-ac62-98d244aa2473 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:35.540554 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963ffaa-d195-41ae-b63f-e1acf8a98150 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:35.603618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6104b-a0a8-4b3e-ac62-98d244aa2473 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:35.653084 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963ffaa-d195-41ae-b63f-e1acf8a98150 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:35.658818 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2bb496-8564-40e5-abf9-2a5a7f3b69f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:35.658818 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bb496-8564-40e5-abf9-2a5a7f3b69f2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:35.658818 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bb496-8564-40e5-abf9-2a5a7f3b69f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:35.658818 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bb496-8564-40e5-abf9-2a5a7f3b69f2 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:35.665434 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2bb496-8564-40e5-abf9-2a5a7f3b69f2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:35.665434 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2bb496-8564-40e5-abf9-2a5a7f3b69f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:35.665434 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2bb496-8564-40e5-abf9-2a5a7f3b69f2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:35.671995 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 456/924] 10.222.0.94 () {56 vars in 1122 bytes} [Thu Sep 1 17:14:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:35.672890 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2bb496-8564-40e5-abf9-2a5a7f3b69f2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:35.694805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405007d7-9afb-4c1c-9456-babd63cb0fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:35.695600 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405007d7-9afb-4c1c-9456-babd63cb0fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:35.695984 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405007d7-9afb-4c1c-9456-babd63cb0fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:35.696356 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405007d7-9afb-4c1c-9456-babd63cb0fb5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:35.707947 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405007d7-9afb-4c1c-9456-babd63cb0fb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:14:35.712885 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-405007d7-9afb-4c1c-9456-babd63cb0fb5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 17:14:35.712885 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:35.712885 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:35.712885 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:35.712885 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:35.712885 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:35.712885 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:35.712885 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:35.712885 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:35.712885 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:35.712885 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:35.712885 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:35.712885 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:14:35.712885 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:14:35.712885 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:14:35.712885 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:14:35.713935 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:14:35.713935 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:14:35.713935 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:14:35.713935 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:14:35.713935 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:35.713935 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:35.713935 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:35.713935 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:35.713935 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:35.713935 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:35.713935 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:35.713935 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:35.713935 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:35.713935 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:35.713935 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:35.713935 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:35.715163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:35.715163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:35.715163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:35.715163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:35.715163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:14:35.715163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:14:35.715163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:14:35.715163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:14:35.715163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:14:35.715163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:14:35.715163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 17:14:35.715163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:35.715163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 469/925] 10.222.0.94 () {56 vars in 1120 bytes} [Thu Sep 1 17:14:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:35.726389 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405007d7-9afb-4c1c-9456-babd63cb0fb5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:35.739136 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:35.765752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:35.779973 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2bb496-8564-40e5-abf9-2a5a7f3b69f2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:35.814972 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62426a2b-a7f6-4396-bdc8-2a598438cae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:35.815587 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62426a2b-a7f6-4396-bdc8-2a598438cae3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:35.815865 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62426a2b-a7f6-4396-bdc8-2a598438cae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:35.816136 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62426a2b-a7f6-4396-bdc8-2a598438cae3 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:35.816771 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62426a2b-a7f6-4396-bdc8-2a598438cae3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:35.817078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62426a2b-a7f6-4396-bdc8-2a598438cae3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:35.818488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62426a2b-a7f6-4396-bdc8-2a598438cae3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:35.829162 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 457/926] 10.222.0.94 () {56 vars in 1122 bytes} [Thu Sep 1 17:14:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:35.830056 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62426a2b-a7f6-4396-bdc8-2a598438cae3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:35.836372 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405007d7-9afb-4c1c-9456-babd63cb0fb5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:35.874437 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6334513-1b05-43c2-979d-1b86bf8a4dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:35.875075 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6334513-1b05-43c2-979d-1b86bf8a4dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:35.875352 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6334513-1b05-43c2-979d-1b86bf8a4dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:35.875619 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6334513-1b05-43c2-979d-1b86bf8a4dd8 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:35.876380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6334513-1b05-43c2-979d-1b86bf8a4dd8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:35.876686 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6334513-1b05-43c2-979d-1b86bf8a4dd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:35.878203 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6334513-1b05-43c2-979d-1b86bf8a4dd8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:35.887305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 470/927] 10.222.0.94 () {56 vars in 1115 bytes} [Thu Sep 1 17:14:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:35.893910 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6334513-1b05-43c2-979d-1b86bf8a4dd8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:35.938374 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62426a2b-a7f6-4396-bdc8-2a598438cae3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:35.972124 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:35.994067 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104464f4-fd5d-4fff-ab54-cf9f82f62c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:35.994603 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104464f4-fd5d-4fff-ab54-cf9f82f62c3e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:35.995135 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104464f4-fd5d-4fff-ab54-cf9f82f62c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:35.995416 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104464f4-fd5d-4fff-ab54-cf9f82f62c3e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:35.997622 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104464f4-fd5d-4fff-ab54-cf9f82f62c3e None admin] RBAC: Adding query filter params (interface=public, service_id=eeacb932c0cf440fba24fb5c52d91dc5, region_id=RegionOne) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:35.997942 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104464f4-fd5d-4fff-ab54-cf9f82f62c3e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:35.999317 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104464f4-fd5d-4fff-ab54-cf9f82f62c3e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:36.010467 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 458/928] 10.222.0.94 () {56 vars in 1251 bytes} [Thu Sep 1 17:14:35 2022] GET /identity/v3/endpoints?service_id=eeacb932c0cf440fba24fb5c52d91dc5&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:36.011464 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104464f4-fd5d-4fff-ab54-cf9f82f62c3e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:36.024122 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:36.041905 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6334513-1b05-43c2-979d-1b86bf8a4dd8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:36.084042 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7e829-b3bc-4b99-8215-c9b10ca6335e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:36.084795 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7e829-b3bc-4b99-8215-c9b10ca6335e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:36.085076 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7e829-b3bc-4b99-8215-c9b10ca6335e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:36.085376 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7e829-b3bc-4b99-8215-c9b10ca6335e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:36.097035 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc7e829-b3bc-4b99-8215-c9b10ca6335e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:36.098525 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc7e829-b3bc-4b99-8215-c9b10ca6335e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:36.114166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-fbc7e829-b3bc-4b99-8215-c9b10ca6335e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:36.114166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:36.114166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:36.114166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:36.114166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:36.114166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:36.114166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:36.114166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:36.114166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:36.114166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:36.114166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:36.114166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:36.114166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:36.114166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:36.114166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:36.114166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:36.115187 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:36.115187 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:36.115187 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:36.115187 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:36.115187 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:36.115187 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:36.115187 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:36.115187 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:36.115187 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:36.115187 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:36.115187 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:36.115187 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:36.115187 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:36.115187 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:36.115187 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:36.115187 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:36.115187 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:36.116098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:36.116098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:36.116098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:36.116098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 471/929] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:14:36.116796 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20562d21-f17b-4974-876d-6de544a4a7be None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:36.116796 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20562d21-f17b-4974-876d-6de544a4a7be None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:36.117068 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20562d21-f17b-4974-876d-6de544a4a7be None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:36.118523 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 472/930] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:36.123681 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20562d21-f17b-4974-876d-6de544a4a7be None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:36.129893 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104464f4-fd5d-4fff-ab54-cf9f82f62c3e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:36.164235 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3720fea-a355-4efa-978e-895aa0e68f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:36.164848 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3720fea-a355-4efa-978e-895aa0e68f8d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:36.165153 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3720fea-a355-4efa-978e-895aa0e68f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:36.165393 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3720fea-a355-4efa-978e-895aa0e68f8d None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:36.166027 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3720fea-a355-4efa-978e-895aa0e68f8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:36.167394 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3720fea-a355-4efa-978e-895aa0e68f8d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:36.173505 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 459/931] 10.222.0.94 () {56 vars in 1087 bytes} [Thu Sep 1 17:14:36 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:14:36.174668 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455092b-7d5f-4b77-9a1c-5af698b23a9a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:36.174951 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455092b-7d5f-4b77-9a1c-5af698b23a9a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:36.175225 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455092b-7d5f-4b77-9a1c-5af698b23a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:36.202612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7455092b-7d5f-4b77-9a1c-5af698b23a9a None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:36.204396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7455092b-7d5f-4b77-9a1c-5af698b23a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:36.257360 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20562d21-f17b-4974-876d-6de544a4a7be None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:36.268348 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:36.301378 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 460/932] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:36.302039 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d458ab-107c-4c1f-b6c4-8361d9727da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:36.302953 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d458ab-107c-4c1f-b6c4-8361d9727da0 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:36.303440 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d458ab-107c-4c1f-b6c4-8361d9727da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:36.303950 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d458ab-107c-4c1f-b6c4-8361d9727da0 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:36.304836 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d458ab-107c-4c1f-b6c4-8361d9727da0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:36.305348 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d458ab-107c-4c1f-b6c4-8361d9727da0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:36.307056 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d458ab-107c-4c1f-b6c4-8361d9727da0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:36.318146 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:36.322231 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 473/933] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:36.328573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455092b-7d5f-4b77-9a1c-5af698b23a9a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:36.433356 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455092b-7d5f-4b77-9a1c-5af698b23a9a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:36.469051 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64a63a-5db4-4052-97f2-4967bb6de29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:36.469712 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64a63a-5db4-4052-97f2-4967bb6de29f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:36.469990 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64a63a-5db4-4052-97f2-4967bb6de29f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:36.470261 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64a63a-5db4-4052-97f2-4967bb6de29f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:36.477534 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64a63a-5db4-4052-97f2-4967bb6de29f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:36.478970 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64a63a-5db4-4052-97f2-4967bb6de29f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:36.489148 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd96c1-b5b8-4988-8014-5ab65a70fc40 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:36.489488 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd96c1-b5b8-4988-8014-5ab65a70fc40 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:36.489718 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd96c1-b5b8-4988-8014-5ab65a70fc40 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:36.491290 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 474/934] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:36.493860 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-4e64a63a-5db4-4052-97f2-4967bb6de29f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 17:14:36.493860 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:36.493860 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:36.493860 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:36.493860 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:36.493860 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:36.493860 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:36.493860 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:36.493860 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:36.493860 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:36.493860 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:36.493860 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:36.493860 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:14:36.493860 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:14:36.493860 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:14:36.493860 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:14:36.494941 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:36.494941 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:36.494941 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:14:36.494941 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:36.494941 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:14:36.494941 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:36.494941 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:36.494941 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:36.494941 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:36.494941 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:36.494941 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:36.494941 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:36.494941 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:36.494941 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:36.494941 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:36.494941 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:36.494941 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:36.494941 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:36.495888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:36.495888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:36.495888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:14:36.495888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:14:36.495888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:14:36.495888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:14:36.495888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:14:36.495888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:14:36.495888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 17:14:36.495888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:36.498045 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 461/935] 10.222.0.94 () {56 vars in 1117 bytes} [Thu Sep 1 17:14:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:14:36.499137 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ca40a-f0a8-4c02-b16f-228c02a1c5c6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:36.502734 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ca40a-f0a8-4c02-b16f-228c02a1c5c6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:36.502734 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ca40a-f0a8-4c02-b16f-228c02a1c5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:36.504136 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64a63a-5db4-4052-97f2-4967bb6de29f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:36.520946 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0c6ca40a-f0a8-4c02-b16f-228c02a1c5c6 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:36.522483 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0c6ca40a-f0a8-4c02-b16f-228c02a1c5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:36.558531 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:36.609231 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 475/936] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:36.613619 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ca40a-f0a8-4c02-b16f-228c02a1c5c6 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:36.642164 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64a63a-5db4-4052-97f2-4967bb6de29f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:36.684133 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35925af9-2aca-4017-89c5-c5faa67eb025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:36.684816 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35925af9-2aca-4017-89c5-c5faa67eb025 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:36.685098 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35925af9-2aca-4017-89c5-c5faa67eb025 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:36.685372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35925af9-2aca-4017-89c5-c5faa67eb025 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:36.686142 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35925af9-2aca-4017-89c5-c5faa67eb025 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:36.686444 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35925af9-2aca-4017-89c5-c5faa67eb025 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:36.687869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35925af9-2aca-4017-89c5-c5faa67eb025 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:36.713833 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 462/937] 10.222.0.94 () {56 vars in 1149 bytes} [Thu Sep 1 17:14:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:36.715565 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35925af9-2aca-4017-89c5-c5faa67eb025 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:36.731330 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ca40a-f0a8-4c02-b16f-228c02a1c5c6 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:36.762046 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:36.768116 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fa35b-0417-49fe-98ba-ee8f1a774306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:36.768787 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fa35b-0417-49fe-98ba-ee8f1a774306 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:36.769071 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fa35b-0417-49fe-98ba-ee8f1a774306 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:36.769342 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fa35b-0417-49fe-98ba-ee8f1a774306 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:36.770037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89fa35b-0417-49fe-98ba-ee8f1a774306 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:36.771647 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89fa35b-0417-49fe-98ba-ee8f1a774306 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:36.774311 dv-cinder-852211-8-smb devstack@keystone.service[81458]: WARNING keystone.server.flask.common [None req-a89fa35b-0417-49fe-98ba-ee8f1a774306 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 01 17:14:36.792337 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.sql.core [None req-a89fa35b-0417-49fe-98ba-ee8f1a774306 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 17:14:36.792337 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 17:14:36.792337 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [parameters: {'id': '0e6140c6f1844a3aa16c93a903b89795', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 17:14:36.792337 dv-cinder-852211-8-smb devstack@keystone.service[81458]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81458) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 17:14:36.800373 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-a89fa35b-0417-49fe-98ba-ee8f1a774306 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0e6140c6f1844a3aa16c93a903b89795.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0e6140c6f1844a3aa16c93a903b89795. Sep 01 17:14:36.800373 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:36.800373 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 17:14:36.800373 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 17:14:36.800373 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 17:14:36.800373 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 17:14:36.800373 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 17:14:36.800373 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 17:14:36.800373 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 17:14:36.800373 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application conn.query(q) Sep 01 17:14:36.800373 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 17:14:36.800373 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 17:14:36.800373 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 17:14:36.801174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result.read() Sep 01 17:14:36.801174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 17:14:36.801174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 17:14:36.801174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 17:14:36.801174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 17:14:36.801174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 17:14:36.801174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 17:14:36.801174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 17:14:36.801174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 17:14:36.801174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 17:14:36.801174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:36.801174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 17:14:36.801174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:36.801174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:36.801174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 17:14:36.801174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 17:14:36.801174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 01 17:14:36.801174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 01 17:14:36.802190 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 17:14:36.802190 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application next(self.gen) Sep 01 17:14:36.802190 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 17:14:36.802190 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application yield resource Sep 01 17:14:36.802190 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 17:14:36.802190 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application next(self.gen) Sep 01 17:14:36.802190 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 17:14:36.802190 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 17:14:36.802190 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 17:14:36.802190 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 17:14:36.802190 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 17:14:36.802190 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise self.value Sep 01 17:14:36.802190 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 17:14:36.802190 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 17:14:36.802190 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 17:14:36.802190 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application session.commit() Sep 01 17:14:36.802190 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 17:14:36.803649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 17:14:36.803649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 17:14:36.803649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 17:14:36.803649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 17:14:36.803649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.session.flush() Sep 01 17:14:36.803649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 17:14:36.803649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 17:14:36.803649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 17:14:36.803649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 17:14:36.803649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 17:14:36.803649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application compat.raise_( Sep 01 17:14:36.803649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 17:14:36.803649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception Sep 01 17:14:36.803649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 17:14:36.803649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 17:14:36.803649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 17:14:36.803649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 17:14:36.804562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 17:14:36.804562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 17:14:36.804562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 17:14:36.804562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 17:14:36.804562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 17:14:36.804562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 17:14:36.804562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 17:14:36.804562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 17:14:36.804562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 17:14:36.804562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 17:14:36.804562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 17:14:36.804562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 17:14:36.804562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 17:14:36.804562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 17:14:36.804562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 17:14:36.806276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 17:14:36.806276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 17:14:36.806276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception Sep 01 17:14:36.806276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 17:14:36.806276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 17:14:36.806276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 17:14:36.806276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 17:14:36.806276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 17:14:36.806276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 17:14:36.806276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 17:14:36.806276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application conn.query(q) Sep 01 17:14:36.806276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 17:14:36.806276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 17:14:36.806276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 17:14:36.806276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result.read() Sep 01 17:14:36.806276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 17:14:36.806276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 17:14:36.808462 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 17:14:36.808462 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 17:14:36.808462 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 17:14:36.808462 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 17:14:36.808462 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 17:14:36.808462 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 17:14:36.808462 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 17:14:36.808462 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 17:14:36.808462 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [parameters: {'id': '0e6140c6f1844a3aa16c93a903b89795', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 17:14:36.808462 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 17:14:36.808462 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:36.808462 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:14:36.808462 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:36.808462 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:36.808462 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 01 17:14:36.811098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 01 17:14:36.811098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 17:14:36.811098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 17:14:36.811098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 01 17:14:36.811098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:36.811098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:14:36.811098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:36.811098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:36.811098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:36.811098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:36.811098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:36.811098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:36.811098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:36.811098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:36.811098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:36.811098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:36.811098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:36.813269 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:36.813269 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 01 17:14:36.813269 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 01 17:14:36.813269 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:36.813269 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:36.813269 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 01 17:14:36.813269 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 01 17:14:36.813269 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0e6140c6f1844a3aa16c93a903b89795. Sep 01 17:14:36.813269 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:36.813269 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 476/938] 10.222.0.94 () {60 vars in 1140 bytes} [Thu Sep 1 17:14:36 2022] POST /identity/v3/projects => generated 262 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:36.813269 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fa35b-0417-49fe-98ba-ee8f1a774306 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:36.840088 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:36.848077 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35925af9-2aca-4017-89c5-c5faa67eb025 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:36.885658 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb1df2-1dec-4226-8846-7ebb3b08aea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:36.886359 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb1df2-1dec-4226-8846-7ebb3b08aea8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:36.886791 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb1df2-1dec-4226-8846-7ebb3b08aea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:36.887002 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb1df2-1dec-4226-8846-7ebb3b08aea8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:36.897546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb1df2-1dec-4226-8846-7ebb3b08aea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:36.898985 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb1df2-1dec-4226-8846-7ebb3b08aea8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:36.914677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-36cb1df2-1dec-4226-8846-7ebb3b08aea8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:36.914677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:36.914677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:36.914677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:36.914677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:36.914677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:36.914677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:36.914677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:36.914677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:36.914677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:36.914677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:36.914677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:36.914677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:36.914677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:36.914677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:36.914677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:36.915638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:36.915638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:36.915638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:36.915638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:36.915638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:36.915638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:36.915638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:36.915638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:36.915638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:36.915638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:36.915638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:36.915638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:36.915638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:36.915638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:36.915638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:36.915638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:36.915638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:36.916526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:36.916526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:36.916526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:36.916526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 463/939] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:14:36.916526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb1df2-1dec-4226-8846-7ebb3b08aea8 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:36.921102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fa35b-0417-49fe-98ba-ee8f1a774306 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:36.957548 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d6c28-763d-43b8-9151-87c8aa5a6eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:36.958226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d6c28-763d-43b8-9151-87c8aa5a6eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:36.958505 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d6c28-763d-43b8-9151-87c8aa5a6eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:36.958778 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d6c28-763d-43b8-9151-87c8aa5a6eb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:36.967572 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d6c28-763d-43b8-9151-87c8aa5a6eb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:36.969564 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d6c28-763d-43b8-9151-87c8aa5a6eb9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:36.980624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-a81d6c28-763d-43b8-9151-87c8aa5a6eb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:36.980624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:36.980624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:36.980624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:36.980624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:36.980624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:36.980624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:36.980624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:36.980624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:36.980624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:36.980624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:36.980624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:36.980624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:14:36.980624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:14:36.980624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:14:36.982175 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:14:36.982175 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:36.982175 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:36.982175 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:36.982175 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:36.982175 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:36.982175 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:36.982175 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:36.982175 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:36.982175 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:36.982175 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:36.982175 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:36.982175 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:36.982175 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:36.982175 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:36.982175 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:36.982175 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:36.983194 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:14:36.983194 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:14:36.983194 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:14:36.983194 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:14:36.983194 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:14:36.983194 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:14:36.983194 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:36.983194 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:36.983194 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 477/940] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:14:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:36.983194 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d6c28-763d-43b8-9151-87c8aa5a6eb9 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:37.034333 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:37.040318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb1df2-1dec-4226-8846-7ebb3b08aea8 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:37.082950 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b019521-d4cd-44e0-b573-cdf9a15de3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:37.083613 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b019521-d4cd-44e0-b573-cdf9a15de3f7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:37.083894 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b019521-d4cd-44e0-b573-cdf9a15de3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:37.084170 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b019521-d4cd-44e0-b573-cdf9a15de3f7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:37.084750 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b019521-d4cd-44e0-b573-cdf9a15de3f7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:37.086154 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b019521-d4cd-44e0-b573-cdf9a15de3f7 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:37.095146 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-0b019521-d4cd-44e0-b573-cdf9a15de3f7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 17:14:37.095146 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:37.095146 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:14:37.095146 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:14:37.095146 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:14:37.095146 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:14:37.095146 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:14:37.095146 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:37.095146 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 17:14:37.095146 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:37.095146 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:14:37.095146 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:37.095146 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:37.095146 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:37.095146 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:37.095146 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:37.096116 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:37.096116 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:37.096116 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:37.096116 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:37.096116 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:37.096116 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:37.096116 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:37.096116 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:14:37.096116 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:14:37.096116 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:14:37.096116 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:14:37.096116 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:37.096116 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:37.096116 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:37.096116 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:37.096116 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:37.096116 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:37.097016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:37.097016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:37.097016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:37.097016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:37.097016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:37.097016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:37.097016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:37.097016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:37.097016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:37.097016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:37.097016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:14:37.097016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:37.097016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 17:14:37.097016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:37.097016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 464/941] 10.222.0.94 () {56 vars in 1132 bytes} [Thu Sep 1 17:14:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:37.097856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b019521-d4cd-44e0-b573-cdf9a15de3f7 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:37.110018 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d6c28-763d-43b8-9151-87c8aa5a6eb9 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:37.116414 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:37.150011 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939cae68-85cb-4418-8420-d3b5f840b47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:37.150643 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cae68-85cb-4418-8420-d3b5f840b47f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:37.150936 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cae68-85cb-4418-8420-d3b5f840b47f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:37.151159 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cae68-85cb-4418-8420-d3b5f840b47f None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:37.151807 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939cae68-85cb-4418-8420-d3b5f840b47f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:37.152221 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939cae68-85cb-4418-8420-d3b5f840b47f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:37.153750 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939cae68-85cb-4418-8420-d3b5f840b47f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:37.174874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 478/942] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:37.175559 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939cae68-85cb-4418-8420-d3b5f840b47f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:37.206534 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b019521-d4cd-44e0-b573-cdf9a15de3f7 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:37.241879 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abd10a-a436-4bb8-9daa-dd9631b0d57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:37.242540 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abd10a-a436-4bb8-9daa-dd9631b0d57c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:37.242835 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abd10a-a436-4bb8-9daa-dd9631b0d57c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:37.243110 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abd10a-a436-4bb8-9daa-dd9631b0d57c None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:37.243771 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46abd10a-a436-4bb8-9daa-dd9631b0d57c None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:37.244071 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46abd10a-a436-4bb8-9daa-dd9631b0d57c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:37.245556 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46abd10a-a436-4bb8-9daa-dd9631b0d57c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:37.273437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 465/943] 10.222.0.94 () {56 vars in 1112 bytes} [Thu Sep 1 17:14:37 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:37.273437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abd10a-a436-4bb8-9daa-dd9631b0d57c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:37.296385 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939cae68-85cb-4418-8420-d3b5f840b47f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:37.312292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:37.340653 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664bcfad-72f3-4be9-b4cb-495cdd86eb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:37.341947 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bcfad-72f3-4be9-b4cb-495cdd86eb1a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:37.342293 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bcfad-72f3-4be9-b4cb-495cdd86eb1a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:37.342633 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bcfad-72f3-4be9-b4cb-495cdd86eb1a None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:37.343348 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664bcfad-72f3-4be9-b4cb-495cdd86eb1a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:37.343722 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664bcfad-72f3-4be9-b4cb-495cdd86eb1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:37.345555 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664bcfad-72f3-4be9-b4cb-495cdd86eb1a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:37.351342 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 479/944] 10.222.0.94 () {56 vars in 1126 bytes} [Thu Sep 1 17:14:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:37.356994 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664bcfad-72f3-4be9-b4cb-495cdd86eb1a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:37.379879 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:37.422194 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abd10a-a436-4bb8-9daa-dd9631b0d57c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:37.464653 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d396833-f383-4f7e-b48e-dd8071cdc540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:37.466973 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d396833-f383-4f7e-b48e-dd8071cdc540 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:37.466973 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d396833-f383-4f7e-b48e-dd8071cdc540 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:37.467323 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d396833-f383-4f7e-b48e-dd8071cdc540 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:37.478029 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d396833-f383-4f7e-b48e-dd8071cdc540 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:37.479590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d396833-f383-4f7e-b48e-dd8071cdc540 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:37.480958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664bcfad-72f3-4be9-b4cb-495cdd86eb1a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:37.491897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-7d396833-f383-4f7e-b48e-dd8071cdc540 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:37.491897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:37.491897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:37.491897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:37.491897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:37.491897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:37.491897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:37.491897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:37.491897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:37.491897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:37.491897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:37.491897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:37.491897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:14:37.491897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:14:37.491897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:14:37.492993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:14:37.492993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:37.492993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:37.492993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:37.492993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:37.492993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:37.492993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:37.492993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:37.492993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:37.492993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:37.492993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:37.492993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:37.492993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:37.492993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:37.492993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:37.492993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:37.492993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:37.494095 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:14:37.494095 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:14:37.494095 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:14:37.494095 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:14:37.494095 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:14:37.494095 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:14:37.494095 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:37.494095 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:37.494964 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 466/945] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:14:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:37.500681 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d396833-f383-4f7e-b48e-dd8071cdc540 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:37.531729 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04286aeb-80a7-4a8f-bcdf-46631f71287d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:37.532515 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04286aeb-80a7-4a8f-bcdf-46631f71287d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:37.532792 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04286aeb-80a7-4a8f-bcdf-46631f71287d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:37.533056 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04286aeb-80a7-4a8f-bcdf-46631f71287d None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:37.534042 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04286aeb-80a7-4a8f-bcdf-46631f71287d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:37.534347 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04286aeb-80a7-4a8f-bcdf-46631f71287d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:37.535919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04286aeb-80a7-4a8f-bcdf-46631f71287d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:37.542294 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 480/946] 10.222.0.94 () {56 vars in 1126 bytes} [Thu Sep 1 17:14:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:37.548968 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04286aeb-80a7-4a8f-bcdf-46631f71287d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:37.595920 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:37.623257 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d396833-f383-4f7e-b48e-dd8071cdc540 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:37.655882 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:37.662357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f59f4-ee4d-4076-9f03-863de0e4fdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:37.663199 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f59f4-ee4d-4076-9f03-863de0e4fdeb None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:37.663627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f59f4-ee4d-4076-9f03-863de0e4fdeb None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:37.664042 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f59f4-ee4d-4076-9f03-863de0e4fdeb None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:37.664883 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f59f4-ee4d-4076-9f03-863de0e4fdeb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:37.665356 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f59f4-ee4d-4076-9f03-863de0e4fdeb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:37.666950 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f59f4-ee4d-4076-9f03-863de0e4fdeb None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:37.680232 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 467/947] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:14:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:37.686224 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f59f4-ee4d-4076-9f03-863de0e4fdeb None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:37.688202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04286aeb-80a7-4a8f-bcdf-46631f71287d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:37.726934 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015601a-84a0-4256-be28-9c5a3e033ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:37.727552 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015601a-84a0-4256-be28-9c5a3e033ceb None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:37.727831 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015601a-84a0-4256-be28-9c5a3e033ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:37.728100 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015601a-84a0-4256-be28-9c5a3e033ceb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:37.728794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015601a-84a0-4256-be28-9c5a3e033ceb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:37.733540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015601a-84a0-4256-be28-9c5a3e033ceb None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:37.761587 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 481/948] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:14:37 2022] POST /identity/v3/endpoints => generated 347 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:14:37.801179 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f59f4-ee4d-4076-9f03-863de0e4fdeb None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:37.846868 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031a3a1-f197-4bce-b6fb-f28d662a35de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:37.847717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031a3a1-f197-4bce-b6fb-f28d662a35de None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:37.848093 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031a3a1-f197-4bce-b6fb-f28d662a35de None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:37.848464 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031a3a1-f197-4bce-b6fb-f28d662a35de None admin] PATH_INFO: `/v3/projects/c8f9428f37354c82ac52b6b8eccc424a/users/9e7444bc40314e73b282217bbb94798d/roles/9990ea7faa184ffb88d6994ef7e3eba1` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:37.850890 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031a3a1-f197-4bce-b6fb-f28d662a35de None admin] RBAC: Authorizing `identity:create_grant(project_id=c8f9428f37354c82ac52b6b8eccc424a, user_id=9e7444bc40314e73b282217bbb94798d, role_id=9990ea7faa184ffb88d6994ef7e3eba1)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:37.852442 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031a3a1-f197-4bce-b6fb-f28d662a35de None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:37.869988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 468/949] 10.222.0.94 () {58 vars in 1439 bytes} [Thu Sep 1 17:14:37 2022] PUT /identity/v3/projects/c8f9428f37354c82ac52b6b8eccc424a/users/9e7444bc40314e73b282217bbb94798d/roles/9990ea7faa184ffb88d6994ef7e3eba1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:14:38.206695 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66529c-d610-41f2-b7e2-962744ab38fb None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:38.207337 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66529c-d610-41f2-b7e2-962744ab38fb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:38.207543 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66529c-d610-41f2-b7e2-962744ab38fb None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:38.209260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 482/950] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:38.214751 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca88d9f-91b2-4dcc-942c-d3e3db4aecfb None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:38.215233 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca88d9f-91b2-4dcc-942c-d3e3db4aecfb None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:38.215472 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca88d9f-91b2-4dcc-942c-d3e3db4aecfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:38.234285 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-aca88d9f-91b2-4dcc-942c-d3e3db4aecfb None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:38.235468 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-aca88d9f-91b2-4dcc-942c-d3e3db4aecfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:38.285053 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:38.311969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 469/951] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:14:38.583617 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66529c-d610-41f2-b7e2-962744ab38fb None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:38.682716 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:38.694166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66529c-d610-41f2-b7e2-962744ab38fb None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:38.730142 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f737878-fa29-431c-b7ec-037a03560913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:38.731123 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f737878-fa29-431c-b7ec-037a03560913 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:38.732138 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f737878-fa29-431c-b7ec-037a03560913 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:38.732654 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f737878-fa29-431c-b7ec-037a03560913 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:38.733486 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f737878-fa29-431c-b7ec-037a03560913 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:38.735073 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f737878-fa29-431c-b7ec-037a03560913 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:38.744590 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-9f737878-fa29-431c-b7ec-037a03560913 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 17:14:38.744590 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:38.744590 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:14:38.744590 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:14:38.744590 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:14:38.744590 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:14:38.744590 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:14:38.744590 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:38.744590 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 17:14:38.744590 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:38.744590 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:14:38.744590 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:38.744590 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:38.744590 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:38.744590 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:38.744590 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:38.744590 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:38.745715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:38.745715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:38.745715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:38.745715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:38.745715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:38.745715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:38.745715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:14:38.745715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:14:38.745715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:14:38.745715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:14:38.745715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:38.745715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:38.745715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:38.745715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:38.745715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:38.745715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:38.746637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:38.746637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:38.746637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:38.746637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:38.746637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:38.746637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:38.746637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:38.746637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:38.746637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:38.746637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:38.746637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:14:38.746637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:38.746637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 17:14:38.746637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:38.749829 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 483/952] 10.222.0.94 () {56 vars in 1126 bytes} [Thu Sep 1 17:14:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:38.757653 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca88d9f-91b2-4dcc-942c-d3e3db4aecfb None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:38.860284 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca88d9f-91b2-4dcc-942c-d3e3db4aecfb None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:38.899677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c943e9d-1c81-486c-8457-984a554cc610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:38.900306 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c943e9d-1c81-486c-8457-984a554cc610 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:38.900584 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c943e9d-1c81-486c-8457-984a554cc610 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:38.900860 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c943e9d-1c81-486c-8457-984a554cc610 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:38.901520 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c943e9d-1c81-486c-8457-984a554cc610 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:38.901826 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c943e9d-1c81-486c-8457-984a554cc610 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:38.904553 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c943e9d-1c81-486c-8457-984a554cc610 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:38.910292 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 470/953] 10.222.0.94 () {56 vars in 1122 bytes} [Thu Sep 1 17:14:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:38.915628 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f737878-fa29-431c-b7ec-037a03560913 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:39.020007 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f737878-fa29-431c-b7ec-037a03560913 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:39.058174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb97ff-dbaf-49b3-9d98-f693c21f9286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:39.058787 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb97ff-dbaf-49b3-9d98-f693c21f9286 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:39.059063 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb97ff-dbaf-49b3-9d98-f693c21f9286 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:39.059839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb97ff-dbaf-49b3-9d98-f693c21f9286 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:39.060492 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb97ff-dbaf-49b3-9d98-f693c21f9286 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:39.060794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb97ff-dbaf-49b3-9d98-f693c21f9286 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:39.062181 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb97ff-dbaf-49b3-9d98-f693c21f9286 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:39.067538 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 484/954] 10.222.0.94 () {56 vars in 1122 bytes} [Thu Sep 1 17:14:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:39.074464 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c943e9d-1c81-486c-8457-984a554cc610 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:39.120320 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:39.189362 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c943e9d-1c81-486c-8457-984a554cc610 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:39.224382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6520af-9832-4f08-a001-7f08618970c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:39.225055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6520af-9832-4f08-a001-7f08618970c6 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:39.225263 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6520af-9832-4f08-a001-7f08618970c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:39.225563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6520af-9832-4f08-a001-7f08618970c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:39.226242 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6520af-9832-4f08-a001-7f08618970c6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:39.227600 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6520af-9832-4f08-a001-7f08618970c6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:39.251497 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 471/955] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:14:39 2022] POST /identity/v3/endpoints => generated 349 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:14:39.386660 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3726d-76ea-42c6-a884-e5b145ed532f None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:39.387163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3726d-76ea-42c6-a884-e5b145ed532f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:39.387163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3726d-76ea-42c6-a884-e5b145ed532f None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:39.389500 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 485/956] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:39.394633 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fb851-e905-4900-a9d5-cfa0d0b8b7a1 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:39.395254 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fb851-e905-4900-a9d5-cfa0d0b8b7a1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:39.395734 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fb851-e905-4900-a9d5-cfa0d0b8b7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:39.415665 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ca1fb851-e905-4900-a9d5-cfa0d0b8b7a1 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:39.417206 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ca1fb851-e905-4900-a9d5-cfa0d0b8b7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:39.498347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 472/957] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:39.779797 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3726d-76ea-42c6-a884-e5b145ed532f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:39.799516 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:39.833221 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4a4c2-35bf-4d28-a8fb-87c63b02c174 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:39.833580 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4a4c2-35bf-4d28-a8fb-87c63b02c174 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:39.833800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4a4c2-35bf-4d28-a8fb-87c63b02c174 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:39.835390 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 473/958] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:39.841337 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed37ba2-06f2-4e08-8144-a79c355a19f4 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:39.841923 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed37ba2-06f2-4e08-8144-a79c355a19f4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:39.842413 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed37ba2-06f2-4e08-8144-a79c355a19f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:39.861462 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-4ed37ba2-06f2-4e08-8144-a79c355a19f4 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:39.862656 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4ed37ba2-06f2-4e08-8144-a79c355a19f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:39.881889 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:39.896593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3726d-76ea-42c6-a884-e5b145ed532f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:39.938542 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152847aa-8c91-4805-9e9b-ccc9d65a8275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:39.939593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152847aa-8c91-4805-9e9b-ccc9d65a8275 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:39.939999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152847aa-8c91-4805-9e9b-ccc9d65a8275 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:39.940268 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152847aa-8c91-4805-9e9b-ccc9d65a8275 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:39.941070 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152847aa-8c91-4805-9e9b-ccc9d65a8275 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:39.943112 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152847aa-8c91-4805-9e9b-ccc9d65a8275 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:39.946144 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 474/959] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:39.950980 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbe79f-5ca2-4626-bd70-eb69a28ab534 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:39.951497 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbe79f-5ca2-4626-bd70-eb69a28ab534 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:39.951976 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbe79f-5ca2-4626-bd70-eb69a28ab534 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:39.953718 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 475/960] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:39.959101 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4ba78-08be-4ed1-aef7-e2c5f887a257 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:39.959379 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4ba78-08be-4ed1-aef7-e2c5f887a257 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:39.959650 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4ba78-08be-4ed1-aef7-e2c5f887a257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:39.960540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.sql.core [None req-152847aa-8c91-4805-9e9b-ccc9d65a8275 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 17:14:39.960540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 17:14:39.960540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [parameters: {'user_id': 'a0324339486c478aae1c255283f4f324', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 17:14:39.960540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81458) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 17:14:39.969348 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-152847aa-8c91-4805-9e9b-ccc9d65a8275 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 17:14:39.969348 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:39.969348 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 17:14:39.969348 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 17:14:39.969348 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 17:14:39.969348 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 17:14:39.969348 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 17:14:39.969348 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 17:14:39.969348 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 17:14:39.969348 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application conn.query(q) Sep 01 17:14:39.969348 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 17:14:39.969348 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 17:14:39.969348 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 17:14:39.969348 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result.read() Sep 01 17:14:39.969348 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 17:14:39.970416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 17:14:39.970416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 17:14:39.970416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 17:14:39.970416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 17:14:39.970416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 17:14:39.970416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 17:14:39.970416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 17:14:39.970416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 17:14:39.970416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:39.970416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 17:14:39.970416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:39.970416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:39.970416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 17:14:39.970416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 17:14:39.970416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 01 17:14:39.970416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 01 17:14:39.970416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 17:14:39.970416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application next(self.gen) Sep 01 17:14:39.971497 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 17:14:39.971497 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application yield resource Sep 01 17:14:39.971497 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 17:14:39.971497 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application next(self.gen) Sep 01 17:14:39.971497 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 17:14:39.971497 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 17:14:39.971497 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 17:14:39.971497 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 17:14:39.971497 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 17:14:39.971497 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise self.value Sep 01 17:14:39.971497 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 17:14:39.971497 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 17:14:39.971497 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 17:14:39.971497 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application session.commit() Sep 01 17:14:39.971497 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 17:14:39.971497 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 17:14:39.971497 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 17:14:39.972470 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 17:14:39.972470 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 17:14:39.972470 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.session.flush() Sep 01 17:14:39.972470 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 17:14:39.972470 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 17:14:39.972470 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 17:14:39.972470 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 17:14:39.972470 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 17:14:39.972470 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application compat.raise_( Sep 01 17:14:39.972470 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 17:14:39.972470 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception Sep 01 17:14:39.972470 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 17:14:39.972470 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 17:14:39.972470 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 17:14:39.972470 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 17:14:39.972470 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 17:14:39.972470 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 17:14:39.974872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 17:14:39.974872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 17:14:39.974872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 01 17:14:39.974872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 01 17:14:39.974872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 17:14:39.974872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 17:14:39.974872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 17:14:39.974872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 17:14:39.974872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 17:14:39.974872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 17:14:39.974872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 17:14:39.974872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 17:14:39.974872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 17:14:39.974872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 17:14:39.974872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 17:14:39.974872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception Sep 01 17:14:39.977108 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 17:14:39.977108 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 17:14:39.977108 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 17:14:39.977108 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 17:14:39.977108 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 17:14:39.977108 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 17:14:39.977108 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 17:14:39.977108 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application conn.query(q) Sep 01 17:14:39.977108 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 17:14:39.977108 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 17:14:39.977108 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 17:14:39.977108 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result.read() Sep 01 17:14:39.977108 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 17:14:39.977108 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 17:14:39.977108 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 17:14:39.977108 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 17:14:39.979179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 17:14:39.979179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 17:14:39.979179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 17:14:39.979179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 17:14:39.979179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 17:14:39.979179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 17:14:39.979179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a0324339486c478aae1c255283f4f324', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 17:14:39.979179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 17:14:39.979179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:39.979179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:14:39.979179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:39.979179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:39.979179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:39.979179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:39.979179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:39.981153 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:39.981153 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:39.981153 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:39.981153 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:39.981153 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:39.981153 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:39.981153 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:39.981153 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 01 17:14:39.981153 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 01 17:14:39.981153 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:39.981153 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:39.981153 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:14:39.981153 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:39.981153 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:14:39.981153 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:39.981153 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 01 17:14:39.981153 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 01 17:14:39.985084 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 01 17:14:39.985084 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 01 17:14:39.985084 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 17:14:39.985084 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 17:14:39.985084 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 17:14:39.985084 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:39.985969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-28f4ba78-08be-4ed1-aef7-e2c5f887a257 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:39.985969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-28f4ba78-08be-4ed1-aef7-e2c5f887a257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:39.986630 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 486/961] 10.222.0.94 () {60 vars in 1131 bytes} [Thu Sep 1 17:14:39 2022] POST /identity/v3/users => generated 160 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:39.989955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152847aa-8c91-4805-9e9b-ccc9d65a8275 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:40.053842 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 476/962] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:14:40.081956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:40.100032 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152847aa-8c91-4805-9e9b-ccc9d65a8275 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:40.135789 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0bdb0b-2ff1-4472-81ad-030591b5fe6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:40.136799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bdb0b-2ff1-4472-81ad-030591b5fe6b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:40.137344 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bdb0b-2ff1-4472-81ad-030591b5fe6b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:40.138457 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bdb0b-2ff1-4472-81ad-030591b5fe6b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:40.146328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0bdb0b-2ff1-4472-81ad-030591b5fe6b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:40.148609 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0bdb0b-2ff1-4472-81ad-030591b5fe6b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:40.160986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-5d0bdb0b-2ff1-4472-81ad-030591b5fe6b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 17:14:40.160986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:40.160986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:40.160986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:40.160986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:40.160986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:40.160986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:40.160986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:40.160986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:40.160986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:40.160986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:40.160986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:40.160986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:14:40.160986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:14:40.160986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:14:40.160986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:14:40.161987 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:40.161987 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:40.161987 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:14:40.161987 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:40.161987 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:14:40.161987 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:40.161987 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:40.161987 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:40.161987 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:40.161987 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:40.161987 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:40.161987 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:40.161987 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:40.161987 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:40.161987 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:40.161987 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:40.161987 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:40.161987 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:40.162965 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:40.162965 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:40.162965 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:14:40.162965 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:14:40.162965 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:14:40.162965 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:14:40.162965 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:14:40.162965 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:14:40.162965 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 17:14:40.162965 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:40.165506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 487/963] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:14:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:14:40.173444 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4ba78-08be-4ed1-aef7-e2c5f887a257 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:40.230028 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0bdb0b-2ff1-4472-81ad-030591b5fe6b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:40.262811 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:40.283233 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4ba78-08be-4ed1-aef7-e2c5f887a257 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:40.322692 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f219c-297b-4b56-9666-cdbe05102451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:40.323232 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f219c-297b-4b56-9666-cdbe05102451 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:40.323510 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f219c-297b-4b56-9666-cdbe05102451 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:40.323789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f219c-297b-4b56-9666-cdbe05102451 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:40.324495 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f219c-297b-4b56-9666-cdbe05102451 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:40.324800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f219c-297b-4b56-9666-cdbe05102451 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:40.326816 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f219c-297b-4b56-9666-cdbe05102451 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:40.357213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0bdb0b-2ff1-4472-81ad-030591b5fe6b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:40.372803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 477/964] 10.222.0.94 () {56 vars in 1101 bytes} [Thu Sep 1 17:14:40 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:40.372803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f219c-297b-4b56-9666-cdbe05102451 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:40.394604 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ea9cb-4245-470d-866a-2c1a305ab20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:40.395308 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ea9cb-4245-470d-866a-2c1a305ab20f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:40.395594 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ea9cb-4245-470d-866a-2c1a305ab20f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:40.395868 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ea9cb-4245-470d-866a-2c1a305ab20f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:40.396461 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ea9cb-4245-470d-866a-2c1a305ab20f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:40.397919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ea9cb-4245-470d-866a-2c1a305ab20f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:40.408102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-a07ea9cb-4245-470d-866a-2c1a305ab20f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 17:14:40.408102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:40.408102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:14:40.408102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:14:40.408102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:14:40.408102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:14:40.408102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:14:40.408102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:40.408102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 17:14:40.408102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:40.408102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:14:40.408102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:40.408102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:40.408102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:40.408102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:40.408102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:40.408102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:40.409291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:40.409291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:40.409291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:40.409291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:40.409291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:40.409291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:40.409291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:14:40.409291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:14:40.409291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:14:40.409291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:14:40.409291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:40.409291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:40.409291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:40.409291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:40.409291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:40.409291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:40.410211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:40.410211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:40.410211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:40.410211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:40.410211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:40.410211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:40.410211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:40.410211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:40.410211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:40.410211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:40.410211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:14:40.410211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:40.410211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 17:14:40.410211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:40.410211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 488/965] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:14:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:14:40.415572 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ea9cb-4245-470d-866a-2c1a305ab20f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:40.421806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:40.514628 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f219c-297b-4b56-9666-cdbe05102451 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:40.555575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a349a39-045b-4460-a771-853f0390943f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:40.556217 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a349a39-045b-4460-a771-853f0390943f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:40.556474 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a349a39-045b-4460-a771-853f0390943f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:40.556741 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a349a39-045b-4460-a771-853f0390943f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:40.559154 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ea9cb-4245-470d-866a-2c1a305ab20f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:40.567730 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a349a39-045b-4460-a771-853f0390943f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:14:40.572653 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-9a349a39-045b-4460-a771-853f0390943f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 17:14:40.572653 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:40.572653 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:40.572653 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:40.572653 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:40.572653 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:40.572653 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:40.572653 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:40.572653 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:40.572653 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:40.572653 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:40.572653 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:40.572653 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:14:40.572653 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:14:40.572653 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:14:40.572653 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:14:40.573803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:14:40.573803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:14:40.573803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:14:40.573803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:14:40.573803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:40.573803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:40.573803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:40.573803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:40.573803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:40.573803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:40.573803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:40.573803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:40.573803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:40.573803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:40.573803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:40.573803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:40.574690 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:40.574690 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:40.574690 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:40.574690 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:40.574690 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:14:40.574690 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:14:40.574690 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:14:40.574690 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:14:40.574690 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:14:40.574690 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:14:40.574690 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 17:14:40.574690 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:40.574690 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 478/966] 10.222.0.94 () {56 vars in 1120 bytes} [Thu Sep 1 17:14:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:40.579926 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a349a39-045b-4460-a771-853f0390943f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:40.583712 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:40.602891 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a8c76-aef7-4867-8be4-6982c97308d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:40.603671 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a8c76-aef7-4867-8be4-6982c97308d9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:40.604062 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a8c76-aef7-4867-8be4-6982c97308d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:40.604447 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a8c76-aef7-4867-8be4-6982c97308d9 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:40.605190 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a8c76-aef7-4867-8be4-6982c97308d9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:40.605624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a8c76-aef7-4867-8be4-6982c97308d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:40.608002 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a8c76-aef7-4867-8be4-6982c97308d9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:40.619406 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 489/967] 10.222.0.94 () {56 vars in 1112 bytes} [Thu Sep 1 17:14:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:40.630667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a8c76-aef7-4867-8be4-6982c97308d9 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:40.713202 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a349a39-045b-4460-a771-853f0390943f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:40.719170 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:40.754555 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c12bc-9282-4dc2-a20f-1d80831ccd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:40.755244 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c12bc-9282-4dc2-a20f-1d80831ccd62 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:40.755594 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c12bc-9282-4dc2-a20f-1d80831ccd62 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:40.755936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c12bc-9282-4dc2-a20f-1d80831ccd62 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:40.756663 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c12bc-9282-4dc2-a20f-1d80831ccd62 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:40.756962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c12bc-9282-4dc2-a20f-1d80831ccd62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:40.758358 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c12bc-9282-4dc2-a20f-1d80831ccd62 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:40.759347 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a8c76-aef7-4867-8be4-6982c97308d9 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:40.766665 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 479/968] 10.222.0.94 () {56 vars in 1115 bytes} [Thu Sep 1 17:14:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:40.772173 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c12bc-9282-4dc2-a20f-1d80831ccd62 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:40.801067 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c9771-aacb-4be8-abdd-8a448cb246d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:40.801708 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c9771-aacb-4be8-abdd-8a448cb246d5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:40.802009 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c9771-aacb-4be8-abdd-8a448cb246d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:40.802281 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c9771-aacb-4be8-abdd-8a448cb246d5 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:40.802910 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c9771-aacb-4be8-abdd-8a448cb246d5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:40.803209 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c9771-aacb-4be8-abdd-8a448cb246d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:40.804579 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c9771-aacb-4be8-abdd-8a448cb246d5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:40.817432 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 490/969] 10.222.0.94 () {56 vars in 1112 bytes} [Thu Sep 1 17:14:40 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:40.850204 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:40.894495 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c12bc-9282-4dc2-a20f-1d80831ccd62 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:40.930445 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a3bf4-e074-474a-8002-71697a1fa6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:40.931087 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a3bf4-e074-474a-8002-71697a1fa6a4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:40.931361 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a3bf4-e074-474a-8002-71697a1fa6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:40.931630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a3bf4-e074-474a-8002-71697a1fa6a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:40.943202 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a3bf4-e074-474a-8002-71697a1fa6a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:40.944659 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a3bf4-e074-474a-8002-71697a1fa6a4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:40.960682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-1d7a3bf4-e074-474a-8002-71697a1fa6a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:40.960682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:40.960682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:40.960682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:40.960682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:40.960682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:40.960682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:40.960682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:40.960682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:40.960682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:40.960682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:40.960682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:40.960682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:40.960682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:40.960682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:40.960682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:40.961778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:40.961778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:40.961778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:40.961778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:40.961778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:40.961778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:40.961778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:40.961778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:40.961778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:40.961778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:40.961778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:40.961778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:40.961778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:40.961778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:40.961778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:40.961778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:40.961778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:40.962709 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:40.962709 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:40.962709 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:40.962709 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 480/970] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:40.968083 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c9771-aacb-4be8-abdd-8a448cb246d5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:41.076500 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c9771-aacb-4be8-abdd-8a448cb246d5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:41.107559 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:41.113787 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ac1f1-0e60-4940-b2ee-bd470753f4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:41.114513 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ac1f1-0e60-4940-b2ee-bd470753f4bd None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:41.114853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ac1f1-0e60-4940-b2ee-bd470753f4bd None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:41.115188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ac1f1-0e60-4940-b2ee-bd470753f4bd None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:41.115892 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ac1f1-0e60-4940-b2ee-bd470753f4bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:41.116257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ac1f1-0e60-4940-b2ee-bd470753f4bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:41.117704 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ac1f1-0e60-4940-b2ee-bd470753f4bd None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:41.130302 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 491/971] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:41.135745 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a3bf4-e074-474a-8002-71697a1fa6a4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:41.239451 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a3bf4-e074-474a-8002-71697a1fa6a4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:41.257588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:41.277352 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37af99-7064-42f6-87e7-bf9f9e5e529b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:41.278020 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37af99-7064-42f6-87e7-bf9f9e5e529b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:41.278392 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37af99-7064-42f6-87e7-bf9f9e5e529b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:41.278665 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37af99-7064-42f6-87e7-bf9f9e5e529b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:41.286278 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37af99-7064-42f6-87e7-bf9f9e5e529b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:41.287729 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37af99-7064-42f6-87e7-bf9f9e5e529b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:41.294352 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2754ffa-2c9e-48d6-9706-2e03103a69c2 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:41.294654 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2754ffa-2c9e-48d6-9706-2e03103a69c2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:41.294921 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2754ffa-2c9e-48d6-9706-2e03103a69c2 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:41.296395 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 492/972] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:41.300054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-6a37af99-7064-42f6-87e7-bf9f9e5e529b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 17:14:41.300054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:41.300054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:41.300054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:41.300054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:41.300054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:41.300054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:41.300054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:41.300054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:41.300054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:41.300054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:41.300054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:41.300054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:14:41.300054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:14:41.300054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:14:41.300054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:14:41.301015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:41.301015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:41.301015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:14:41.301015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:41.301015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:14:41.301015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:41.301015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:41.301015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:41.301015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:41.301015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:41.301015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:41.301015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:41.301015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:41.301015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:41.301015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:41.301015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:41.301015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:41.301015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:41.307010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:41.307010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:41.307010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:14:41.307010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:14:41.307010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:14:41.307010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:14:41.307010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:14:41.307010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:14:41.307010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 17:14:41.307010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:41.307601 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd612f-1f77-4baf-93c8-7208d8d7aff4 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:41.307677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 481/973] 10.222.0.94 () {56 vars in 1117 bytes} [Thu Sep 1 17:14:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:41.307756 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd612f-1f77-4baf-93c8-7208d8d7aff4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:41.307756 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd612f-1f77-4baf-93c8-7208d8d7aff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:41.307892 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37af99-7064-42f6-87e7-bf9f9e5e529b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:41.322765 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3abd612f-1f77-4baf-93c8-7208d8d7aff4 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:41.324310 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3abd612f-1f77-4baf-93c8-7208d8d7aff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:41.395029 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 493/974] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:14:41.415695 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37af99-7064-42f6-87e7-bf9f9e5e529b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:41.450795 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3fe0c-b846-497e-a3e8-4e504ea9cdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:41.451406 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3fe0c-b846-497e-a3e8-4e504ea9cdfa None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:41.451684 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3fe0c-b846-497e-a3e8-4e504ea9cdfa None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:41.451954 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3fe0c-b846-497e-a3e8-4e504ea9cdfa None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:41.452678 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3fe0c-b846-497e-a3e8-4e504ea9cdfa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:41.452983 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3fe0c-b846-497e-a3e8-4e504ea9cdfa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:41.454724 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3fe0c-b846-497e-a3e8-4e504ea9cdfa None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:41.476480 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 482/975] 10.222.0.94 () {56 vars in 1149 bytes} [Thu Sep 1 17:14:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:41.477698 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd612f-1f77-4baf-93c8-7208d8d7aff4 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:41.583132 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd612f-1f77-4baf-93c8-7208d8d7aff4 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:41.605622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:41.618228 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1005c3-ffaa-422f-bd14-664153e0a5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:41.618888 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1005c3-ffaa-422f-bd14-664153e0a5d5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:41.619171 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1005c3-ffaa-422f-bd14-664153e0a5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:41.619441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1005c3-ffaa-422f-bd14-664153e0a5d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:41.662043 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3fe0c-b846-497e-a3e8-4e504ea9cdfa None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:41.689750 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1005c3-ffaa-422f-bd14-664153e0a5d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:41.691202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1005c3-ffaa-422f-bd14-664153e0a5d5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:41.697824 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:41.767430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3fe0c-b846-497e-a3e8-4e504ea9cdfa None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:41.797302 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 494/976] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:14:41 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 17:14:41.803195 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1005c3-ffaa-422f-bd14-664153e0a5d5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:41.810625 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c68af4-ebe1-41a8-8f77-2c689fcf6bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:41.811374 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c68af4-ebe1-41a8-8f77-2c689fcf6bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:41.811584 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c68af4-ebe1-41a8-8f77-2c689fcf6bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:41.811810 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c68af4-ebe1-41a8-8f77-2c689fcf6bb4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:41.812400 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c68af4-ebe1-41a8-8f77-2c689fcf6bb4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:41.813848 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c68af4-ebe1-41a8-8f77-2c689fcf6bb4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:41.823418 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-18c68af4-ebe1-41a8-8f77-2c689fcf6bb4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 17:14:41.823418 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:41.823418 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:14:41.823418 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:14:41.823418 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:14:41.823418 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:14:41.823418 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:14:41.823418 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:41.823418 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 17:14:41.823418 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:41.823418 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:14:41.823418 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:41.823418 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:41.823418 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:41.823418 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:41.823418 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:41.823418 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:41.824491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:41.824491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:41.824491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:41.824491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:41.824491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:41.824491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:41.824491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:14:41.824491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:14:41.824491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:14:41.824491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:14:41.824491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:41.824491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:41.824491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:41.824491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:41.824491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:41.824491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:41.826488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:41.826488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:41.826488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:41.826488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:41.826488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:41.826488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:41.826488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:41.826488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:41.826488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:41.826488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:41.826488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:14:41.826488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:41.826488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 17:14:41.826488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:41.826488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 483/977] 10.222.0.94 () {56 vars in 1126 bytes} [Thu Sep 1 17:14:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:14:41.831128 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c68af4-ebe1-41a8-8f77-2c689fcf6bb4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:41.832778 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:41.919475 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1005c3-ffaa-422f-bd14-664153e0a5d5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:41.934128 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:41.938741 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c68af4-ebe1-41a8-8f77-2c689fcf6bb4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:41.959656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382dee48-3a06-48c2-9142-b3a4121f0191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:41.960287 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dee48-3a06-48c2-9142-b3a4121f0191 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:41.960568 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dee48-3a06-48c2-9142-b3a4121f0191 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:41.960840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dee48-3a06-48c2-9142-b3a4121f0191 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:41.971042 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382dee48-3a06-48c2-9142-b3a4121f0191 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:41.972489 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382dee48-3a06-48c2-9142-b3a4121f0191 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:41.977388 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537e0cb-69c1-4a8f-b807-f93893136932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:41.978024 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537e0cb-69c1-4a8f-b807-f93893136932 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:41.978304 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537e0cb-69c1-4a8f-b807-f93893136932 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:41.978577 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537e0cb-69c1-4a8f-b807-f93893136932 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:41.979618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537e0cb-69c1-4a8f-b807-f93893136932 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:41.979928 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537e0cb-69c1-4a8f-b807-f93893136932 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:41.981729 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537e0cb-69c1-4a8f-b807-f93893136932 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:41.991046 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 484/978] 10.222.0.94 () {56 vars in 1122 bytes} [Thu Sep 1 17:14:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:41.991188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-382dee48-3a06-48c2-9142-b3a4121f0191 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:41.991188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:41.991188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:41.991188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:41.991188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:41.991188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:41.991188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:41.991188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:41.991188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:41.991188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:41.991188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:41.991188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:41.991188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:41.991188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:41.991188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:41.991188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:41.992102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:41.992102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:41.992102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:41.992102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:41.992102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:41.992102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:41.992102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:41.992102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:41.992102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:41.992102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:41.992102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:41.992102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:41.992102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:41.992102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:41.992102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:41.992102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:41.992102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:41.993025 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:41.993025 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:41.993025 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:41.993025 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 495/979] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:14:41.993715 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537e0cb-69c1-4a8f-b807-f93893136932 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:41.993818 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382dee48-3a06-48c2-9142-b3a4121f0191 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:42.070996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:42.099150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537e0cb-69c1-4a8f-b807-f93893136932 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:42.099932 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382dee48-3a06-48c2-9142-b3a4121f0191 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:42.136632 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3447424-cbe0-43d4-b959-adf8a4d2addb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:42.137105 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4a635-0ee8-4144-87d2-88b2fb87ab76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:42.137571 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3447424-cbe0-43d4-b959-adf8a4d2addb None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:42.137764 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4a635-0ee8-4144-87d2-88b2fb87ab76 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:42.138043 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4a635-0ee8-4144-87d2-88b2fb87ab76 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:42.138147 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3447424-cbe0-43d4-b959-adf8a4d2addb None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:42.138315 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4a635-0ee8-4144-87d2-88b2fb87ab76 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:42.138581 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3447424-cbe0-43d4-b959-adf8a4d2addb None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:42.138946 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4a635-0ee8-4144-87d2-88b2fb87ab76 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:42.139249 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4a635-0ee8-4144-87d2-88b2fb87ab76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:42.139491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3447424-cbe0-43d4-b959-adf8a4d2addb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:42.139890 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3447424-cbe0-43d4-b959-adf8a4d2addb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:42.140667 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4a635-0ee8-4144-87d2-88b2fb87ab76 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:42.141452 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3447424-cbe0-43d4-b959-adf8a4d2addb None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:42.149732 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 485/980] 10.222.0.94 () {56 vars in 1122 bytes} [Thu Sep 1 17:14:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:42.151985 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4a635-0ee8-4144-87d2-88b2fb87ab76 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:42.154721 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 496/981] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:42.160147 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3447424-cbe0-43d4-b959-adf8a4d2addb None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:42.182780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:42.255767 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4a635-0ee8-4144-87d2-88b2fb87ab76 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:42.270349 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3447424-cbe0-43d4-b959-adf8a4d2addb None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:42.292597 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf1cb3-2300-4aa5-8fa7-22cb1feeaef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:42.293332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf1cb3-2300-4aa5-8fa7-22cb1feeaef2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:42.293550 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf1cb3-2300-4aa5-8fa7-22cb1feeaef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:42.293898 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf1cb3-2300-4aa5-8fa7-22cb1feeaef2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:42.294618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edf1cb3-2300-4aa5-8fa7-22cb1feeaef2 None admin] RBAC: Adding query filter params (interface=admin, service_id=eeacb932c0cf440fba24fb5c52d91dc5, region_id=RegionOne) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:42.294930 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edf1cb3-2300-4aa5-8fa7-22cb1feeaef2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:42.296831 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edf1cb3-2300-4aa5-8fa7-22cb1feeaef2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:42.306506 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 486/982] 10.222.0.94 () {56 vars in 1249 bytes} [Thu Sep 1 17:14:42 2022] GET /identity/v3/endpoints?service_id=eeacb932c0cf440fba24fb5c52d91dc5&interface=admin®ion_id=RegionOne => generated 193 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:42.307524 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf1cb3-2300-4aa5-8fa7-22cb1feeaef2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:42.313214 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d55f3-bc79-4e0d-831f-4d276f38041f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:42.313892 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d55f3-bc79-4e0d-831f-4d276f38041f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:42.314166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d55f3-bc79-4e0d-831f-4d276f38041f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:42.314436 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d55f3-bc79-4e0d-831f-4d276f38041f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:42.316415 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:42.323328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d55f3-bc79-4e0d-831f-4d276f38041f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:42.324778 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d55f3-bc79-4e0d-831f-4d276f38041f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:42.336963 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-a58d55f3-bc79-4e0d-831f-4d276f38041f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:42.336963 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:42.336963 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:42.336963 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:42.336963 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:42.336963 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:42.336963 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:42.336963 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:42.336963 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:42.336963 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:42.336963 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:42.336963 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:42.336963 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:14:42.336963 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:14:42.336963 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:14:42.337960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:14:42.337960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:42.337960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:42.337960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:42.337960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:42.337960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:42.337960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:42.337960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:42.337960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:42.337960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:42.337960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:42.337960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:42.337960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:42.337960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:42.337960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:42.337960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:42.337960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:42.338867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:14:42.338867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:14:42.338867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:14:42.338867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:14:42.338867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:14:42.338867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:14:42.338867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:42.338867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:42.338867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 497/983] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:14:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:42.344148 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d55f3-bc79-4e0d-831f-4d276f38041f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:42.408313 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:42.419685 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf1cb3-2300-4aa5-8fa7-22cb1feeaef2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:42.451127 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d55f3-bc79-4e0d-831f-4d276f38041f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:42.455305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efbaa40-bade-4c4b-bb6c-e3177c1f6906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:42.456165 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbaa40-bade-4c4b-bb6c-e3177c1f6906 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:42.456644 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbaa40-bade-4c4b-bb6c-e3177c1f6906 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:42.457137 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbaa40-bade-4c4b-bb6c-e3177c1f6906 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:42.457971 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efbaa40-bade-4c4b-bb6c-e3177c1f6906 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:42.459530 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efbaa40-bade-4c4b-bb6c-e3177c1f6906 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:42.466224 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 487/984] 10.222.0.94 () {56 vars in 1087 bytes} [Thu Sep 1 17:14:42 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:14:42.500818 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711058db-7e30-4131-8d41-af0c4404ed17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:42.501506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711058db-7e30-4131-8d41-af0c4404ed17 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:42.501787 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711058db-7e30-4131-8d41-af0c4404ed17 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:42.502058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711058db-7e30-4131-8d41-af0c4404ed17 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:42.502765 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711058db-7e30-4131-8d41-af0c4404ed17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:42.503071 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711058db-7e30-4131-8d41-af0c4404ed17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:42.504533 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711058db-7e30-4131-8d41-af0c4404ed17 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:42.518352 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 498/985] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:14:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:42.524456 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efbaa40-bade-4c4b-bb6c-e3177c1f6906 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:42.643717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efbaa40-bade-4c4b-bb6c-e3177c1f6906 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:42.678507 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1e15f-eb8f-49f0-9797-0d9ef46ff248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:42.679112 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1e15f-eb8f-49f0-9797-0d9ef46ff248 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:42.679387 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1e15f-eb8f-49f0-9797-0d9ef46ff248 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:42.679654 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1e15f-eb8f-49f0-9797-0d9ef46ff248 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:42.680371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1e15f-eb8f-49f0-9797-0d9ef46ff248 None admin] RBAC: Adding query filter params (role.id=9990ea7faa184ffb88d6994ef7e3eba1, scope.project.id=c8f9428f37354c82ac52b6b8eccc424a, user.id=9e7444bc40314e73b282217bbb94798d) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:42.680672 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1e15f-eb8f-49f0-9797-0d9ef46ff248 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:42.682113 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1e15f-eb8f-49f0-9797-0d9ef46ff248 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:42.693480 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 488/986] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:14:42 2022] GET /identity/v3/role_assignments?user.id=9e7444bc40314e73b282217bbb94798d&scope.project.id=c8f9428f37354c82ac52b6b8eccc424a&role.id=9990ea7faa184ffb88d6994ef7e3eba1 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:42.767182 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63a38c-962d-4059-a98f-9ce6c1cbf9fa None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:42.767494 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63a38c-962d-4059-a98f-9ce6c1cbf9fa None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:42.767782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63a38c-962d-4059-a98f-9ce6c1cbf9fa None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:42.770397 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 499/987] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:42.776648 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43de5a0-6427-491e-9f73-c096e265386f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:42.776961 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43de5a0-6427-491e-9f73-c096e265386f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:42.777209 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43de5a0-6427-491e-9f73-c096e265386f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:42.798750 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b43de5a0-6427-491e-9f73-c096e265386f None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:42.799974 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b43de5a0-6427-491e-9f73-c096e265386f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:42.816462 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:42.879717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 489/988] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:43.154380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63a38c-962d-4059-a98f-9ce6c1cbf9fa None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:43.214645 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:43.263426 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63a38c-962d-4059-a98f-9ce6c1cbf9fa None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:43.298672 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f1c42-f233-4c6c-8b30-f2302eb4a199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:43.299366 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f1c42-f233-4c6c-8b30-f2302eb4a199 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:43.299645 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f1c42-f233-4c6c-8b30-f2302eb4a199 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:43.299914 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f1c42-f233-4c6c-8b30-f2302eb4a199 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:43.300578 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f1c42-f233-4c6c-8b30-f2302eb4a199 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:43.301978 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f1c42-f233-4c6c-8b30-f2302eb4a199 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:43.321601 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 500/989] 10.222.0.94 () {60 vars in 1141 bytes} [Thu Sep 1 17:14:43 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:14:44.394403 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d2207-bf83-424c-a004-d5528617577b None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:44.394935 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d2207-bf83-424c-a004-d5528617577b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:44.394935 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d2207-bf83-424c-a004-d5528617577b None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:44.396430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 490/990] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:44.401456 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc355dd6-658e-4bc4-9213-b41adfc036aa None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:44.401868 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc355dd6-658e-4bc4-9213-b41adfc036aa None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:44.402038 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc355dd6-658e-4bc4-9213-b41adfc036aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:44.421143 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-cc355dd6-658e-4bc4-9213-b41adfc036aa None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:44.422411 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cc355dd6-658e-4bc4-9213-b41adfc036aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:44.499322 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 501/991] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:44 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:44.657779 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612700d-8215-4741-93ee-d30fe4609582 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:44.658110 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612700d-8215-4741-93ee-d30fe4609582 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:44.658335 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612700d-8215-4741-93ee-d30fe4609582 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:44.659832 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 491/992] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:44.664609 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8668eec-00dc-40da-8a1a-e6c47ca88b9b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:44.664897 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8668eec-00dc-40da-8a1a-e6c47ca88b9b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:44.665168 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8668eec-00dc-40da-8a1a-e6c47ca88b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:44.683717 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b8668eec-00dc-40da-8a1a-e6c47ca88b9b None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:44.684957 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b8668eec-00dc-40da-8a1a-e6c47ca88b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:44.720204 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:44.755354 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 502/993] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:44 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:44.770527 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612700d-8215-4741-93ee-d30fe4609582 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:44.872907 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612700d-8215-4741-93ee-d30fe4609582 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:44.908118 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd98370-5605-43ed-bf7a-e1c616c486fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:44.908668 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd98370-5605-43ed-bf7a-e1c616c486fe None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:44.908942 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd98370-5605-43ed-bf7a-e1c616c486fe None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:44.909207 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd98370-5605-43ed-bf7a-e1c616c486fe None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:44.909831 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd98370-5605-43ed-bf7a-e1c616c486fe None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:44.911205 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd98370-5605-43ed-bf7a-e1c616c486fe None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:44.920050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-ddd98370-5605-43ed-bf7a-e1c616c486fe None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 17:14:44.920050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:44.920050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:14:44.920050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:14:44.920050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:14:44.920050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:14:44.920050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:14:44.920050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:44.920050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 17:14:44.920050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:44.920050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:14:44.920050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:44.920050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:44.920050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:44.920050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:44.920050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:44.920050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:44.921102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:44.921102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:44.921102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:44.921102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:44.921102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:44.921102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:44.921102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:14:44.921102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:14:44.921102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:14:44.921102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:14:44.921102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:44.921102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:44.921102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:44.921102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:44.921102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:44.921102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:44.922331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:44.922331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:44.922331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:44.922331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:44.922331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:44.922331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:44.922331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:44.922331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:44.922331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:44.922331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:44.922331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:14:44.922331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:44.922331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 17:14:44.922331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:44.925713 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 492/994] 10.222.0.94 () {56 vars in 1126 bytes} [Thu Sep 1 17:14:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:44.927042 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8668eec-00dc-40da-8a1a-e6c47ca88b9b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:45.019074 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd98370-5605-43ed-bf7a-e1c616c486fe None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:45.026226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8668eec-00dc-40da-8a1a-e6c47ca88b9b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:45.034165 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:45.061128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4e955-d899-47ea-9d35-023f202c7af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:45.061764 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4e955-d899-47ea-9d35-023f202c7af5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:45.062041 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4e955-d899-47ea-9d35-023f202c7af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:45.062310 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4e955-d899-47ea-9d35-023f202c7af5 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:45.062944 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b4e955-d899-47ea-9d35-023f202c7af5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:45.063249 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b4e955-d899-47ea-9d35-023f202c7af5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:45.064620 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b4e955-d899-47ea-9d35-023f202c7af5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:45.074060 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 503/995] 10.222.0.94 () {56 vars in 1122 bytes} [Thu Sep 1 17:14:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:45.076002 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4e955-d899-47ea-9d35-023f202c7af5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:45.111316 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:45.129937 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd98370-5605-43ed-bf7a-e1c616c486fe None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:45.165978 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086edd8-476d-4707-98e9-da23dde047b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:45.166631 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086edd8-476d-4707-98e9-da23dde047b7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:45.166914 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086edd8-476d-4707-98e9-da23dde047b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:45.167188 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086edd8-476d-4707-98e9-da23dde047b7 None admin] PATH_INFO: `/v3/services/image` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:45.167763 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086edd8-476d-4707-98e9-da23dde047b7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:45.169218 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086edd8-476d-4707-98e9-da23dde047b7 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:45.178054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-3086edd8-476d-4707-98e9-da23dde047b7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 17:14:45.178054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:45.178054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:14:45.178054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:14:45.178054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:14:45.178054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:14:45.178054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:14:45.178054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:45.178054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 17:14:45.178054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:45.178054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:14:45.178054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:45.178054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:45.178054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:45.178054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:45.178054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:45.178054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:45.179265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:45.179265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:45.179265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:45.179265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:45.179265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:45.179265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:45.179265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:14:45.179265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:14:45.179265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:14:45.179265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:14:45.179265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:45.179265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:45.179265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:45.179265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:45.179265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:45.179265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:45.180115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:45.180115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:45.180115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:45.180115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:45.180115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:45.180115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:45.180115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:45.180115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:45.180115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:45.180115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:45.180115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:14:45.180115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:45.180115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 17:14:45.180115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:45.180115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 493/996] 10.222.0.94 () {56 vars in 1105 bytes} [Thu Sep 1 17:14:45 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:14:45.185312 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086edd8-476d-4707-98e9-da23dde047b7 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:45.191191 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4e955-d899-47ea-9d35-023f202c7af5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:45.227723 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f1210-5b2b-430f-b42e-302a69e72a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:45.228439 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f1210-5b2b-430f-b42e-302a69e72a72 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:45.228622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f1210-5b2b-430f-b42e-302a69e72a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:45.228855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f1210-5b2b-430f-b42e-302a69e72a72 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:45.229511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f1210-5b2b-430f-b42e-302a69e72a72 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:45.229814 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f1210-5b2b-430f-b42e-302a69e72a72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:45.231232 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f1210-5b2b-430f-b42e-302a69e72a72 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:45.236390 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 504/997] 10.222.0.94 () {56 vars in 1122 bytes} [Thu Sep 1 17:14:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:45.242114 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f1210-5b2b-430f-b42e-302a69e72a72 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:45.267815 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:45.292769 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086edd8-476d-4707-98e9-da23dde047b7 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:45.327141 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fe36f-8692-4450-880e-321c4f22c67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:45.327745 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fe36f-8692-4450-880e-321c4f22c67c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:45.328023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fe36f-8692-4450-880e-321c4f22c67c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:45.328300 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fe36f-8692-4450-880e-321c4f22c67c None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:45.329178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72fe36f-8692-4450-880e-321c4f22c67c None admin] RBAC: Adding query filter params (name=image) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:45.329513 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72fe36f-8692-4450-880e-321c4f22c67c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:45.330875 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72fe36f-8692-4450-880e-321c4f22c67c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:45.335607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 494/998] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:45.336738 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc04b0-aeb4-4ed4-bf53-a27da0ea99a5 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:45.337019 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc04b0-aeb4-4ed4-bf53-a27da0ea99a5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:45.337292 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc04b0-aeb4-4ed4-bf53-a27da0ea99a5 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:45.338501 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 495/999] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:45.341651 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc04b0-aeb4-4ed4-bf53-a27da0ea99a5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:45.344556 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:45.349606 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f1210-5b2b-430f-b42e-302a69e72a72 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:45.382407 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e2178-e5db-4640-880b-5c5b258a2a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:45.383002 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e2178-e5db-4640-880b-5c5b258a2a0c None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:45.383273 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e2178-e5db-4640-880b-5c5b258a2a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:45.383536 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e2178-e5db-4640-880b-5c5b258a2a0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:45.384199 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e2178-e5db-4640-880b-5c5b258a2a0c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:45.385584 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e2178-e5db-4640-880b-5c5b258a2a0c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:45.401946 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 505/1000] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:14:45 2022] POST /identity/v3/endpoints => generated 325 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:14:45.403447 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fff14-7182-4e78-9ca5-300502296beb None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:45.403838 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fff14-7182-4e78-9ca5-300502296beb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:45.404182 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fff14-7182-4e78-9ca5-300502296beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:45.435560 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d41fff14-7182-4e78-9ca5-300502296beb None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:45.436715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d41fff14-7182-4e78-9ca5-300502296beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:45.456739 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc04b0-aeb4-4ed4-bf53-a27da0ea99a5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:45.495317 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635a057-77e2-4917-9068-8e75da10cd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:45.495944 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635a057-77e2-4917-9068-8e75da10cd86 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:45.496232 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635a057-77e2-4917-9068-8e75da10cd86 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:45.496503 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635a057-77e2-4917-9068-8e75da10cd86 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:45.497739 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635a057-77e2-4917-9068-8e75da10cd86 None admin] RBAC: Adding query filter params (type=image) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:45.498045 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635a057-77e2-4917-9068-8e75da10cd86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:45.499444 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635a057-77e2-4917-9068-8e75da10cd86 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:45.501835 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:45.505206 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 496/1001] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:45 2022] GET /identity/v3/services?type=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:45.537435 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 506/1002] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:45 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:45.799528 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635a057-77e2-4917-9068-8e75da10cd86 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:45.905261 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635a057-77e2-4917-9068-8e75da10cd86 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:45.939517 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6870b-ea50-40c8-9d26-3432995c3594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:45.940146 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6870b-ea50-40c8-9d26-3432995c3594 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:45.940427 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6870b-ea50-40c8-9d26-3432995c3594 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:45.940699 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6870b-ea50-40c8-9d26-3432995c3594 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:45.941277 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6870b-ea50-40c8-9d26-3432995c3594 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:45.942684 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6870b-ea50-40c8-9d26-3432995c3594 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:45.953616 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-ded6870b-ea50-40c8-9d26-3432995c3594 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 17:14:45.953616 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:45.953616 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:14:45.953616 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:14:45.953616 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:14:45.953616 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:14:45.953616 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:14:45.953616 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:45.953616 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 17:14:45.953616 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:45.953616 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:14:45.953616 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:45.953616 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:45.953616 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:45.953616 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:45.953616 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:45.953616 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:45.954663 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:45.954663 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:45.954663 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:45.954663 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:45.954663 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:45.954663 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:45.954663 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:14:45.954663 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:14:45.954663 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:14:45.954663 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:14:45.954663 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:45.954663 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:45.954663 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:45.954663 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:45.954663 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:45.954663 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:45.955546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:45.955546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:45.955546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:45.955546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:45.955546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:45.955546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:45.955546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:45.955546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:45.955546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:45.955546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:45.955546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:14:45.955546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:45.955546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 17:14:45.955546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:45.957759 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 497/1003] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:14:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:45.960577 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41fff14-7182-4e78-9ca5-300502296beb None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:46.047475 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:46.062965 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41fff14-7182-4e78-9ca5-300502296beb None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:46.098645 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167975d-34ef-46e8-ba25-3bd4c202b66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:46.099669 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167975d-34ef-46e8-ba25-3bd4c202b66e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:46.100166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167975d-34ef-46e8-ba25-3bd4c202b66e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:46.100535 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167975d-34ef-46e8-ba25-3bd4c202b66e None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:46.101186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167975d-34ef-46e8-ba25-3bd4c202b66e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:46.101521 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167975d-34ef-46e8-ba25-3bd4c202b66e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:46.102921 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167975d-34ef-46e8-ba25-3bd4c202b66e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:46.112834 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 507/1004] 10.222.0.94 () {56 vars in 1112 bytes} [Thu Sep 1 17:14:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:46.114580 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6870b-ea50-40c8-9d26-3432995c3594 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:46.179818 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:46.219641 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6870b-ea50-40c8-9d26-3432995c3594 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:46.257546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ec800-4039-4609-914f-92a8fc193173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:46.258158 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ec800-4039-4609-914f-92a8fc193173 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:46.258437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ec800-4039-4609-914f-92a8fc193173 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:46.258709 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ec800-4039-4609-914f-92a8fc193173 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:46.259337 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ec800-4039-4609-914f-92a8fc193173 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:46.259640 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ec800-4039-4609-914f-92a8fc193173 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:46.261000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ec800-4039-4609-914f-92a8fc193173 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:46.270896 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 498/1005] 10.222.0.94 () {56 vars in 1112 bytes} [Thu Sep 1 17:14:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:46.272409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167975d-34ef-46e8-ba25-3bd4c202b66e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:46.375845 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167975d-34ef-46e8-ba25-3bd4c202b66e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:46.410270 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2e361-8179-47d9-919c-3e09c926fcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:46.410888 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2e361-8179-47d9-919c-3e09c926fcba None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:46.411146 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2e361-8179-47d9-919c-3e09c926fcba None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:46.411410 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2e361-8179-47d9-919c-3e09c926fcba None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:46.412142 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2e361-8179-47d9-919c-3e09c926fcba None admin] RBAC: Adding query filter params (interface=public, service_id=812608ece8e54b61bcf5689b5dfc9fb8, region_id=RegionOne) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:46.412452 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2e361-8179-47d9-919c-3e09c926fcba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:46.413924 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2e361-8179-47d9-919c-3e09c926fcba None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:46.419776 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 508/1006] 10.222.0.94 () {56 vars in 1251 bytes} [Thu Sep 1 17:14:46 2022] GET /identity/v3/endpoints?service_id=812608ece8e54b61bcf5689b5dfc9fb8&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:46.425357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ec800-4039-4609-914f-92a8fc193173 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:46.539264 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ec800-4039-4609-914f-92a8fc193173 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:46.567706 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:46.577618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6ab16-5e8d-4a7f-9e6f-c1eed4008991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:46.578262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6ab16-5e8d-4a7f-9e6f-c1eed4008991 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:46.578803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6ab16-5e8d-4a7f-9e6f-c1eed4008991 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:46.579080 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6ab16-5e8d-4a7f-9e6f-c1eed4008991 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:46.579703 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6ab16-5e8d-4a7f-9e6f-c1eed4008991 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:46.581228 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6ab16-5e8d-4a7f-9e6f-c1eed4008991 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:46.593466 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 499/1007] 10.222.0.94 () {56 vars in 1087 bytes} [Thu Sep 1 17:14:46 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:14:47.359930 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e816b-92b1-410d-9b15-639bc136e653 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:47.360215 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e816b-92b1-410d-9b15-639bc136e653 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:47.360490 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e816b-92b1-410d-9b15-639bc136e653 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:47.361872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 509/1008] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:47.367008 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3f329-fcd5-4ab4-a8a5-5c4803df719f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:47.367373 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3f329-fcd5-4ab4-a8a5-5c4803df719f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:47.367720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3f329-fcd5-4ab4-a8a5-5c4803df719f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:47.386189 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d7e3f329-fcd5-4ab4-a8a5-5c4803df719f None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:47.387408 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d7e3f329-fcd5-4ab4-a8a5-5c4803df719f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:47.404141 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de58a11-0314-4114-af07-64c2fa43480a None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:47.404414 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de58a11-0314-4114-af07-64c2fa43480a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:47.404693 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de58a11-0314-4114-af07-64c2fa43480a None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:47.406046 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 510/1009] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:14:47.410707 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59cfc9-9367-4093-b8d9-00ea1c4a3457 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:47.411276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59cfc9-9367-4093-b8d9-00ea1c4a3457 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:47.411276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59cfc9-9367-4093-b8d9-00ea1c4a3457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:47.428840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0d59cfc9-9367-4093-b8d9-00ea1c4a3457 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:47.430044 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0d59cfc9-9367-4093-b8d9-00ea1c4a3457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:47.441577 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:47.465939 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 500/1010] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:47 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:47.505034 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 511/1011] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:47 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:14:47.739073 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3f329-fcd5-4ab4-a8a5-5c4803df719f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:47.774806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59cfc9-9367-4093-b8d9-00ea1c4a3457 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:47.845511 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3f329-fcd5-4ab4-a8a5-5c4803df719f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:47.870958 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:47.881798 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59cfc9-9367-4093-b8d9-00ea1c4a3457 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:47.883557 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce479d-ca7f-429d-8c66-f3a43083bd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:47.884218 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce479d-ca7f-429d-8c66-f3a43083bd2e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:47.884514 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce479d-ca7f-429d-8c66-f3a43083bd2e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:47.884767 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce479d-ca7f-429d-8c66-f3a43083bd2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:47.885943 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce479d-ca7f-429d-8c66-f3a43083bd2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:47.887906 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce479d-ca7f-429d-8c66-f3a43083bd2e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:47.889841 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 501/1012] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:47.895186 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce479d-ca7f-429d-8c66-f3a43083bd2e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:47.925178 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70537560-d8ed-4217-ac66-387a14fba2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:47.926073 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70537560-d8ed-4217-ac66-387a14fba2c5 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:47.926511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70537560-d8ed-4217-ac66-387a14fba2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:47.926777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70537560-d8ed-4217-ac66-387a14fba2c5 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:47.927440 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70537560-d8ed-4217-ac66-387a14fba2c5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:47.928863 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70537560-d8ed-4217-ac66-387a14fba2c5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:47.945605 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 512/1013] 10.222.0.94 () {60 vars in 1141 bytes} [Thu Sep 1 17:14:47 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:14:48.004118 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce479d-ca7f-429d-8c66-f3a43083bd2e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:48.047296 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fd04e-9ce5-48d9-bcca-99727fa755d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:48.047918 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fd04e-9ce5-48d9-bcca-99727fa755d6 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:48.048195 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fd04e-9ce5-48d9-bcca-99727fa755d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:48.048462 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fd04e-9ce5-48d9-bcca-99727fa755d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:48.049163 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831fd04e-9ce5-48d9-bcca-99727fa755d6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:48.050655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831fd04e-9ce5-48d9-bcca-99727fa755d6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:48.088025 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 502/1014] 10.222.0.94 () {60 vars in 1141 bytes} [Thu Sep 1 17:14:47 2022] POST /identity/v3/projects => generated 311 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:14:48.520486 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85119cc-4761-4980-9bc6-9033468b6bdb None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:48.521011 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85119cc-4761-4980-9bc6-9033468b6bdb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:48.521011 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85119cc-4761-4980-9bc6-9033468b6bdb None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:48.522547 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 513/1015] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:48.529839 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8c1b6-204b-46ab-8985-b5541b23caf3 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:48.529839 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8c1b6-204b-46ab-8985-b5541b23caf3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:48.529839 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8c1b6-204b-46ab-8985-b5541b23caf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:48.547071 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d9c8c1b6-204b-46ab-8985-b5541b23caf3 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:48.548269 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d9c8c1b6-204b-46ab-8985-b5541b23caf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:48.584213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:48.625447 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 503/1016] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:48 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:48.890400 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85119cc-4761-4980-9bc6-9033468b6bdb None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:48.899183 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:48.994958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85119cc-4761-4980-9bc6-9033468b6bdb None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:49.030289 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da6051-065d-4d1e-b822-e70c9df380b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:49.030925 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da6051-065d-4d1e-b822-e70c9df380b0 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:49.031202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da6051-065d-4d1e-b822-e70c9df380b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:49.031473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da6051-065d-4d1e-b822-e70c9df380b0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:49.032054 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da6051-065d-4d1e-b822-e70c9df380b0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:49.033465 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da6051-065d-4d1e-b822-e70c9df380b0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:49.042260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-61da6051-065d-4d1e-b822-e70c9df380b0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 17:14:49.042260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:49.042260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:14:49.042260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:14:49.042260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:14:49.042260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:14:49.042260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:14:49.042260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:49.042260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 17:14:49.042260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:49.042260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:14:49.042260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:49.042260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:49.042260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:49.042260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:49.042260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:49.042260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:49.043237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:49.043237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:49.043237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:49.043237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:49.043237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:49.043237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:49.043237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:14:49.043237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:14:49.043237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:14:49.043237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:14:49.043237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:49.043237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:49.043237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:49.043237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:49.043237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:49.043237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:49.044311 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:49.044311 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:49.044311 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:49.044311 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:49.044311 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:49.044311 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:49.044311 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:49.044311 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:49.044311 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:49.044311 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:49.044311 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:14:49.044311 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:49.044311 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 17:14:49.044311 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:49.044311 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 514/1017] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:14:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:49.051088 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8c1b6-204b-46ab-8985-b5541b23caf3 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:49.151509 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8c1b6-204b-46ab-8985-b5541b23caf3 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:49.185362 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89157124-0772-4509-8371-ea59cb3b2518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:49.186000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89157124-0772-4509-8371-ea59cb3b2518 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:49.186281 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89157124-0772-4509-8371-ea59cb3b2518 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:49.186551 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89157124-0772-4509-8371-ea59cb3b2518 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:49.187175 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89157124-0772-4509-8371-ea59cb3b2518 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:49.187476 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89157124-0772-4509-8371-ea59cb3b2518 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:49.188829 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89157124-0772-4509-8371-ea59cb3b2518 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:49.193828 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 504/1018] 10.222.0.94 () {56 vars in 1112 bytes} [Thu Sep 1 17:14:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:49.199261 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da6051-065d-4d1e-b822-e70c9df380b0 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:49.271402 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:49.303589 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da6051-065d-4d1e-b822-e70c9df380b0 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:49.337651 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f916830-5a26-4497-90dd-f1330e25bb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:49.338260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f916830-5a26-4497-90dd-f1330e25bb2a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:49.338536 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f916830-5a26-4497-90dd-f1330e25bb2a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:49.338805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f916830-5a26-4497-90dd-f1330e25bb2a None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:49.339430 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f916830-5a26-4497-90dd-f1330e25bb2a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:49.339729 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f916830-5a26-4497-90dd-f1330e25bb2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:49.341144 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f916830-5a26-4497-90dd-f1330e25bb2a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:49.346042 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 515/1019] 10.222.0.94 () {56 vars in 1112 bytes} [Thu Sep 1 17:14:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:49.351648 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89157124-0772-4509-8371-ea59cb3b2518 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:49.383305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:49.451895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89157124-0772-4509-8371-ea59cb3b2518 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:49.485691 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d657c-31b9-4cfd-a2ec-a8c87f507541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:49.486300 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d657c-31b9-4cfd-a2ec-a8c87f507541 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:49.486571 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d657c-31b9-4cfd-a2ec-a8c87f507541 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:49.486845 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d657c-31b9-4cfd-a2ec-a8c87f507541 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:49.487516 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d657c-31b9-4cfd-a2ec-a8c87f507541 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:49.488870 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d657c-31b9-4cfd-a2ec-a8c87f507541 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:49.509157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 505/1020] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:14:49 2022] POST /identity/v3/endpoints => generated 334 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:14:49.928595 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717f710-77a1-4683-afbb-7948ec769c5c None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:49.929121 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717f710-77a1-4683-afbb-7948ec769c5c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:49.929121 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717f710-77a1-4683-afbb-7948ec769c5c None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:49.930674 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 516/1021] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:49.935550 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd13c5-76ba-432a-8e2c-30248ec16690 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:49.935835 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd13c5-76ba-432a-8e2c-30248ec16690 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:49.936106 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd13c5-76ba-432a-8e2c-30248ec16690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:49.954934 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-32bd13c5-76ba-432a-8e2c-30248ec16690 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:49.956120 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-32bd13c5-76ba-432a-8e2c-30248ec16690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:50.031529 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 506/1022] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:50.057687 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475e26a-9b5f-4fdb-a7c0-8c38c09fda12 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:50.057994 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475e26a-9b5f-4fdb-a7c0-8c38c09fda12 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:50.058246 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475e26a-9b5f-4fdb-a7c0-8c38c09fda12 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:50.059774 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 517/1023] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:50.064727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66e2c3-aaee-43b0-8281-180f88db4627 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:50.065170 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66e2c3-aaee-43b0-8281-180f88db4627 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:50.065263 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66e2c3-aaee-43b0-8281-180f88db4627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:50.083963 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6a66e2c3-aaee-43b0-8281-180f88db4627 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:50.085143 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6a66e2c3-aaee-43b0-8281-180f88db4627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:50.095165 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:50.156840 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 507/1024] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:50.297478 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475e26a-9b5f-4fdb-a7c0-8c38c09fda12 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:50.397390 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475e26a-9b5f-4fdb-a7c0-8c38c09fda12 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:50.427740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66e2c3-aaee-43b0-8281-180f88db4627 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:50.430947 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35336331-bfe6-4a38-aef4-40a84b4b44ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:50.431575 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35336331-bfe6-4a38-aef4-40a84b4b44ae None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:50.431852 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35336331-bfe6-4a38-aef4-40a84b4b44ae None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:50.432123 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35336331-bfe6-4a38-aef4-40a84b4b44ae None admin] PATH_INFO: `/v3/services/image` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:50.432702 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35336331-bfe6-4a38-aef4-40a84b4b44ae None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:50.434108 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35336331-bfe6-4a38-aef4-40a84b4b44ae None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:50.443054 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-35336331-bfe6-4a38-aef4-40a84b4b44ae None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 17:14:50.443054 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:50.443054 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:14:50.443054 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:14:50.443054 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:14:50.443054 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:14:50.443054 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:14:50.443054 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:50.443054 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 17:14:50.443054 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:50.443054 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:14:50.443054 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:50.443054 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:50.443054 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:50.443054 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:50.443054 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:50.443054 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:50.444398 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:50.444398 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:50.444398 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:50.444398 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:50.444398 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:50.444398 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:50.444398 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:14:50.444398 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:14:50.444398 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:14:50.444398 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:14:50.444398 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:50.444398 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:50.444398 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:50.444398 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:50.444398 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:50.444398 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:50.445445 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:50.445445 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:50.445445 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:50.445445 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:50.445445 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:50.445445 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:50.445445 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:50.445445 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:50.445445 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:50.445445 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:50.445445 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:14:50.445445 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:50.445445 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 17:14:50.445445 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:50.445445 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 518/1025] 10.222.0.94 () {56 vars in 1105 bytes} [Thu Sep 1 17:14:50 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:50.446302 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:50.450416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35336331-bfe6-4a38-aef4-40a84b4b44ae None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:50.538248 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66e2c3-aaee-43b0-8281-180f88db4627 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:50.561754 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35336331-bfe6-4a38-aef4-40a84b4b44ae None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:50.573382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95154b36-5c1c-4aae-93ac-54b8dfbed15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:50.574038 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95154b36-5c1c-4aae-93ac-54b8dfbed15b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:50.574318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95154b36-5c1c-4aae-93ac-54b8dfbed15b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:50.574592 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95154b36-5c1c-4aae-93ac-54b8dfbed15b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:50.576531 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95154b36-5c1c-4aae-93ac-54b8dfbed15b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:50.578662 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95154b36-5c1c-4aae-93ac-54b8dfbed15b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:50.581439 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 508/1026] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:50.586884 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95154b36-5c1c-4aae-93ac-54b8dfbed15b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:50.599764 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae911f0-076f-4bc5-822c-77f66932bc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:50.600374 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae911f0-076f-4bc5-822c-77f66932bc3a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:50.600697 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae911f0-076f-4bc5-822c-77f66932bc3a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:50.600968 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae911f0-076f-4bc5-822c-77f66932bc3a None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:50.601638 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae911f0-076f-4bc5-822c-77f66932bc3a None admin] RBAC: Adding query filter params (name=image) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:50.602373 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae911f0-076f-4bc5-822c-77f66932bc3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:50.602483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:50.603346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae911f0-076f-4bc5-822c-77f66932bc3a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:50.609667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 519/1027] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:50.615034 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae911f0-076f-4bc5-822c-77f66932bc3a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:50.679145 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:50.706788 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95154b36-5c1c-4aae-93ac-54b8dfbed15b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:50.721860 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae911f0-076f-4bc5-822c-77f66932bc3a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:50.743373 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690f017-b7c8-4c6b-9c46-25343955d89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:50.744095 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690f017-b7c8-4c6b-9c46-25343955d89e None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:50.744376 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690f017-b7c8-4c6b-9c46-25343955d89e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:50.744762 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690f017-b7c8-4c6b-9c46-25343955d89e None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:50.745424 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690f017-b7c8-4c6b-9c46-25343955d89e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:50.747040 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690f017-b7c8-4c6b-9c46-25343955d89e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:50.758506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e26649-6ff5-451c-bdc4-29f6e1c8ddcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:50.759123 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e26649-6ff5-451c-bdc4-29f6e1c8ddcc None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:50.759403 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e26649-6ff5-451c-bdc4-29f6e1c8ddcc None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:50.759700 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e26649-6ff5-451c-bdc4-29f6e1c8ddcc None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:50.760310 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e26649-6ff5-451c-bdc4-29f6e1c8ddcc None admin] RBAC: Adding query filter params (type=image) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:50.760618 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e26649-6ff5-451c-bdc4-29f6e1c8ddcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:50.762088 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e26649-6ff5-451c-bdc4-29f6e1c8ddcc None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:50.767996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 520/1028] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:50 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:50.773780 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e26649-6ff5-451c-bdc4-29f6e1c8ddcc None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:50.785807 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 509/1029] 10.222.0.94 () {60 vars in 1132 bytes} [Thu Sep 1 17:14:50 2022] POST /identity/v3/users => generated 285 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:14:50.881240 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e26649-6ff5-451c-bdc4-29f6e1c8ddcc None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:50.907830 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:50.918334 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e370a-305e-4add-ac2b-58addfe16d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:50.919475 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e370a-305e-4add-ac2b-58addfe16d30 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:50.919789 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e370a-305e-4add-ac2b-58addfe16d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:50.920085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e370a-305e-4add-ac2b-58addfe16d30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:50.920760 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e370a-305e-4add-ac2b-58addfe16d30 None admin] RBAC: Adding query filter params (interface=public, service_id=a9e27925eaec45c3a05edd596bacbe89, region_id=RegionOne) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:50.921058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e370a-305e-4add-ac2b-58addfe16d30 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:50.922646 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e370a-305e-4add-ac2b-58addfe16d30 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:50.927790 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 521/1030] 10.222.0.94 () {56 vars in 1251 bytes} [Thu Sep 1 17:14:50 2022] GET /identity/v3/endpoints?service_id=a9e27925eaec45c3a05edd596bacbe89&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:50.933622 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690f017-b7c8-4c6b-9c46-25343955d89e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:51.006699 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:51.043126 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690f017-b7c8-4c6b-9c46-25343955d89e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:51.079485 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6cd0d-d6bb-4fd8-b1d2-290e3bd21c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:51.080117 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6cd0d-d6bb-4fd8-b1d2-290e3bd21c42 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:51.080378 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6cd0d-d6bb-4fd8-b1d2-290e3bd21c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:51.080625 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6cd0d-d6bb-4fd8-b1d2-290e3bd21c42 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:51.081228 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6cd0d-d6bb-4fd8-b1d2-290e3bd21c42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:51.082617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6cd0d-d6bb-4fd8-b1d2-290e3bd21c42 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:51.095171 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 510/1031] 10.222.0.94 () {56 vars in 1087 bytes} [Thu Sep 1 17:14:50 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:14:51.532874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001bfab-b89e-43d9-823b-638afffc11ca None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:51.533436 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001bfab-b89e-43d9-823b-638afffc11ca None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:51.533436 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001bfab-b89e-43d9-823b-638afffc11ca None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:51.534935 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 522/1032] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:51.540146 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac429be-d1d3-45e6-9c01-0084331f6689 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:51.540433 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac429be-d1d3-45e6-9c01-0084331f6689 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:51.540702 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac429be-d1d3-45e6-9c01-0084331f6689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:51.558911 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-dac429be-d1d3-45e6-9c01-0084331f6689 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:51.560641 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dac429be-d1d3-45e6-9c01-0084331f6689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:51.628398 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 511/1033] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:51.892507 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001bfab-b89e-43d9-823b-638afffc11ca None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:51.995715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001bfab-b89e-43d9-823b-638afffc11ca None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:52.028867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b440b00-6edb-44e5-ae6a-80c1c2cdb3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:52.029515 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b440b00-6edb-44e5-ae6a-80c1c2cdb3d6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:52.029791 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b440b00-6edb-44e5-ae6a-80c1c2cdb3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:52.030055 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b440b00-6edb-44e5-ae6a-80c1c2cdb3d6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:52.040408 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b440b00-6edb-44e5-ae6a-80c1c2cdb3d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:14:52.045213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-3b440b00-6edb-44e5-ae6a-80c1c2cdb3d6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 17:14:52.045213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:52.045213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:52.045213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:52.045213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:52.045213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:52.045213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:52.045213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:52.045213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:52.045213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:52.045213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:52.045213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:52.045213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:14:52.045213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:14:52.045213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:14:52.045213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:14:52.046163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:14:52.046163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:14:52.046163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:14:52.046163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:14:52.046163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:52.046163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:52.046163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:52.046163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:52.046163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:52.046163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:52.046163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:52.046163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:52.046163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:52.046163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:52.046163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:52.046163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:52.047071 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:52.047071 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:52.047071 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:52.047071 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:52.047071 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:14:52.047071 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:14:52.047071 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:14:52.047071 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:14:52.047071 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:14:52.047071 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:14:52.047071 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 17:14:52.047071 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:52.049779 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 523/1034] 10.222.0.94 () {56 vars in 1120 bytes} [Thu Sep 1 17:14:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:14:52.052187 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac429be-d1d3-45e6-9c01-0084331f6689 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:52.116350 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:52.158495 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac429be-d1d3-45e6-9c01-0084331f6689 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:52.194028 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae553ac0-795f-45fd-978f-3a96793280d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:52.194638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae553ac0-795f-45fd-978f-3a96793280d2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:52.194913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae553ac0-795f-45fd-978f-3a96793280d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:52.195180 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae553ac0-795f-45fd-978f-3a96793280d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:52.195834 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae553ac0-795f-45fd-978f-3a96793280d2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:52.196131 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae553ac0-795f-45fd-978f-3a96793280d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:52.197620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae553ac0-795f-45fd-978f-3a96793280d2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:52.209480 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 512/1035] 10.222.0.94 () {56 vars in 1115 bytes} [Thu Sep 1 17:14:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:52.212069 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b440b00-6edb-44e5-ae6a-80c1c2cdb3d6 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:52.261296 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:52.312032 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b440b00-6edb-44e5-ae6a-80c1c2cdb3d6 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:52.345845 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7e657-3f48-46f3-8902-4b4209f7e834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:52.346465 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7e657-3f48-46f3-8902-4b4209f7e834 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:52.346737 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7e657-3f48-46f3-8902-4b4209f7e834 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:52.347000 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7e657-3f48-46f3-8902-4b4209f7e834 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:52.357241 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7e657-3f48-46f3-8902-4b4209f7e834 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:52.358696 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7e657-3f48-46f3-8902-4b4209f7e834 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:52.372562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-8cf7e657-3f48-46f3-8902-4b4209f7e834 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:52.372562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:52.372562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:52.372562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:52.372562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:52.372562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:52.372562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:52.372562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:52.372562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:52.372562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:52.372562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:52.372562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:52.372562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:52.372562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:52.372562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:52.372562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:52.373806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:52.373806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:52.373806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:52.373806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:52.373806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:52.373806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:52.373806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:52.373806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:52.373806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:52.373806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:52.373806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:52.373806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:52.373806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:52.373806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:52.373806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:52.373806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:52.373806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:52.374760 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:52.374760 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:52.374760 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:52.375338 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 524/1036] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:52.379477 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae553ac0-795f-45fd-978f-3a96793280d2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:52.482887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae553ac0-795f-45fd-978f-3a96793280d2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:52.506326 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:52.518371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c4a0a-e37c-4666-be1c-31510c6dd97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:52.518981 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c4a0a-e37c-4666-be1c-31510c6dd97b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:52.519256 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c4a0a-e37c-4666-be1c-31510c6dd97b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:52.519526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c4a0a-e37c-4666-be1c-31510c6dd97b None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:52.520167 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c4a0a-e37c-4666-be1c-31510c6dd97b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:52.520467 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c4a0a-e37c-4666-be1c-31510c6dd97b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:52.521857 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c4a0a-e37c-4666-be1c-31510c6dd97b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:52.538523 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 513/1037] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:52.543910 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7e657-3f48-46f3-8902-4b4209f7e834 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:52.649242 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7e657-3f48-46f3-8902-4b4209f7e834 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:52.650801 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:52.684856 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f02d9b-7c54-4683-9474-755babd541dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:52.685506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f02d9b-7c54-4683-9474-755babd541dc None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:52.685784 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f02d9b-7c54-4683-9474-755babd541dc None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:52.686052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f02d9b-7c54-4683-9474-755babd541dc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:52.693476 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f02d9b-7c54-4683-9474-755babd541dc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:52.694907 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f02d9b-7c54-4683-9474-755babd541dc None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:52.706540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-47f02d9b-7c54-4683-9474-755babd541dc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:14:52.706540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:52.706540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:52.706540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:52.706540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:52.706540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:52.706540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:52.706540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:52.706540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:52.706540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:52.706540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:52.706540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:52.706540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:14:52.706540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:14:52.706540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:14:52.706540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:14:52.707525 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:52.707525 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:52.707525 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:14:52.707525 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:52.707525 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:14:52.707525 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:52.707525 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:52.707525 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:52.707525 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:52.707525 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:52.707525 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:52.707525 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:52.707525 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:52.707525 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:52.707525 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:52.707525 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:52.707525 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:52.707525 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:52.708491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:52.708491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:52.708491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:14:52.708491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:14:52.708491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:14:52.708491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:14:52.708491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:14:52.708491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:14:52.708491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:14:52.708491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:52.709924 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 525/1038] 10.222.0.94 () {56 vars in 1093 bytes} [Thu Sep 1 17:14:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:52.715234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c4a0a-e37c-4666-be1c-31510c6dd97b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:52.773666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52197bdf-2ff6-4455-b26f-191d033cec1a None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:52.773879 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52197bdf-2ff6-4455-b26f-191d033cec1a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:52.774156 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52197bdf-2ff6-4455-b26f-191d033cec1a None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:52.775488 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 526/1039] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:52.780268 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737c757-d39a-452d-9090-fbc3c75975c8 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:52.780552 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737c757-d39a-452d-9090-fbc3c75975c8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:52.780827 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737c757-d39a-452d-9090-fbc3c75975c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:52.800853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f737c757-d39a-452d-9090-fbc3c75975c8 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:52.802061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f737c757-d39a-452d-9090-fbc3c75975c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:52.824319 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c4a0a-e37c-4666-be1c-31510c6dd97b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:52.860798 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937aaac-dadc-4eb2-970c-b3fac713ebf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:52.861422 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937aaac-dadc-4eb2-970c-b3fac713ebf6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:52.861720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937aaac-dadc-4eb2-970c-b3fac713ebf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:52.861997 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937aaac-dadc-4eb2-970c-b3fac713ebf6 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:52.862717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6937aaac-dadc-4eb2-970c-b3fac713ebf6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:52.863023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6937aaac-dadc-4eb2-970c-b3fac713ebf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:52.864446 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6937aaac-dadc-4eb2-970c-b3fac713ebf6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:52.872769 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 527/1040] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:52 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:14:52.882277 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 514/1041] 10.222.0.94 () {56 vars in 1133 bytes} [Thu Sep 1 17:14:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:52.888372 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737c757-d39a-452d-9090-fbc3c75975c8 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:52.987230 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:52.997079 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737c757-d39a-452d-9090-fbc3c75975c8 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:53.031522 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e2970-f0d6-4e17-868d-4c6131be18ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:53.032053 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e2970-f0d6-4e17-868d-4c6131be18ad None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:53.032328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e2970-f0d6-4e17-868d-4c6131be18ad None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:53.032595 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e2970-f0d6-4e17-868d-4c6131be18ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:53.083882 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a657c-0a9b-42d6-99a6-8e40b793caab None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:53.084216 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a657c-0a9b-42d6-99a6-8e40b793caab None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:53.084441 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a657c-0a9b-42d6-99a6-8e40b793caab None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:53.085937 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 515/1042] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:14:53.091162 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715c958-5c48-4eee-9793-8bca5603c51e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:53.091442 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715c958-5c48-4eee-9793-8bca5603c51e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:53.091716 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715c958-5c48-4eee-9793-8bca5603c51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:53.100996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e2970-f0d6-4e17-868d-4c6131be18ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:53.102480 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e2970-f0d6-4e17-868d-4c6131be18ad None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:53.109364 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2715c958-5c48-4eee-9793-8bca5603c51e None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:53.110595 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2715c958-5c48-4eee-9793-8bca5603c51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:53.146960 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:53.179416 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 516/1043] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:14:53.180134 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715c958-5c48-4eee-9793-8bca5603c51e None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:53.198795 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:53.209785 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 528/1044] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:14:52 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 17:14:53.215339 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e2970-f0d6-4e17-868d-4c6131be18ad None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:53.285121 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715c958-5c48-4eee-9793-8bca5603c51e None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:53.317959 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e2970-f0d6-4e17-868d-4c6131be18ad None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:53.320249 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da8a3d-73a8-42eb-a511-767ad0c81a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:53.320878 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da8a3d-73a8-42eb-a511-767ad0c81a9a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:53.321155 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da8a3d-73a8-42eb-a511-767ad0c81a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:53.321441 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da8a3d-73a8-42eb-a511-767ad0c81a9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:53.336455 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da8a3d-73a8-42eb-a511-767ad0c81a9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:14:53.341453 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-d4da8a3d-73a8-42eb-a511-767ad0c81a9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:14:53.341453 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:53.341453 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:53.341453 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:53.341453 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:53.341453 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:53.341453 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:53.341453 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:53.341453 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:53.341453 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:53.341453 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:53.341453 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:53.341453 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:14:53.341453 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:14:53.341453 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:14:53.341453 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:14:53.342471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:14:53.342471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:14:53.342471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:14:53.342471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:14:53.342471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:53.342471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:53.342471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:53.342471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:53.342471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:53.342471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:53.342471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:53.342471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:53.342471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:53.342471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:53.342471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:53.342471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:53.343385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:53.343385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:53.343385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:53.343385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:53.343385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:14:53.343385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:14:53.343385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:14:53.343385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:14:53.343385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:14:53.343385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:14:53.343385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:14:53.343385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:53.343385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 517/1045] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:14:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:53.348858 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da8a3d-73a8-42eb-a511-767ad0c81a9a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:53.356990 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6a5b7-0f1c-4771-8268-66b96650acf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:53.357664 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6a5b7-0f1c-4771-8268-66b96650acf4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:53.357945 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6a5b7-0f1c-4771-8268-66b96650acf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:53.358211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6a5b7-0f1c-4771-8268-66b96650acf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:53.368622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6a5b7-0f1c-4771-8268-66b96650acf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:53.370152 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6a5b7-0f1c-4771-8268-66b96650acf4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:53.382381 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:53.385613 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-48a6a5b7-0f1c-4771-8268-66b96650acf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:53.385613 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:53.385613 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:53.385613 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:53.385613 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:53.385613 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:53.385613 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:53.385613 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:53.385613 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:53.385613 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:53.385613 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:53.385613 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:53.385613 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:53.385613 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:53.385613 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:53.385613 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:53.386615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:53.386615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:53.386615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:53.386615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:53.386615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:53.386615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:53.386615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:53.386615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:53.386615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:53.386615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:53.386615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:53.386615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:53.386615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:53.386615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:53.386615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:53.386615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:53.386615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:53.387570 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:53.387570 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:53.387570 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:53.392004 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 529/1046] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:14:53.392847 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6a5b7-0f1c-4771-8268-66b96650acf4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:53.437709 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:53.462304 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da8a3d-73a8-42eb-a511-767ad0c81a9a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:53.495979 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02827b5e-21e8-4794-a1bf-b28dd8293c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:53.496318 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6a5b7-0f1c-4771-8268-66b96650acf4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:53.497104 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02827b5e-21e8-4794-a1bf-b28dd8293c98 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:53.497379 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02827b5e-21e8-4794-a1bf-b28dd8293c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:53.497672 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02827b5e-21e8-4794-a1bf-b28dd8293c98 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:53.498324 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02827b5e-21e8-4794-a1bf-b28dd8293c98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:53.498619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02827b5e-21e8-4794-a1bf-b28dd8293c98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:53.500009 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02827b5e-21e8-4794-a1bf-b28dd8293c98 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:53.507779 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 518/1047] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:14:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:53.508543 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02827b5e-21e8-4794-a1bf-b28dd8293c98 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:53.531880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08dd84-e4d6-4afc-8adb-7b23e435c5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:53.532816 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08dd84-e4d6-4afc-8adb-7b23e435c5b2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:53.533297 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08dd84-e4d6-4afc-8adb-7b23e435c5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:53.533796 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08dd84-e4d6-4afc-8adb-7b23e435c5b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:53.534695 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b08dd84-e4d6-4afc-8adb-7b23e435c5b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:53.535000 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b08dd84-e4d6-4afc-8adb-7b23e435c5b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:53.536356 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b08dd84-e4d6-4afc-8adb-7b23e435c5b2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:53.548847 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 530/1048] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:53.549766 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08dd84-e4d6-4afc-8adb-7b23e435c5b2 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:53.601237 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:53.609722 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02827b5e-21e8-4794-a1bf-b28dd8293c98 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:53.642779 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768eba6-f6eb-44b0-a823-288332c44eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:53.643400 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768eba6-f6eb-44b0-a823-288332c44eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:53.643675 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768eba6-f6eb-44b0-a823-288332c44eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:53.643950 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768eba6-f6eb-44b0-a823-288332c44eb3 None admin] PATH_INFO: `/v3/services/image` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:53.644522 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768eba6-f6eb-44b0-a823-288332c44eb3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:53.645906 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768eba6-f6eb-44b0-a823-288332c44eb3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:53.646606 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08dd84-e4d6-4afc-8adb-7b23e435c5b2 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:53.648834 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:53.654841 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-6768eba6-f6eb-44b0-a823-288332c44eb3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 17:14:53.654841 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:53.654841 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:14:53.654841 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:14:53.654841 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:14:53.654841 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:14:53.654841 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:14:53.654841 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:53.654841 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 17:14:53.654841 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:53.654841 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:14:53.654841 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:53.654841 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:53.654841 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:53.654841 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:53.654841 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:53.654841 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:53.657584 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:53.657584 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:53.657584 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:53.657584 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:53.657584 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:53.657584 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:53.657584 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:14:53.657584 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:14:53.657584 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:14:53.657584 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:14:53.657584 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:53.657584 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:53.657584 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:53.657584 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:53.657584 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:53.657584 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:53.658468 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:53.658468 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:53.658468 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:53.658468 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:53.658468 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:53.658468 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:53.658468 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:53.658468 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:53.658468 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:53.658468 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:53.658468 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:14:53.658468 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:14:53.658468 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 17:14:53.658468 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:53.658468 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 519/1049] 10.222.0.94 () {56 vars in 1105 bytes} [Thu Sep 1 17:14:53 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:53.659272 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768eba6-f6eb-44b0-a823-288332c44eb3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:53.683714 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756725dd-4e5c-4359-b5ce-8ab5f33b9a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:53.684886 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756725dd-4e5c-4359-b5ce-8ab5f33b9a83 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:53.685163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756725dd-4e5c-4359-b5ce-8ab5f33b9a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:53.685458 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756725dd-4e5c-4359-b5ce-8ab5f33b9a83 None admin] PATH_INFO: `/v3/users/dd397ef3fac84e008571b460db52b70b` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:53.698357 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756725dd-4e5c-4359-b5ce-8ab5f33b9a83 None admin] RBAC: Authorizing `identity:get_user(user_id=dd397ef3fac84e008571b460db52b70b)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:53.700186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756725dd-4e5c-4359-b5ce-8ab5f33b9a83 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:53.701930 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 531/1050] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:14:53 2022] GET /identity/v3/users/dd397ef3fac84e008571b460db52b70b => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:53.702963 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756725dd-4e5c-4359-b5ce-8ab5f33b9a83 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:53.771297 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768eba6-f6eb-44b0-a823-288332c44eb3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:53.802513 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756725dd-4e5c-4359-b5ce-8ab5f33b9a83 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:53.805128 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fcd0f-ae73-4ac7-b68f-33c00c4d1342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:53.805786 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fcd0f-ae73-4ac7-b68f-33c00c4d1342 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:53.806064 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fcd0f-ae73-4ac7-b68f-33c00c4d1342 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:53.806335 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fcd0f-ae73-4ac7-b68f-33c00c4d1342 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:53.813339 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267fcd0f-ae73-4ac7-b68f-33c00c4d1342 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:53.814874 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267fcd0f-ae73-4ac7-b68f-33c00c4d1342 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:53.825804 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-267fcd0f-ae73-4ac7-b68f-33c00c4d1342 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:53.825804 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:53.825804 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:53.825804 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:53.825804 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:53.825804 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:53.825804 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:53.825804 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:53.825804 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:53.825804 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:53.825804 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:53.825804 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:53.825804 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:14:53.825804 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:14:53.825804 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:14:53.826717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:14:53.826717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:53.826717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:53.826717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:53.826717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:53.826717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:53.826717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:53.826717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:53.826717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:53.826717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:53.826717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:53.826717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:53.826717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:53.826717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:53.826717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:53.826717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:53.826717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:53.827642 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:14:53.827642 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:14:53.827642 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:14:53.827642 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:14:53.827642 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:14:53.827642 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:14:53.827642 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:53.827642 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:53.827642 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 520/1051] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:14:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:53.828146 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fcd0f-ae73-4ac7-b68f-33c00c4d1342 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:53.840834 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a17a5-cda2-47da-8015-e446bdb06bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:53.841458 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a17a5-cda2-47da-8015-e446bdb06bbf None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:53.841735 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a17a5-cda2-47da-8015-e446bdb06bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:53.842002 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a17a5-cda2-47da-8015-e446bdb06bbf None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:53.842620 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a17a5-cda2-47da-8015-e446bdb06bbf None admin] RBAC: Adding query filter params (name=image) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:53.842919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a17a5-cda2-47da-8015-e446bdb06bbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:53.844261 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a17a5-cda2-47da-8015-e446bdb06bbf None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:53.846285 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:53.849140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 532/1052] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:53.849993 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a17a5-cda2-47da-8015-e446bdb06bbf None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:53.880646 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:53.926861 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fcd0f-ae73-4ac7-b68f-33c00c4d1342 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:53.952378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a17a5-cda2-47da-8015-e446bdb06bbf None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:53.959800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ea396-6ecf-4f3b-92e3-a02d4aa9a821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:53.960402 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ea396-6ecf-4f3b-92e3-a02d4aa9a821 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:53.960682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ea396-6ecf-4f3b-92e3-a02d4aa9a821 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:53.960954 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ea396-6ecf-4f3b-92e3-a02d4aa9a821 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:53.986411 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ef8a7-4082-4ac4-9c8f-f8d674111311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:53.987015 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ef8a7-4082-4ac4-9c8f-f8d674111311 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:53.987284 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ef8a7-4082-4ac4-9c8f-f8d674111311 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:53.987550 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ef8a7-4082-4ac4-9c8f-f8d674111311 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:53.988235 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ef8a7-4082-4ac4-9c8f-f8d674111311 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:53.988534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ef8a7-4082-4ac4-9c8f-f8d674111311 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:53.989997 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ef8a7-4082-4ac4-9c8f-f8d674111311 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:54.001746 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 533/1053] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:14:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:54.002524 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ef8a7-4082-4ac4-9c8f-f8d674111311 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:54.030244 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ea396-6ecf-4f3b-92e3-a02d4aa9a821 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:54.031674 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ea396-6ecf-4f3b-92e3-a02d4aa9a821 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:54.049059 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:54.089833 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:54.105196 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ef8a7-4082-4ac4-9c8f-f8d674111311 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:54.129266 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 521/1054] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:14:53 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 17:14:54.130123 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ea396-6ecf-4f3b-92e3-a02d4aa9a821 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:54.138353 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d970a87-42d8-40a7-bfc0-33ffdb4f22c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:54.138960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d970a87-42d8-40a7-bfc0-33ffdb4f22c8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:54.139239 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d970a87-42d8-40a7-bfc0-33ffdb4f22c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:54.139509 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d970a87-42d8-40a7-bfc0-33ffdb4f22c8 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:54.140143 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d970a87-42d8-40a7-bfc0-33ffdb4f22c8 None admin] RBAC: Adding query filter params (type=image) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:54.140448 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d970a87-42d8-40a7-bfc0-33ffdb4f22c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:54.141849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d970a87-42d8-40a7-bfc0-33ffdb4f22c8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:54.151051 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 534/1055] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:54.151051 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d970a87-42d8-40a7-bfc0-33ffdb4f22c8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:54.229583 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ea396-6ecf-4f3b-92e3-a02d4aa9a821 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:54.247420 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:54.248145 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d970a87-42d8-40a7-bfc0-33ffdb4f22c8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:54.265172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8eb85-f544-482b-8fc3-94c472d48a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:54.265805 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8eb85-f544-482b-8fc3-94c472d48a6b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:54.266084 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8eb85-f544-482b-8fc3-94c472d48a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:54.266352 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8eb85-f544-482b-8fc3-94c472d48a6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:54.267101 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8eb85-f544-482b-8fc3-94c472d48a6b None admin] RBAC: Adding query filter params (role.id=9990ea7faa184ffb88d6994ef7e3eba1, scope.project.id=c8f9428f37354c82ac52b6b8eccc424a, user.id=8b7fa3c4c5d94b3c9b7f17dde35d39a0) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:54.267367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8eb85-f544-482b-8fc3-94c472d48a6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:54.268776 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8eb85-f544-482b-8fc3-94c472d48a6b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:54.274188 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 522/1056] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:14:54 2022] GET /identity/v3/role_assignments?user.id=8b7fa3c4c5d94b3c9b7f17dde35d39a0&scope.project.id=c8f9428f37354c82ac52b6b8eccc424a&role.id=9990ea7faa184ffb88d6994ef7e3eba1 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:54.281864 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027216f-6550-4ff2-a189-32ada4b6fe3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:54.282518 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027216f-6550-4ff2-a189-32ada4b6fe3d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:54.282796 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027216f-6550-4ff2-a189-32ada4b6fe3d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:54.283041 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8eb85-f544-482b-8fc3-94c472d48a6b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:54.283179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027216f-6550-4ff2-a189-32ada4b6fe3d None admin] PATH_INFO: `/v3/projects/1abdc670121348f5b4b4cd2bf2ddbe73` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:54.284213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027216f-6550-4ff2-a189-32ada4b6fe3d None admin] RBAC: Authorizing `identity:get_project(project_id=1abdc670121348f5b4b4cd2bf2ddbe73)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:54.285745 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027216f-6550-4ff2-a189-32ada4b6fe3d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:54.287654 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 535/1057] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:14:54 2022] GET /identity/v3/projects/1abdc670121348f5b4b4cd2bf2ddbe73 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:54.293555 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027216f-6550-4ff2-a189-32ada4b6fe3d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:54.315432 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:54.399812 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8eb85-f544-482b-8fc3-94c472d48a6b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:54.406168 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027216f-6550-4ff2-a189-32ada4b6fe3d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:54.442739 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff572a6-bd45-42b6-8c8f-d267e5114617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:54.443606 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff572a6-bd45-42b6-8c8f-d267e5114617 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:54.444039 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff572a6-bd45-42b6-8c8f-d267e5114617 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:54.444483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff572a6-bd45-42b6-8c8f-d267e5114617 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:54.445298 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff572a6-bd45-42b6-8c8f-d267e5114617 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:54.446874 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff572a6-bd45-42b6-8c8f-d267e5114617 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:54.447097 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f93222-3603-47aa-8023-0bebfa60b182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:54.447702 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f93222-3603-47aa-8023-0bebfa60b182 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:54.447978 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f93222-3603-47aa-8023-0bebfa60b182 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:54.448250 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f93222-3603-47aa-8023-0bebfa60b182 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:54.448967 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f93222-3603-47aa-8023-0bebfa60b182 None admin] RBAC: Adding query filter params (role.id=70f911a75b7b40a19f65857b9d19cfad, scope.project.id=1abdc670121348f5b4b4cd2bf2ddbe73, user.id=dd397ef3fac84e008571b460db52b70b) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:54.449271 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f93222-3603-47aa-8023-0bebfa60b182 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:54.450749 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f93222-3603-47aa-8023-0bebfa60b182 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:54.456447 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 536/1058] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:14:54 2022] GET /identity/v3/role_assignments?user.id=dd397ef3fac84e008571b460db52b70b&scope.project.id=1abdc670121348f5b4b4cd2bf2ddbe73&role.id=70f911a75b7b40a19f65857b9d19cfad => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:54.470072 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 523/1059] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:14:54 2022] POST /identity/v3/endpoints => generated 327 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:14:56.175763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534960c-aa9c-445e-ad12-ed2a2892506f None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:56.176324 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534960c-aa9c-445e-ad12-ed2a2892506f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:56.176324 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534960c-aa9c-445e-ad12-ed2a2892506f None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:56.177690 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 537/1060] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:56.182831 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a0355-0f21-422b-8e0e-d9b5d131208a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:56.183248 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a0355-0f21-422b-8e0e-d9b5d131208a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:56.183413 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a0355-0f21-422b-8e0e-d9b5d131208a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:56.201845 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-916a0355-0f21-422b-8e0e-d9b5d131208a None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:56.203018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-916a0355-0f21-422b-8e0e-d9b5d131208a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:56.233890 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:56.280446 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 524/1061] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:56.377688 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43d8e6-d408-4180-959a-2a753b6a142b None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:56.378038 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43d8e6-d408-4180-959a-2a753b6a142b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:56.378234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43d8e6-d408-4180-959a-2a753b6a142b None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:56.379884 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 538/1062] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:56.384828 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e7ab8-c7e4-4400-b9da-aad5d04be840 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:56.385115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e7ab8-c7e4-4400-b9da-aad5d04be840 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:56.385394 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e7ab8-c7e4-4400-b9da-aad5d04be840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:56.396593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9ae95-f1b2-43b1-a52a-3b4f6b061a63 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:56.396872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9ae95-f1b2-43b1-a52a-3b4f6b061a63 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:56.397144 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9ae95-f1b2-43b1-a52a-3b4f6b061a63 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:56.398723 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 539/1063] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:14:56.403883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb111a9d-b4f8-4779-98fc-cd200551f611 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:56.404166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb111a9d-b4f8-4779-98fc-cd200551f611 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:56.404469 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb111a9d-b4f8-4779-98fc-cd200551f611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:56.404567 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-233e7ab8-c7e4-4400-b9da-aad5d04be840 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:56.405678 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-233e7ab8-c7e4-4400-b9da-aad5d04be840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:56.422368 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-bb111a9d-b4f8-4779-98fc-cd200551f611 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:56.423538 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bb111a9d-b4f8-4779-98fc-cd200551f611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:56.488480 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 525/1064] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:14:56.494121 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 540/1065] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:14:56.555419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e7ab8-c7e4-4400-b9da-aad5d04be840 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:56.649040 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:56.657568 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e7ab8-c7e4-4400-b9da-aad5d04be840 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:56.691127 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8d142-ae92-49d4-9e9c-69da109fe995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:56.691744 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8d142-ae92-49d4-9e9c-69da109fe995 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:56.692019 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8d142-ae92-49d4-9e9c-69da109fe995 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:56.692286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8d142-ae92-49d4-9e9c-69da109fe995 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:56.702911 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8d142-ae92-49d4-9e9c-69da109fe995 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:14:56.707877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-84c8d142-ae92-49d4-9e9c-69da109fe995 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 17:14:56.707877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:56.707877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:56.707877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:56.707877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:56.707877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:56.707877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:56.707877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:56.707877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:56.707877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:56.707877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:56.707877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:56.707877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:14:56.707877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:14:56.707877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:14:56.707877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:14:56.708823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:14:56.708823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:14:56.708823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:14:56.708823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:14:56.708823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:56.708823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:56.708823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:56.708823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:56.708823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:56.708823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:56.708823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:56.708823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:56.708823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:56.708823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:56.708823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:56.708823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:56.714769 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:56.714769 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:56.714769 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:56.714769 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:56.714769 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:14:56.714769 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:14:56.714769 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:14:56.714769 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:14:56.714769 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:14:56.714769 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:14:56.714769 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 17:14:56.714769 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:56.714769 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 526/1066] 10.222.0.94 () {56 vars in 1120 bytes} [Thu Sep 1 17:14:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:56.716087 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb111a9d-b4f8-4779-98fc-cd200551f611 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:56.729761 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:56.760869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8d142-ae92-49d4-9e9c-69da109fe995 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:56.816049 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb111a9d-b4f8-4779-98fc-cd200551f611 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:56.848652 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d062ff-8028-4936-ac93-67a2b64ba8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:56.849268 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d062ff-8028-4936-ac93-67a2b64ba8c0 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:56.849586 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d062ff-8028-4936-ac93-67a2b64ba8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:56.849865 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d062ff-8028-4936-ac93-67a2b64ba8c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:56.850698 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d062ff-8028-4936-ac93-67a2b64ba8c0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:56.851111 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d062ff-8028-4936-ac93-67a2b64ba8c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:56.852598 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d062ff-8028-4936-ac93-67a2b64ba8c0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:56.861429 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 541/1067] 10.222.0.94 () {56 vars in 1115 bytes} [Thu Sep 1 17:14:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:14:56.862218 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d062ff-8028-4936-ac93-67a2b64ba8c0 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:56.863250 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8d142-ae92-49d4-9e9c-69da109fe995 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:56.906146 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66db6f-19b7-402f-b760-c660890f9abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:56.906983 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66db6f-19b7-402f-b760-c660890f9abd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:56.907290 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66db6f-19b7-402f-b760-c660890f9abd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:56.907555 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66db6f-19b7-402f-b760-c660890f9abd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:56.920136 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66db6f-19b7-402f-b760-c660890f9abd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:14:56.924979 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-7f66db6f-19b7-402f-b760-c660890f9abd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:14:56.924979 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:56.924979 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:56.924979 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:56.924979 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:56.924979 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:56.924979 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:56.924979 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:56.924979 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:56.924979 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:56.924979 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:56.924979 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:56.924979 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:14:56.924979 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:14:56.924979 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:14:56.924979 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:14:56.926137 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:14:56.926137 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:14:56.926137 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:14:56.926137 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:14:56.926137 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:56.926137 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:56.926137 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:56.926137 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:56.926137 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:56.926137 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:56.926137 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:56.926137 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:56.926137 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:56.926137 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:56.926137 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:56.926137 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:56.927677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:56.927677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:56.927677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:56.927677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:56.927677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:14:56.927677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:14:56.927677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:14:56.927677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:14:56.927677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:14:56.927677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:14:56.927677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:14:56.927677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:56.927677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 527/1068] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:14:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:14:56.927677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66db6f-19b7-402f-b760-c660890f9abd None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:56.943895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:56.948275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:56.974118 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d062ff-8028-4936-ac93-67a2b64ba8c0 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:57.007020 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb00ab-77e4-4e9f-a2e0-57d031abd403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:57.007620 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb00ab-77e4-4e9f-a2e0-57d031abd403 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:57.007899 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb00ab-77e4-4e9f-a2e0-57d031abd403 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:57.008165 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb00ab-77e4-4e9f-a2e0-57d031abd403 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:57.029835 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66db6f-19b7-402f-b760-c660890f9abd None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:57.062885 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93064f-d736-4450-93ee-234d87ee56a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:57.063505 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93064f-d736-4450-93ee-234d87ee56a0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:57.063777 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93064f-d736-4450-93ee-234d87ee56a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:57.064050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93064f-d736-4450-93ee-234d87ee56a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:57.073589 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93064f-d736-4450-93ee-234d87ee56a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:57.075572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93064f-d736-4450-93ee-234d87ee56a0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:57.076223 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb00ab-77e4-4e9f-a2e0-57d031abd403 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:57.077688 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb00ab-77e4-4e9f-a2e0-57d031abd403 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:57.091234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-2e93064f-d736-4450-93ee-234d87ee56a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:57.091234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:57.091234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:57.091234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:57.091234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:57.091234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:57.091234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:57.091234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:57.091234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:57.091234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:57.091234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:57.091234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:57.091234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:57.091234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:57.091234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:57.091234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:57.092247 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:57.092247 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:57.092247 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:57.092247 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:57.092247 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:57.092247 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:57.092247 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:57.092247 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:57.092247 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:57.092247 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:57.092247 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:57.092247 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:57.092247 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:57.092247 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:57.092247 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:57.092247 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:57.092247 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:57.093240 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:57.093240 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:57.093240 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:57.093240 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 528/1069] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:57.093240 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93064f-d736-4450-93ee-234d87ee56a0 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:57.157416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:57.158635 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:57.183706 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 542/1070] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:14:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 17:14:57.185184 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb00ab-77e4-4e9f-a2e0-57d031abd403 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:57.194939 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93064f-d736-4450-93ee-234d87ee56a0 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:57.227767 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401ac83-b444-4dcb-b365-c02ed85180ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:57.228359 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401ac83-b444-4dcb-b365-c02ed85180ac None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:57.228631 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401ac83-b444-4dcb-b365-c02ed85180ac None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:57.228896 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401ac83-b444-4dcb-b365-c02ed85180ac None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:57.229577 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401ac83-b444-4dcb-b365-c02ed85180ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:57.229881 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401ac83-b444-4dcb-b365-c02ed85180ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:57.231294 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401ac83-b444-4dcb-b365-c02ed85180ac None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:57.239544 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 529/1071] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:14:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:57.240309 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401ac83-b444-4dcb-b365-c02ed85180ac None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:57.286737 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb00ab-77e4-4e9f-a2e0-57d031abd403 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:57.320258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec06a09-d584-4009-a672-e2481ff8ec27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:57.320857 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec06a09-d584-4009-a672-e2481ff8ec27 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:57.321129 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec06a09-d584-4009-a672-e2481ff8ec27 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:57.321396 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec06a09-d584-4009-a672-e2481ff8ec27 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:57.322044 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec06a09-d584-4009-a672-e2481ff8ec27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:57.322345 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec06a09-d584-4009-a672-e2481ff8ec27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:57.323691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec06a09-d584-4009-a672-e2481ff8ec27 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:57.334875 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 543/1072] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:57.335642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec06a09-d584-4009-a672-e2481ff8ec27 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:57.336936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401ac83-b444-4dcb-b365-c02ed85180ac None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:57.363127 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:57.370159 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:57.371051 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677143f3-2a8c-43b0-b33c-172f5ef78719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:57.372237 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677143f3-2a8c-43b0-b33c-172f5ef78719 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:57.372504 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677143f3-2a8c-43b0-b33c-172f5ef78719 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:57.372768 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677143f3-2a8c-43b0-b33c-172f5ef78719 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:57.382755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677143f3-2a8c-43b0-b33c-172f5ef78719 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:57.384198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677143f3-2a8c-43b0-b33c-172f5ef78719 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:57.398936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-677143f3-2a8c-43b0-b33c-172f5ef78719 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:57.398936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:57.398936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:57.398936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:57.398936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:57.398936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:57.398936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:57.398936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:57.398936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:57.398936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:57.398936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:57.398936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:57.398936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:57.398936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:57.398936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:57.398936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:57.400157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:57.400157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:57.400157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:57.400157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:57.400157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:57.400157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:57.400157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:57.400157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:57.400157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:57.400157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:57.400157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:57.400157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:57.400157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:57.400157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:57.400157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:57.400157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:57.400157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:57.401094 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:57.401094 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:57.401094 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:57.401094 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 530/1073] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:57.401094 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677143f3-2a8c-43b0-b33c-172f5ef78719 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:57.437861 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec06a09-d584-4009-a672-e2481ff8ec27 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:57.471674 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c00c2-3d3c-4f82-a836-a1b27c9cc8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:57.472296 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c00c2-3d3c-4f82-a836-a1b27c9cc8b4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:57.472573 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c00c2-3d3c-4f82-a836-a1b27c9cc8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:57.472841 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c00c2-3d3c-4f82-a836-a1b27c9cc8b4 None admin] PATH_INFO: `/v3/users/dd397ef3fac84e008571b460db52b70b` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:57.473989 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c00c2-3d3c-4f82-a836-a1b27c9cc8b4 None admin] RBAC: Authorizing `identity:get_user(user_id=dd397ef3fac84e008571b460db52b70b)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:57.475427 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c00c2-3d3c-4f82-a836-a1b27c9cc8b4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:57.481933 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 544/1074] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:14:57 2022] GET /identity/v3/users/dd397ef3fac84e008571b460db52b70b => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:57.481933 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c00c2-3d3c-4f82-a836-a1b27c9cc8b4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:57.500304 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677143f3-2a8c-43b0-b33c-172f5ef78719 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:57.536713 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb625f2-e779-4e0c-acea-6f791ff8db83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:57.537447 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb625f2-e779-4e0c-acea-6f791ff8db83 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:57.537690 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb625f2-e779-4e0c-acea-6f791ff8db83 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:57.537960 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb625f2-e779-4e0c-acea-6f791ff8db83 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:57.545040 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb625f2-e779-4e0c-acea-6f791ff8db83 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:57.546508 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb625f2-e779-4e0c-acea-6f791ff8db83 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:57.557899 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-bbb625f2-e779-4e0c-acea-6f791ff8db83 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:14:57.557899 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:57.557899 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:57.557899 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:57.557899 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:57.557899 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:57.557899 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:57.557899 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:57.557899 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:57.557899 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:57.557899 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:57.557899 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:57.557899 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:14:57.557899 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:14:57.557899 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:14:57.557899 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:14:57.558887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:57.558887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:57.558887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:14:57.558887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:57.558887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:14:57.558887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:14:57.558887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:57.558887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:57.558887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:57.558887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:57.558887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:57.558887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:57.558887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:57.558887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:57.558887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:57.558887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:57.558887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:57.558887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:57.560528 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:57.560528 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:57.560528 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:14:57.560528 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:14:57.560528 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:14:57.560528 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:14:57.560528 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:14:57.560528 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:14:57.560528 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:14:57.560528 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:14:57.560528 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 531/1075] 10.222.0.94 () {56 vars in 1093 bytes} [Thu Sep 1 17:14:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:57.560528 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb625f2-e779-4e0c-acea-6f791ff8db83 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:57.581478 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c00c2-3d3c-4f82-a836-a1b27c9cc8b4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:57.583158 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:57.603959 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:57.618198 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8130e0-b47c-45f2-a5d2-a0e9bf57c1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:57.618843 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8130e0-b47c-45f2-a5d2-a0e9bf57c1e1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:57.619129 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8130e0-b47c-45f2-a5d2-a0e9bf57c1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:57.619403 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8130e0-b47c-45f2-a5d2-a0e9bf57c1e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:57.620039 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8130e0-b47c-45f2-a5d2-a0e9bf57c1e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:57.620341 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8130e0-b47c-45f2-a5d2-a0e9bf57c1e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:57.622329 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8130e0-b47c-45f2-a5d2-a0e9bf57c1e1 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:57.634079 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 545/1076] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:57.634865 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8130e0-b47c-45f2-a5d2-a0e9bf57c1e1 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:57.666811 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb625f2-e779-4e0c-acea-6f791ff8db83 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:57.706578 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9638b38-ada5-4083-9276-37b0bff5e3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:57.707228 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9638b38-ada5-4083-9276-37b0bff5e3ef None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:57.707507 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9638b38-ada5-4083-9276-37b0bff5e3ef None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:57.707780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9638b38-ada5-4083-9276-37b0bff5e3ef None admin] PATH_INFO: `/v3/projects/1abdc670121348f5b4b4cd2bf2ddbe73` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:57.708947 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9638b38-ada5-4083-9276-37b0bff5e3ef None admin] RBAC: Authorizing `identity:get_project(project_id=1abdc670121348f5b4b4cd2bf2ddbe73)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:57.710542 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9638b38-ada5-4083-9276-37b0bff5e3ef None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:57.712258 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 532/1077] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:14:57 2022] GET /identity/v3/projects/1abdc670121348f5b4b4cd2bf2ddbe73 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:57.719109 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9638b38-ada5-4083-9276-37b0bff5e3ef None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:57.761151 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8130e0-b47c-45f2-a5d2-a0e9bf57c1e1 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:57.802268 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d7f1f-0253-483e-92d2-74afc942e282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:57.802796 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d7f1f-0253-483e-92d2-74afc942e282 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:57.803069 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d7f1f-0253-483e-92d2-74afc942e282 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:57.803334 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d7f1f-0253-483e-92d2-74afc942e282 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:57.804062 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d7f1f-0253-483e-92d2-74afc942e282 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:57.804363 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d7f1f-0253-483e-92d2-74afc942e282 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:57.806479 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d7f1f-0253-483e-92d2-74afc942e282 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:57.827355 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 546/1078] 10.222.0.94 () {56 vars in 1133 bytes} [Thu Sep 1 17:14:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:57.833978 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d7f1f-0253-483e-92d2-74afc942e282 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:57.836624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9638b38-ada5-4083-9276-37b0bff5e3ef None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:57.847676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:57.859417 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:57.881665 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359ec98-d6f7-4dc8-a641-e3506129dc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:57.882338 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359ec98-d6f7-4dc8-a641-e3506129dc83 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:57.882621 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359ec98-d6f7-4dc8-a641-e3506129dc83 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:57.883107 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359ec98-d6f7-4dc8-a641-e3506129dc83 None admin] PATH_INFO: `/v3/projects/1abdc670121348f5b4b4cd2bf2ddbe73/users/dd397ef3fac84e008571b460db52b70b/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:57.885372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359ec98-d6f7-4dc8-a641-e3506129dc83 None admin] RBAC: Authorizing `identity:create_grant(project_id=1abdc670121348f5b4b4cd2bf2ddbe73, user_id=dd397ef3fac84e008571b460db52b70b, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:57.887836 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359ec98-d6f7-4dc8-a641-e3506129dc83 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:57.907577 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 533/1079] 10.222.0.94 () {58 vars in 1439 bytes} [Thu Sep 1 17:14:57 2022] PUT /identity/v3/projects/1abdc670121348f5b4b4cd2bf2ddbe73/users/dd397ef3fac84e008571b460db52b70b/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:14:57.958326 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d7f1f-0253-483e-92d2-74afc942e282 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:57.994114 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ab070-fcce-4c9c-805e-460d298bfa2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:57.994758 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ab070-fcce-4c9c-805e-460d298bfa2d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:57.995034 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ab070-fcce-4c9c-805e-460d298bfa2d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:57.995301 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ab070-fcce-4c9c-805e-460d298bfa2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:58.006659 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ab070-fcce-4c9c-805e-460d298bfa2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:58.008137 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ab070-fcce-4c9c-805e-460d298bfa2d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:58.024292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-3c7ab070-fcce-4c9c-805e-460d298bfa2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:58.024292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:58.024292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:58.024292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:58.024292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:58.024292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:58.024292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:58.024292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:58.024292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:58.024292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:58.024292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:58.024292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:58.024292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:14:58.024292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:14:58.024292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:14:58.024292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:14:58.025380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:58.025380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:58.025380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:58.025380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:58.025380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:58.025380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:58.025380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:58.025380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:58.025380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:58.025380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:58.025380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:58.025380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:58.025380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:58.025380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:58.025380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:58.025380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:58.025380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:14:58.026833 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:14:58.026833 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:14:58.026833 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:58.026833 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 547/1080] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:14:58.031712 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359ec98-d6f7-4dc8-a641-e3506129dc83 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:58.134457 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359ec98-d6f7-4dc8-a641-e3506129dc83 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:58.166349 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50087624-fd5d-47cf-af0a-0629bebc27b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:58.166947 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50087624-fd5d-47cf-af0a-0629bebc27b3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:58.167224 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50087624-fd5d-47cf-af0a-0629bebc27b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:58.167491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50087624-fd5d-47cf-af0a-0629bebc27b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:58.168129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50087624-fd5d-47cf-af0a-0629bebc27b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:58.168946 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50087624-fd5d-47cf-af0a-0629bebc27b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:58.170335 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50087624-fd5d-47cf-af0a-0629bebc27b3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:58.181816 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 534/1081] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:58.188253 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ab070-fcce-4c9c-805e-460d298bfa2d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:58.258954 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:58.288366 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ab070-fcce-4c9c-805e-460d298bfa2d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:58.320930 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e52c93-c94d-48cf-a2ab-dc8d089c8849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:58.321600 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e52c93-c94d-48cf-a2ab-dc8d089c8849 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:58.321881 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e52c93-c94d-48cf-a2ab-dc8d089c8849 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:58.322150 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e52c93-c94d-48cf-a2ab-dc8d089c8849 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:58.329506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e52c93-c94d-48cf-a2ab-dc8d089c8849 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:58.330941 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e52c93-c94d-48cf-a2ab-dc8d089c8849 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:58.342584 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-f3e52c93-c94d-48cf-a2ab-dc8d089c8849 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:58.342584 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:14:58.342584 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:14:58.342584 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:14:58.342584 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:14:58.342584 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:14:58.342584 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:14:58.342584 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:14:58.342584 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:14:58.342584 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:14:58.342584 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:14:58.342584 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:14:58.342584 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:14:58.342584 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:14:58.342584 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:14:58.343666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:14:58.343666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:14:58.343666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:14:58.343666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:14:58.343666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:14:58.343666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:14:58.343666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:14:58.343666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:14:58.343666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:14:58.343666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:14:58.343666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:14:58.343666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:14:58.343666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:14:58.343666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:14:58.343666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:14:58.343666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:14:58.343666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:14:58.344677 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:14:58.344677 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:14:58.344677 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:14:58.344677 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:14:58.344677 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:14:58.344677 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:14:58.344677 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:14:58.344677 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:14:58.344677 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 548/1082] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:14:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:14:58.349898 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50087624-fd5d-47cf-af0a-0629bebc27b3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:58.379413 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:58.451977 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50087624-fd5d-47cf-af0a-0629bebc27b3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:58.485414 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869467dd-4cc6-428e-96a2-8d4486189924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:58.486028 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869467dd-4cc6-428e-96a2-8d4486189924 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:58.486308 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869467dd-4cc6-428e-96a2-8d4486189924 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:58.486579 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869467dd-4cc6-428e-96a2-8d4486189924 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:58.487265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869467dd-4cc6-428e-96a2-8d4486189924 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:14:58.487568 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869467dd-4cc6-428e-96a2-8d4486189924 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:58.488990 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869467dd-4cc6-428e-96a2-8d4486189924 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:58.500928 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 535/1083] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:14:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:14:58.506946 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e52c93-c94d-48cf-a2ab-dc8d089c8849 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:14:58.607816 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e52c93-c94d-48cf-a2ab-dc8d089c8849 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:14:58.635232 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:14:58.640714 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92888d33-222d-42bc-a52e-16569b7d7844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:14:58.641376 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92888d33-222d-42bc-a52e-16569b7d7844 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:58.641725 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92888d33-222d-42bc-a52e-16569b7d7844 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:58.642007 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92888d33-222d-42bc-a52e-16569b7d7844 None admin] PATH_INFO: `/v3/projects/c8f9428f37354c82ac52b6b8eccc424a/users/8b7fa3c4c5d94b3c9b7f17dde35d39a0/roles/9990ea7faa184ffb88d6994ef7e3eba1` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:58.644133 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92888d33-222d-42bc-a52e-16569b7d7844 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8f9428f37354c82ac52b6b8eccc424a, user_id=8b7fa3c4c5d94b3c9b7f17dde35d39a0, role_id=9990ea7faa184ffb88d6994ef7e3eba1)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:14:58.645604 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92888d33-222d-42bc-a52e-16569b7d7844 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:14:58.658186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 549/1084] 10.222.0.94 () {58 vars in 1439 bytes} [Thu Sep 1 17:14:58 2022] PUT /identity/v3/projects/c8f9428f37354c82ac52b6b8eccc424a/users/8b7fa3c4c5d94b3c9b7f17dde35d39a0/roles/9990ea7faa184ffb88d6994ef7e3eba1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:14:59.770786 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f14572-603f-47c9-8bdf-3abf7eea5efd None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:59.771312 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f14572-603f-47c9-8bdf-3abf7eea5efd None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:59.771312 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f14572-603f-47c9-8bdf-3abf7eea5efd None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:59.772655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 536/1085] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:14:59.778615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f78cd-0d76-433d-8462-8751c07c6dc3 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:14:59.779007 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f78cd-0d76-433d-8462-8751c07c6dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:14:59.779192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f78cd-0d76-433d-8462-8751c07c6dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:14:59.796995 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e66f78cd-0d76-433d-8462-8751c07c6dc3 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:14:59.798146 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e66f78cd-0d76-433d-8462-8751c07c6dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:14:59.861947 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 550/1086] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:14:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:15:00.153854 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f14572-603f-47c9-8bdf-3abf7eea5efd None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:00.245301 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:00.258835 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f14572-603f-47c9-8bdf-3abf7eea5efd None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:00.296219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc68cb9-401f-4641-93cf-804531124015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:00.296841 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc68cb9-401f-4641-93cf-804531124015 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:00.297116 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc68cb9-401f-4641-93cf-804531124015 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:00.297384 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc68cb9-401f-4641-93cf-804531124015 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:00.307213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc68cb9-401f-4641-93cf-804531124015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:15:00.312930 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-4bc68cb9-401f-4641-93cf-804531124015 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:15:00.312930 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:15:00.312930 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:15:00.312930 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:15:00.312930 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:15:00.312930 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:15:00.312930 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:15:00.312930 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:15:00.312930 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:15:00.312930 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:15:00.312930 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:15:00.312930 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:15:00.312930 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:15:00.312930 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:15:00.312930 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:15:00.312930 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:15:00.313915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:15:00.313915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:15:00.313915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:15:00.313915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:15:00.313915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:15:00.313915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:15:00.313915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:15:00.313915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:15:00.313915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:15:00.313915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:15:00.313915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:15:00.313915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:15:00.313915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:15:00.313915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:15:00.313915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:15:00.313915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:15:00.314815 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:15:00.314815 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:15:00.314815 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:15:00.314815 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:15:00.314815 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:15:00.314815 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:15:00.314815 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:15:00.314815 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:15:00.314815 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:15:00.314815 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:15:00.314815 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:15:00.314815 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:15:00.314815 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 537/1087] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:15:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:15:00.323996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f78cd-0d76-433d-8462-8751c07c6dc3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:00.421969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f78cd-0d76-433d-8462-8751c07c6dc3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:00.445539 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:00.457934 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c0aa9-9901-4ca1-9d87-38c2c9c8febb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:00.458542 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c0aa9-9901-4ca1-9d87-38c2c9c8febb None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:00.458818 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c0aa9-9901-4ca1-9d87-38c2c9c8febb None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:00.459085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c0aa9-9901-4ca1-9d87-38c2c9c8febb None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:00.459741 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c0aa9-9901-4ca1-9d87-38c2c9c8febb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:15:00.460041 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c0aa9-9901-4ca1-9d87-38c2c9c8febb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:00.461419 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c0aa9-9901-4ca1-9d87-38c2c9c8febb None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:00.469356 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 551/1088] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:15:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:00.475120 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc68cb9-401f-4641-93cf-804531124015 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:00.540114 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f09596-2eeb-4b12-b25c-a80fc6e5ab72 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:00.540401 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f09596-2eeb-4b12-b25c-a80fc6e5ab72 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:00.540675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f09596-2eeb-4b12-b25c-a80fc6e5ab72 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:00.542167 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 552/1089] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:15:00.546988 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b4354-e69c-439b-b06a-90ade1d57766 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:00.547267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b4354-e69c-439b-b06a-90ade1d57766 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:00.547535 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b4354-e69c-439b-b06a-90ade1d57766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:00.565183 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a15b4354-e69c-439b-b06a-90ade1d57766 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:15:00.566409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a15b4354-e69c-439b-b06a-90ade1d57766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:15:00.576857 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc68cb9-401f-4641-93cf-804531124015 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:00.611749 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6212ce9-fbe3-49f3-8e2e-35b49c1bf7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:00.612373 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6212ce9-fbe3-49f3-8e2e-35b49c1bf7ec None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:00.612647 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6212ce9-fbe3-49f3-8e2e-35b49c1bf7ec None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:00.612917 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6212ce9-fbe3-49f3-8e2e-35b49c1bf7ec None admin] PATH_INFO: `/v3/users/dd397ef3fac84e008571b460db52b70b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:00.614045 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6212ce9-fbe3-49f3-8e2e-35b49c1bf7ec None admin] RBAC: Authorizing `identity:get_user(user_id=dd397ef3fac84e008571b460db52b70b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:00.615461 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6212ce9-fbe3-49f3-8e2e-35b49c1bf7ec None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:00.617025 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 538/1090] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:15:00 2022] GET /identity/v3/users/dd397ef3fac84e008571b460db52b70b => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:15:00.622957 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6212ce9-fbe3-49f3-8e2e-35b49c1bf7ec None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:00.634752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 553/1091] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:15:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:15:00.641214 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:00.722741 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6212ce9-fbe3-49f3-8e2e-35b49c1bf7ec None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:00.754931 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6636db-dd85-4204-a426-4461a9c14d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:00.755527 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6636db-dd85-4204-a426-4461a9c14d3b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:00.755809 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6636db-dd85-4204-a426-4461a9c14d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:00.756084 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6636db-dd85-4204-a426-4461a9c14d3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:00.821294 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6636db-dd85-4204-a426-4461a9c14d3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:00.822761 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6636db-dd85-4204-a426-4461a9c14d3b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:00.839541 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:00.906278 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b4354-e69c-439b-b06a-90ade1d57766 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:00.919467 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 539/1092] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:15:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 17:15:00.925124 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6636db-dd85-4204-a426-4461a9c14d3b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:01.003461 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b4354-e69c-439b-b06a-90ade1d57766 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:01.017693 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:01.022872 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6636db-dd85-4204-a426-4461a9c14d3b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:01.038390 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71afb201-5c2d-4ac8-8f0f-c0fc540090cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:01.039067 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afb201-5c2d-4ac8-8f0f-c0fc540090cf None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:01.039254 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:01.039380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afb201-5c2d-4ac8-8f0f-c0fc540090cf None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:01.039598 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afb201-5c2d-4ac8-8f0f-c0fc540090cf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:01.050123 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71afb201-5c2d-4ac8-8f0f-c0fc540090cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:15:01.054893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-71afb201-5c2d-4ac8-8f0f-c0fc540090cf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 17:15:01.054893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:15:01.054893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:15:01.054893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:15:01.054893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:15:01.054893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:15:01.054893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:15:01.054893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:15:01.054893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:15:01.054893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:15:01.054893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:15:01.054893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:15:01.054893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:15:01.054893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:15:01.054893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:15:01.054893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:15:01.056041 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:15:01.056041 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:15:01.056041 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:15:01.056041 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:15:01.056041 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:15:01.056041 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:15:01.056041 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:15:01.056041 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:15:01.056041 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:15:01.056041 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:15:01.056041 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:15:01.056041 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:15:01.056041 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:15:01.056041 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:15:01.056041 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:15:01.056041 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:15:01.057095 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:15:01.057095 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:15:01.057095 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:15:01.057095 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:15:01.057095 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:15:01.057095 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:15:01.057095 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:15:01.057095 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:15:01.057095 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:15:01.057095 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:15:01.057095 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 17:15:01.057095 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:15:01.057095 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 554/1093] 10.222.0.94 () {56 vars in 1120 bytes} [Thu Sep 1 17:15:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:15:01.060370 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad51a4-5179-4fcd-87a0-a6177510130e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:01.060995 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad51a4-5179-4fcd-87a0-a6177510130e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:01.061268 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad51a4-5179-4fcd-87a0-a6177510130e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:01.061559 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad51a4-5179-4fcd-87a0-a6177510130e None admin] PATH_INFO: `/v3/projects/1abdc670121348f5b4b4cd2bf2ddbe73` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:01.062665 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad51a4-5179-4fcd-87a0-a6177510130e None admin] RBAC: Authorizing `identity:get_project(project_id=1abdc670121348f5b4b4cd2bf2ddbe73)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:01.062772 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71afb201-5c2d-4ac8-8f0f-c0fc540090cf None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:01.064077 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad51a4-5179-4fcd-87a0-a6177510130e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:01.065733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 540/1094] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:15:00 2022] GET /identity/v3/projects/1abdc670121348f5b4b4cd2bf2ddbe73 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:15:01.071458 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad51a4-5179-4fcd-87a0-a6177510130e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:01.162557 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71afb201-5c2d-4ac8-8f0f-c0fc540090cf None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:01.175012 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad51a4-5179-4fcd-87a0-a6177510130e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:01.196360 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cded2a-c84a-4467-ade5-faa03224c0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:01.196954 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cded2a-c84a-4467-ade5-faa03224c0f3 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:01.197234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cded2a-c84a-4467-ade5-faa03224c0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:01.197817 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cded2a-c84a-4467-ade5-faa03224c0f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:01.198191 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cded2a-c84a-4467-ade5-faa03224c0f3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:15:01.198554 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cded2a-c84a-4467-ade5-faa03224c0f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:01.199959 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cded2a-c84a-4467-ade5-faa03224c0f3 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:01.207993 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 555/1095] 10.222.0.94 () {56 vars in 1115 bytes} [Thu Sep 1 17:15:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:15:01.212850 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c0962-50f5-49ab-af4f-3d029831e5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:01.212850 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c0962-50f5-49ab-af4f-3d029831e5cf None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:01.212850 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c0962-50f5-49ab-af4f-3d029831e5cf None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:01.212850 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c0962-50f5-49ab-af4f-3d029831e5cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:01.213186 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c0962-50f5-49ab-af4f-3d029831e5cf None admin] RBAC: Adding query filter params (role.id=70f911a75b7b40a19f65857b9d19cfad, scope.project.id=1abdc670121348f5b4b4cd2bf2ddbe73, user.id=dd397ef3fac84e008571b460db52b70b) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:15:01.213186 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c0962-50f5-49ab-af4f-3d029831e5cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:01.213186 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c0962-50f5-49ab-af4f-3d029831e5cf None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:01.214146 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cded2a-c84a-4467-ade5-faa03224c0f3 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:01.217464 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 541/1096] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:15:01 2022] GET /identity/v3/role_assignments?user.id=dd397ef3fac84e008571b460db52b70b&scope.project.id=1abdc670121348f5b4b4cd2bf2ddbe73&role.id=70f911a75b7b40a19f65857b9d19cfad => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:15:01.252104 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:01.321188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cded2a-c84a-4467-ade5-faa03224c0f3 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:01.357020 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca147f6-b440-4d0d-8ad4-7f1b8a9b32f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:01.357692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca147f6-b440-4d0d-8ad4-7f1b8a9b32f5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:01.357970 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca147f6-b440-4d0d-8ad4-7f1b8a9b32f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:01.358247 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca147f6-b440-4d0d-8ad4-7f1b8a9b32f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:01.368868 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca147f6-b440-4d0d-8ad4-7f1b8a9b32f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:01.370429 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca147f6-b440-4d0d-8ad4-7f1b8a9b32f5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:01.384656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-cca147f6-b440-4d0d-8ad4-7f1b8a9b32f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:15:01.384656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:15:01.384656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:15:01.384656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:15:01.384656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:15:01.384656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:15:01.384656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:15:01.384656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:15:01.384656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:15:01.384656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:15:01.384656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:15:01.384656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:15:01.384656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:15:01.384656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:15:01.384656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:15:01.384656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:15:01.385922 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:15:01.385922 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:15:01.385922 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:15:01.385922 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:15:01.385922 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:15:01.385922 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:15:01.385922 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:15:01.385922 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:15:01.385922 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:15:01.385922 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:15:01.385922 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:15:01.385922 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:15:01.385922 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:15:01.385922 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:15:01.385922 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:15:01.385922 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:15:01.385922 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:15:01.387595 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:15:01.387595 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:15:01.387595 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:15:01.387595 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 556/1097] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:15:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:15:01.392402 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c0962-50f5-49ab-af4f-3d029831e5cf None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:01.441607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:01.492443 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c0962-50f5-49ab-af4f-3d029831e5cf None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:01.525517 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a45a6c-ad13-4cea-8607-df1b6ab6aec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:01.526121 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a45a6c-ad13-4cea-8607-df1b6ab6aec9 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:01.526401 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a45a6c-ad13-4cea-8607-df1b6ab6aec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:01.526672 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a45a6c-ad13-4cea-8607-df1b6ab6aec9 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:01.530058 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a45a6c-ad13-4cea-8607-df1b6ab6aec9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:15:01.530058 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a45a6c-ad13-4cea-8607-df1b6ab6aec9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:01.530058 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a45a6c-ad13-4cea-8607-df1b6ab6aec9 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:01.543030 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 542/1098] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:01.548794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca147f6-b440-4d0d-8ad4-7f1b8a9b32f5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:01.635879 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:01.648223 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca147f6-b440-4d0d-8ad4-7f1b8a9b32f5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:01.681573 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85543283-d47e-4897-9e37-30c3bfadd295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:01.682197 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85543283-d47e-4897-9e37-30c3bfadd295 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:01.682476 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85543283-d47e-4897-9e37-30c3bfadd295 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:01.682743 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85543283-d47e-4897-9e37-30c3bfadd295 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:01.690591 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85543283-d47e-4897-9e37-30c3bfadd295 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:01.692026 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85543283-d47e-4897-9e37-30c3bfadd295 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:01.703823 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-85543283-d47e-4897-9e37-30c3bfadd295 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:15:01.703823 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:15:01.703823 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:15:01.703823 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:15:01.703823 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:15:01.703823 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:15:01.703823 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:15:01.703823 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:15:01.703823 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:15:01.703823 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:15:01.703823 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:15:01.703823 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:15:01.703823 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:15:01.703823 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:15:01.703823 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:15:01.703823 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:15:01.704827 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:15:01.704827 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:15:01.704827 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:15:01.704827 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:15:01.704827 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:15:01.704827 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:15:01.704827 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:15:01.704827 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:15:01.704827 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:15:01.704827 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:15:01.704827 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:15:01.704827 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:15:01.704827 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:15:01.704827 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:15:01.704827 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:15:01.704827 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:15:01.704827 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:15:01.704827 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:15:01.705849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:15:01.705849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:15:01.705849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:15:01.705849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:15:01.705849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:15:01.705849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:15:01.705849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:15:01.705849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:15:01.705849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 17:15:01.705849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:15:01.705849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 557/1099] 10.222.0.94 () {56 vars in 1093 bytes} [Thu Sep 1 17:15:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:15:01.710638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a45a6c-ad13-4cea-8607-df1b6ab6aec9 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:01.805739 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a45a6c-ad13-4cea-8607-df1b6ab6aec9 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:01.815080 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:01.839014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b2772-fb62-433f-b459-079e7d80f235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:01.839613 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b2772-fb62-433f-b459-079e7d80f235 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:01.839873 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b2772-fb62-433f-b459-079e7d80f235 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:01.840165 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b2772-fb62-433f-b459-079e7d80f235 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:01.840885 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b2772-fb62-433f-b459-079e7d80f235 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:15:01.841184 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b2772-fb62-433f-b459-079e7d80f235 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:01.842619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b2772-fb62-433f-b459-079e7d80f235 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:01.859551 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 543/1100] 10.222.0.94 () {56 vars in 1133 bytes} [Thu Sep 1 17:15:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:01.865377 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85543283-d47e-4897-9e37-30c3bfadd295 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:01.962813 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85543283-d47e-4897-9e37-30c3bfadd295 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:01.995222 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18f6fe-7f7c-4d3d-8ef8-1d2b7f5ba974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:01.995821 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18f6fe-7f7c-4d3d-8ef8-1d2b7f5ba974 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:01.996099 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18f6fe-7f7c-4d3d-8ef8-1d2b7f5ba974 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:01.996405 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18f6fe-7f7c-4d3d-8ef8-1d2b7f5ba974 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:02.014343 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:02.063168 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18f6fe-7f7c-4d3d-8ef8-1d2b7f5ba974 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:02.064606 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18f6fe-7f7c-4d3d-8ef8-1d2b7f5ba974 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:02.165065 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 558/1101] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:15:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 17:15:02.171360 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b2772-fb62-433f-b459-079e7d80f235 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:02.272163 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b2772-fb62-433f-b459-079e7d80f235 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:02.304573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf0d4f-ac91-4fd5-b18b-ebfa6eb1ecb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:02.305201 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf0d4f-ac91-4fd5-b18b-ebfa6eb1ecb4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:02.305509 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf0d4f-ac91-4fd5-b18b-ebfa6eb1ecb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:02.305784 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf0d4f-ac91-4fd5-b18b-ebfa6eb1ecb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:02.316888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf0d4f-ac91-4fd5-b18b-ebfa6eb1ecb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:02.318398 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf0d4f-ac91-4fd5-b18b-ebfa6eb1ecb4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:02.334506 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-9dbf0d4f-ac91-4fd5-b18b-ebfa6eb1ecb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:15:02.334506 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:15:02.334506 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:15:02.334506 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:15:02.334506 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:15:02.334506 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:15:02.334506 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:15:02.334506 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:15:02.334506 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:15:02.334506 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:15:02.334506 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:15:02.334506 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:15:02.334506 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:15:02.334506 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:15:02.334506 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:15:02.334506 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:15:02.335733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:15:02.335733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:15:02.335733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:15:02.335733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:15:02.335733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:15:02.335733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:15:02.335733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:15:02.335733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:15:02.335733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:15:02.335733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:15:02.335733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:15:02.335733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:15:02.335733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:15:02.335733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:15:02.335733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:15:02.335733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:15:02.335733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:15:02.336647 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:15:02.336647 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:15:02.336647 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:15:02.336647 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 544/1102] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:15:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:15:02.341308 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18f6fe-7f7c-4d3d-8ef8-1d2b7f5ba974 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:02.388199 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:02.437328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18f6fe-7f7c-4d3d-8ef8-1d2b7f5ba974 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:02.470238 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e1d31-9ee8-4e3a-b48f-e25bdeed2b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:02.470837 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e1d31-9ee8-4e3a-b48f-e25bdeed2b25 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:02.471119 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e1d31-9ee8-4e3a-b48f-e25bdeed2b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:02.471390 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e1d31-9ee8-4e3a-b48f-e25bdeed2b25 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:02.472024 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e1d31-9ee8-4e3a-b48f-e25bdeed2b25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:15:02.472326 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e1d31-9ee8-4e3a-b48f-e25bdeed2b25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:02.473715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e1d31-9ee8-4e3a-b48f-e25bdeed2b25 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:02.484438 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 559/1103] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:02.490093 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf0d4f-ac91-4fd5-b18b-ebfa6eb1ecb4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:02.509375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:02.591649 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf0d4f-ac91-4fd5-b18b-ebfa6eb1ecb4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:02.625603 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ecd83-0fb2-4606-a1f3-7a9cf4b80ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:02.626227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ecd83-0fb2-4606-a1f3-7a9cf4b80ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:02.626505 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ecd83-0fb2-4606-a1f3-7a9cf4b80ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:02.626776 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ecd83-0fb2-4606-a1f3-7a9cf4b80ea6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:02.633547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ecd83-0fb2-4606-a1f3-7a9cf4b80ea6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:02.634988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ecd83-0fb2-4606-a1f3-7a9cf4b80ea6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:02.646508 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-544ecd83-0fb2-4606-a1f3-7a9cf4b80ea6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:15:02.646508 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:15:02.646508 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:15:02.646508 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:15:02.646508 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:15:02.646508 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:15:02.646508 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:15:02.646508 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:15:02.646508 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:15:02.646508 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:15:02.646508 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:15:02.646508 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:15:02.646508 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:15:02.646508 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:15:02.646508 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:15:02.647573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:15:02.647573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:15:02.647573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:15:02.647573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:15:02.647573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:15:02.647573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:15:02.647573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:15:02.647573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:15:02.647573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:15:02.647573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:15:02.647573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:15:02.647573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:15:02.647573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:15:02.647573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:15:02.647573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:15:02.647573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:15:02.647573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:15:02.648570 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:15:02.648570 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:15:02.648570 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:15:02.648570 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:15:02.648570 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:15:02.648570 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:15:02.648570 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:15:02.648570 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:15:02.648570 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 545/1104] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:15:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:15:02.653571 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e1d31-9ee8-4e3a-b48f-e25bdeed2b25 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:02.750645 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e1d31-9ee8-4e3a-b48f-e25bdeed2b25 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:02.759169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:02.784218 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe39ce-a6e4-49c2-a288-a9520d44e900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:02.784747 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe39ce-a6e4-49c2-a288-a9520d44e900 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:02.785023 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe39ce-a6e4-49c2-a288-a9520d44e900 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:02.785291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe39ce-a6e4-49c2-a288-a9520d44e900 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:02.786013 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe39ce-a6e4-49c2-a288-a9520d44e900 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:15:02.786315 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe39ce-a6e4-49c2-a288-a9520d44e900 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:02.787741 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe39ce-a6e4-49c2-a288-a9520d44e900 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:02.799904 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 560/1105] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:15:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:02.806015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ecd83-0fb2-4606-a1f3-7a9cf4b80ea6 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:02.889641 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:02.911093 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ecd83-0fb2-4606-a1f3-7a9cf4b80ea6 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:02.948422 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5afa0-1fd7-4225-b447-ed5c32356965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:02.949020 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5afa0-1fd7-4225-b447-ed5c32356965 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:02.949295 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5afa0-1fd7-4225-b447-ed5c32356965 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:02.949613 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5afa0-1fd7-4225-b447-ed5c32356965 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:02.950326 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5afa0-1fd7-4225-b447-ed5c32356965 None admin] RBAC: Adding query filter params (role.id=9990ea7faa184ffb88d6994ef7e3eba1, scope.project.id=c8f9428f37354c82ac52b6b8eccc424a, user.id=8b7fa3c4c5d94b3c9b7f17dde35d39a0) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:15:02.950629 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5afa0-1fd7-4225-b447-ed5c32356965 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:02.952044 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5afa0-1fd7-4225-b447-ed5c32356965 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:02.957935 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 546/1106] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:15:02 2022] GET /identity/v3/role_assignments?user.id=8b7fa3c4c5d94b3c9b7f17dde35d39a0&scope.project.id=c8f9428f37354c82ac52b6b8eccc424a&role.id=9990ea7faa184ffb88d6994ef7e3eba1 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:15:03.188080 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17019be0-acdc-47c2-8ea4-e5feb159eba5 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:03.188592 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17019be0-acdc-47c2-8ea4-e5feb159eba5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:03.188707 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17019be0-acdc-47c2-8ea4-e5feb159eba5 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:03.189999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 561/1107] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:15:03.195306 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e89e7-fc0f-4efd-a569-bb92b0ce5eb8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:03.195594 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e89e7-fc0f-4efd-a569-bb92b0ce5eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:03.195869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e89e7-fc0f-4efd-a569-bb92b0ce5eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:03.223622 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-154e89e7-fc0f-4efd-a569-bb92b0ce5eb8 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:15:03.224907 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-154e89e7-fc0f-4efd-a569-bb92b0ce5eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:15:03.297144 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 547/1108] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:15:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:15:03.562617 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17019be0-acdc-47c2-8ea4-e5feb159eba5 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:03.667883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17019be0-acdc-47c2-8ea4-e5feb159eba5 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:03.704695 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67bafd-39ea-47df-bd62-1a7a9fcfda23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:03.705333 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67bafd-39ea-47df-bd62-1a7a9fcfda23 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:03.705662 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67bafd-39ea-47df-bd62-1a7a9fcfda23 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:03.705946 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67bafd-39ea-47df-bd62-1a7a9fcfda23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:03.707082 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67bafd-39ea-47df-bd62-1a7a9fcfda23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:03.708522 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67bafd-39ea-47df-bd62-1a7a9fcfda23 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:03.710159 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 562/1109] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:15:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:03.716583 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e89e7-fc0f-4efd-a569-bb92b0ce5eb8 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:03.786970 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:03.816089 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e89e7-fc0f-4efd-a569-bb92b0ce5eb8 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:03.848520 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6429c2a-6dbf-4593-8902-3826a8d9c114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:03.849115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6429c2a-6dbf-4593-8902-3826a8d9c114 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:03.849393 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6429c2a-6dbf-4593-8902-3826a8d9c114 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:03.849701 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6429c2a-6dbf-4593-8902-3826a8d9c114 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:03.850348 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6429c2a-6dbf-4593-8902-3826a8d9c114 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:03.851760 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6429c2a-6dbf-4593-8902-3826a8d9c114 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:03.871787 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 548/1110] 10.222.0.94 () {60 vars in 1132 bytes} [Thu Sep 1 17:15:03 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:15:05.811992 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257eb90d-9118-4b57-83c7-3b88713f202d None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:05.812531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257eb90d-9118-4b57-83c7-3b88713f202d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:05.812531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257eb90d-9118-4b57-83c7-3b88713f202d None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:05.813826 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 563/1111] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:15:05.819036 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d00e1-1343-4edc-b04c-6d9a8a3feda2 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:05.819467 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d00e1-1343-4edc-b04c-6d9a8a3feda2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:05.819575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d00e1-1343-4edc-b04c-6d9a8a3feda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:05.837565 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5b1d00e1-1343-4edc-b04c-6d9a8a3feda2 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:15:05.838755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5b1d00e1-1343-4edc-b04c-6d9a8a3feda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:15:05.903837 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 549/1112] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:15:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:15:06.170935 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257eb90d-9118-4b57-83c7-3b88713f202d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:06.206603 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:06.269955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257eb90d-9118-4b57-83c7-3b88713f202d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:06.302260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200958e-4de8-418e-a0a5-ddc16f91e262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:06.302876 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200958e-4de8-418e-a0a5-ddc16f91e262 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:06.303148 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200958e-4de8-418e-a0a5-ddc16f91e262 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:06.303413 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200958e-4de8-418e-a0a5-ddc16f91e262 None admin] PATH_INFO: `/v3/roles/9131e2ca337e4d1286ef32a4ba63cafa` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:06.304768 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200958e-4de8-418e-a0a5-ddc16f91e262 None admin] RBAC: Authorizing `identity:get_role(role_id=9131e2ca337e4d1286ef32a4ba63cafa)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:06.306151 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200958e-4de8-418e-a0a5-ddc16f91e262 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:06.307444 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 564/1113] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:15:06 2022] GET /identity/v3/roles/9131e2ca337e4d1286ef32a4ba63cafa => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:06.313763 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d00e1-1343-4edc-b04c-6d9a8a3feda2 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:06.377638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:06.417430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d00e1-1343-4edc-b04c-6d9a8a3feda2 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:06.451311 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42eac2-aebc-4078-95d3-9538f9c92c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:06.451834 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42eac2-aebc-4078-95d3-9538f9c92c1e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:06.452106 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42eac2-aebc-4078-95d3-9538f9c92c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:06.452369 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42eac2-aebc-4078-95d3-9538f9c92c1e None admin] PATH_INFO: `/v3/users/9f830ec2845041b584b6e15d8688c9d4` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:06.465599 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42eac2-aebc-4078-95d3-9538f9c92c1e None admin] RBAC: Authorizing `identity:get_user(user_id=9f830ec2845041b584b6e15d8688c9d4)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:06.467026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42eac2-aebc-4078-95d3-9538f9c92c1e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:06.468606 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 550/1114] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:15:06 2022] GET /identity/v3/users/9f830ec2845041b584b6e15d8688c9d4 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:06.474394 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200958e-4de8-418e-a0a5-ddc16f91e262 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:06.571217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200958e-4de8-418e-a0a5-ddc16f91e262 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:06.573467 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:06.604074 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd813ea1-11ce-435a-841c-0a2ee53d65f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:06.604661 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd813ea1-11ce-435a-841c-0a2ee53d65f4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:06.604936 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd813ea1-11ce-435a-841c-0a2ee53d65f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:06.605200 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd813ea1-11ce-435a-841c-0a2ee53d65f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:06.668661 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd813ea1-11ce-435a-841c-0a2ee53d65f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:06.670121 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd813ea1-11ce-435a-841c-0a2ee53d65f4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:06.761951 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 565/1115] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:15:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 17:15:06.767785 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42eac2-aebc-4078-95d3-9538f9c92c1e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:06.865163 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42eac2-aebc-4078-95d3-9538f9c92c1e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:06.880775 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:06.898104 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06db924-c147-4e63-b427-9e1bf06053f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:06.898723 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06db924-c147-4e63-b427-9e1bf06053f8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:06.899003 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06db924-c147-4e63-b427-9e1bf06053f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:06.899274 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06db924-c147-4e63-b427-9e1bf06053f8 None admin] PATH_INFO: `/v3/projects/1abdc670121348f5b4b4cd2bf2ddbe73` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:06.900370 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06db924-c147-4e63-b427-9e1bf06053f8 None admin] RBAC: Authorizing `identity:get_project(project_id=1abdc670121348f5b4b4cd2bf2ddbe73)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:06.901835 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06db924-c147-4e63-b427-9e1bf06053f8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:06.903963 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 551/1116] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:15:06 2022] GET /identity/v3/projects/1abdc670121348f5b4b4cd2bf2ddbe73 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:06.910049 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd813ea1-11ce-435a-841c-0a2ee53d65f4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:06.913022 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:07.004799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd813ea1-11ce-435a-841c-0a2ee53d65f4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:07.037069 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8366af8-bf0b-4792-9d17-baadb29e957d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:07.037623 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8366af8-bf0b-4792-9d17-baadb29e957d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:07.037904 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8366af8-bf0b-4792-9d17-baadb29e957d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:07.038175 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8366af8-bf0b-4792-9d17-baadb29e957d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:07.038885 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8366af8-bf0b-4792-9d17-baadb29e957d None admin] RBAC: Adding query filter params (role.id=9131e2ca337e4d1286ef32a4ba63cafa, scope.project.id=1abdc670121348f5b4b4cd2bf2ddbe73, user.id=9f830ec2845041b584b6e15d8688c9d4) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:15:07.039190 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8366af8-bf0b-4792-9d17-baadb29e957d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:07.040604 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8366af8-bf0b-4792-9d17-baadb29e957d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:07.046332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 566/1117] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:15:06 2022] GET /identity/v3/role_assignments?user.id=9f830ec2845041b584b6e15d8688c9d4&scope.project.id=1abdc670121348f5b4b4cd2bf2ddbe73&role.id=9131e2ca337e4d1286ef32a4ba63cafa => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:08.940395 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438b2da-194a-4c8e-847b-d9c783a8aeee None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:08.941015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438b2da-194a-4c8e-847b-d9c783a8aeee None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:08.941015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438b2da-194a-4c8e-847b-d9c783a8aeee None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:08.942290 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 552/1118] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:15:08.947516 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c8f68-59f5-4d76-8aa6-6431d9569df1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:08.947980 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c8f68-59f5-4d76-8aa6-6431d9569df1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:08.948087 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c8f68-59f5-4d76-8aa6-6431d9569df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:08.967058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-371c8f68-59f5-4d76-8aa6-6431d9569df1 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:15:08.968244 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-371c8f68-59f5-4d76-8aa6-6431d9569df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:15:09.028308 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:09.034085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 567/1119] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:15:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:15:09.314459 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438b2da-194a-4c8e-847b-d9c783a8aeee None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:09.412076 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438b2da-194a-4c8e-847b-d9c783a8aeee None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:09.445108 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc85bb-8bc6-4128-a2e1-be70cdb53ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:09.445748 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc85bb-8bc6-4128-a2e1-be70cdb53ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:09.446026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc85bb-8bc6-4128-a2e1-be70cdb53ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:09.446296 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc85bb-8bc6-4128-a2e1-be70cdb53ec5 None admin] PATH_INFO: `/v3/roles/9131e2ca337e4d1286ef32a4ba63cafa` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:09.447671 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc85bb-8bc6-4128-a2e1-be70cdb53ec5 None admin] RBAC: Authorizing `identity:get_role(role_id=9131e2ca337e4d1286ef32a4ba63cafa)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:09.449020 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc85bb-8bc6-4128-a2e1-be70cdb53ec5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:09.450367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 553/1120] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:15:09 2022] GET /identity/v3/roles/9131e2ca337e4d1286ef32a4ba63cafa => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:09.456400 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c8f68-59f5-4d76-8aa6-6431d9569df1 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:09.556138 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c8f68-59f5-4d76-8aa6-6431d9569df1 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:09.589245 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea68daf-72e9-42ff-8ea7-370c27f3759a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:09.589840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea68daf-72e9-42ff-8ea7-370c27f3759a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:09.590122 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea68daf-72e9-42ff-8ea7-370c27f3759a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:09.590393 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea68daf-72e9-42ff-8ea7-370c27f3759a None admin] PATH_INFO: `/v3/users/9f830ec2845041b584b6e15d8688c9d4` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:09.591500 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea68daf-72e9-42ff-8ea7-370c27f3759a None admin] RBAC: Authorizing `identity:get_user(user_id=9f830ec2845041b584b6e15d8688c9d4)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:09.592938 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea68daf-72e9-42ff-8ea7-370c27f3759a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:09.594538 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 568/1121] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:15:09 2022] GET /identity/v3/users/9f830ec2845041b584b6e15d8688c9d4 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:09.600335 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc85bb-8bc6-4128-a2e1-be70cdb53ec5 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:09.651618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:09.697260 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc85bb-8bc6-4128-a2e1-be70cdb53ec5 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:09.729613 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7132e69-4e80-4428-a378-7975e41f3407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:09.730227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7132e69-4e80-4428-a378-7975e41f3407 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:09.730545 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7132e69-4e80-4428-a378-7975e41f3407 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:09.730820 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7132e69-4e80-4428-a378-7975e41f3407 None admin] PATH_INFO: `/v3/projects/1abdc670121348f5b4b4cd2bf2ddbe73` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:09.731920 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7132e69-4e80-4428-a378-7975e41f3407 None admin] RBAC: Authorizing `identity:get_project(project_id=1abdc670121348f5b4b4cd2bf2ddbe73)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:09.733341 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7132e69-4e80-4428-a378-7975e41f3407 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:09.734973 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 554/1122] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:15:09 2022] GET /identity/v3/projects/1abdc670121348f5b4b4cd2bf2ddbe73 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:09.740917 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea68daf-72e9-42ff-8ea7-370c27f3759a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:09.804855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:09.839456 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea68daf-72e9-42ff-8ea7-370c27f3759a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:09.873221 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f780e0d-f86f-4726-a8a4-9f2de4b20712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:09.873895 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f780e0d-f86f-4726-a8a4-9f2de4b20712 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:09.874176 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f780e0d-f86f-4726-a8a4-9f2de4b20712 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:09.874450 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f780e0d-f86f-4726-a8a4-9f2de4b20712 None admin] PATH_INFO: `/v3/projects/1abdc670121348f5b4b4cd2bf2ddbe73/users/9f830ec2845041b584b6e15d8688c9d4/roles/9131e2ca337e4d1286ef32a4ba63cafa` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:09.876569 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f780e0d-f86f-4726-a8a4-9f2de4b20712 None admin] RBAC: Authorizing `identity:create_grant(project_id=1abdc670121348f5b4b4cd2bf2ddbe73, user_id=9f830ec2845041b584b6e15d8688c9d4, role_id=9131e2ca337e4d1286ef32a4ba63cafa)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:09.878035 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f780e0d-f86f-4726-a8a4-9f2de4b20712 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:09.890639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 569/1123] 10.222.0.94 () {58 vars in 1439 bytes} [Thu Sep 1 17:15:09 2022] PUT /identity/v3/projects/1abdc670121348f5b4b4cd2bf2ddbe73/users/9f830ec2845041b584b6e15d8688c9d4/roles/9131e2ca337e4d1286ef32a4ba63cafa => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:15:11.768672 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0619628-637b-4e0d-8e7f-241be22b634e None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:11.769221 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0619628-637b-4e0d-8e7f-241be22b634e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:11.769221 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0619628-637b-4e0d-8e7f-241be22b634e None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:11.770573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 555/1124] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:15:11.775592 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b36d29-e969-4e2a-90a9-028c85ba0747 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:11.776015 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b36d29-e969-4e2a-90a9-028c85ba0747 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:11.776145 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b36d29-e969-4e2a-90a9-028c85ba0747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:11.794770 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-97b36d29-e969-4e2a-90a9-028c85ba0747 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:15:11.795943 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-97b36d29-e969-4e2a-90a9-028c85ba0747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:15:11.860955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 570/1125] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:15:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:15:12.131088 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0619628-637b-4e0d-8e7f-241be22b634e None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:12.229843 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0619628-637b-4e0d-8e7f-241be22b634e None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:12.249483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:12.263653 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef6837-4078-4e72-b2fd-c21cfc236b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:12.264274 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef6837-4078-4e72-b2fd-c21cfc236b0e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:12.264551 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef6837-4078-4e72-b2fd-c21cfc236b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:12.264819 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef6837-4078-4e72-b2fd-c21cfc236b0e None admin] PATH_INFO: `/v3/roles/9131e2ca337e4d1286ef32a4ba63cafa` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:12.266224 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef6837-4078-4e72-b2fd-c21cfc236b0e None admin] RBAC: Authorizing `identity:get_role(role_id=9131e2ca337e4d1286ef32a4ba63cafa)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:12.267584 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef6837-4078-4e72-b2fd-c21cfc236b0e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:12.268889 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 556/1126] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:15:12 2022] GET /identity/v3/roles/9131e2ca337e4d1286ef32a4ba63cafa => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:12.274737 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b36d29-e969-4e2a-90a9-028c85ba0747 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:12.329821 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:12.374352 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b36d29-e969-4e2a-90a9-028c85ba0747 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:12.406377 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ce01f-6b65-40b9-b181-af93069dc1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:12.406996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ce01f-6b65-40b9-b181-af93069dc1f6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:12.407274 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ce01f-6b65-40b9-b181-af93069dc1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:12.407543 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ce01f-6b65-40b9-b181-af93069dc1f6 None admin] PATH_INFO: `/v3/users/9f830ec2845041b584b6e15d8688c9d4` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:12.408647 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ce01f-6b65-40b9-b181-af93069dc1f6 None admin] RBAC: Authorizing `identity:get_user(user_id=9f830ec2845041b584b6e15d8688c9d4)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:12.410103 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ce01f-6b65-40b9-b181-af93069dc1f6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:12.411658 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 571/1127] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:15:12 2022] GET /identity/v3/users/9f830ec2845041b584b6e15d8688c9d4 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:12.417464 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef6837-4078-4e72-b2fd-c21cfc236b0e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:12.513359 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef6837-4078-4e72-b2fd-c21cfc236b0e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:12.547476 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bdf863-040e-469d-93ff-325ff2d41837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:12.548110 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdf863-040e-469d-93ff-325ff2d41837 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:12.548391 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdf863-040e-469d-93ff-325ff2d41837 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:12.548662 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdf863-040e-469d-93ff-325ff2d41837 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:12.603045 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:12.617222 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bdf863-040e-469d-93ff-325ff2d41837 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:12.618701 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bdf863-040e-469d-93ff-325ff2d41837 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:12.713054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 557/1128] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:15:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 17:15:12.718984 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ce01f-6b65-40b9-b181-af93069dc1f6 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:12.816656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ce01f-6b65-40b9-b181-af93069dc1f6 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:12.839523 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:12.850114 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed88de-7d9b-490c-863d-7c012ec89eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:12.850736 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed88de-7d9b-490c-863d-7c012ec89eda None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:12.851015 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed88de-7d9b-490c-863d-7c012ec89eda None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:12.851287 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed88de-7d9b-490c-863d-7c012ec89eda None admin] PATH_INFO: `/v3/projects/1abdc670121348f5b4b4cd2bf2ddbe73` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:12.852393 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed88de-7d9b-490c-863d-7c012ec89eda None admin] RBAC: Authorizing `identity:get_project(project_id=1abdc670121348f5b4b4cd2bf2ddbe73)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:12.853864 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed88de-7d9b-490c-863d-7c012ec89eda None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:12.855497 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 572/1129] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:15:12 2022] GET /identity/v3/projects/1abdc670121348f5b4b4cd2bf2ddbe73 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:12.862471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bdf863-040e-469d-93ff-325ff2d41837 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:12.945172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:12.957124 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bdf863-040e-469d-93ff-325ff2d41837 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:12.989155 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc11446-d936-4880-a763-fdf8f9b94c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:12.989704 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc11446-d936-4880-a763-fdf8f9b94c7b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:12.989976 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc11446-d936-4880-a763-fdf8f9b94c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:12.990243 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc11446-d936-4880-a763-fdf8f9b94c7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:12.990946 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc11446-d936-4880-a763-fdf8f9b94c7b None admin] RBAC: Adding query filter params (role.id=9131e2ca337e4d1286ef32a4ba63cafa, scope.project.id=1abdc670121348f5b4b4cd2bf2ddbe73, user.id=9f830ec2845041b584b6e15d8688c9d4) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:15:12.991245 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc11446-d936-4880-a763-fdf8f9b94c7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:12.992639 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc11446-d936-4880-a763-fdf8f9b94c7b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:12.998614 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 558/1130] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:15:12 2022] GET /identity/v3/role_assignments?user.id=9f830ec2845041b584b6e15d8688c9d4&scope.project.id=1abdc670121348f5b4b4cd2bf2ddbe73&role.id=9131e2ca337e4d1286ef32a4ba63cafa => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:14.878700 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f1c6a-d260-4a35-8475-58634784a39e None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:14.879238 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f1c6a-d260-4a35-8475-58634784a39e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:14.879238 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f1c6a-d260-4a35-8475-58634784a39e None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:14.880551 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 573/1131] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:15:14.885737 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb4f05-f2a2-4afc-a9e6-ef071d8840fd None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:14.886175 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb4f05-f2a2-4afc-a9e6-ef071d8840fd None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:14.886362 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb4f05-f2a2-4afc-a9e6-ef071d8840fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:14.905329 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-00eb4f05-f2a2-4afc-a9e6-ef071d8840fd None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:15:14.906523 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-00eb4f05-f2a2-4afc-a9e6-ef071d8840fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:15:14.970159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 559/1132] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:15:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:15:15.235903 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f1c6a-d260-4a35-8475-58634784a39e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:15.335894 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f1c6a-d260-4a35-8475-58634784a39e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:15.368664 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d877db-1c1d-4cd3-aeea-637b191aec7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:15.369282 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d877db-1c1d-4cd3-aeea-637b191aec7f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:15.369594 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d877db-1c1d-4cd3-aeea-637b191aec7f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:15.369868 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d877db-1c1d-4cd3-aeea-637b191aec7f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:15.371529 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d877db-1c1d-4cd3-aeea-637b191aec7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:15.372971 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d877db-1c1d-4cd3-aeea-637b191aec7f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:15.374554 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 574/1133] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:15:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:15.380329 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb4f05-f2a2-4afc-a9e6-ef071d8840fd None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:15.458729 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:15.476345 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb4f05-f2a2-4afc-a9e6-ef071d8840fd None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:15.508584 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dde9c7-cf57-45b4-a0d8-c8414ba208ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:15.509118 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dde9c7-cf57-45b4-a0d8-c8414ba208ff None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:15.509391 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dde9c7-cf57-45b4-a0d8-c8414ba208ff None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:15.509695 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dde9c7-cf57-45b4-a0d8-c8414ba208ff None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:15.510336 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dde9c7-cf57-45b4-a0d8-c8414ba208ff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:15.512252 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dde9c7-cf57-45b4-a0d8-c8414ba208ff None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:15.539890 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 560/1134] 10.222.0.94 () {60 vars in 1141 bytes} [Thu Sep 1 17:15:15 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:15:17.474166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe892b4-a749-4028-9c72-d6304aa32eef None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:17.474701 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe892b4-a749-4028-9c72-d6304aa32eef None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:17.474701 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe892b4-a749-4028-9c72-d6304aa32eef None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:17.476030 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 575/1135] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:15:17.481856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea518e5-6223-4292-abdd-9b089a9d66e7 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:17.482282 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea518e5-6223-4292-abdd-9b089a9d66e7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:17.482414 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea518e5-6223-4292-abdd-9b089a9d66e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:17.500227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5ea518e5-6223-4292-abdd-9b089a9d66e7 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:15:17.501427 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5ea518e5-6223-4292-abdd-9b089a9d66e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:15:17.566530 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 561/1136] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:15:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:15:17.842571 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe892b4-a749-4028-9c72-d6304aa32eef None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:17.900769 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:17.941357 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe892b4-a749-4028-9c72-d6304aa32eef None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:17.974439 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba46453-a31f-4595-ae64-bee702800696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:17.975052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba46453-a31f-4595-ae64-bee702800696 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:17.975330 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba46453-a31f-4595-ae64-bee702800696 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:17.975598 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba46453-a31f-4595-ae64-bee702800696 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:17.976693 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba46453-a31f-4595-ae64-bee702800696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:17.978145 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba46453-a31f-4595-ae64-bee702800696 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:17.979676 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 576/1137] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:15:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:15:17.985445 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea518e5-6223-4292-abdd-9b089a9d66e7 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:18.046101 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:18.082546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea518e5-6223-4292-abdd-9b089a9d66e7 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:18.115241 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75eadd-7993-4475-88d2-8133d4d9bff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:18.115770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75eadd-7993-4475-88d2-8133d4d9bff4 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:18.116044 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75eadd-7993-4475-88d2-8133d4d9bff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:18.116308 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75eadd-7993-4475-88d2-8133d4d9bff4 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:18.116934 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa75eadd-7993-4475-88d2-8133d4d9bff4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:18.118362 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa75eadd-7993-4475-88d2-8133d4d9bff4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:18.138461 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 562/1138] 10.222.0.94 () {60 vars in 1132 bytes} [Thu Sep 1 17:15:17 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:15:20.041726 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732ff45-36e6-425d-8627-ab8bb83c7c22 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:20.042294 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732ff45-36e6-425d-8627-ab8bb83c7c22 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:20.042294 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732ff45-36e6-425d-8627-ab8bb83c7c22 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:20.044099 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 577/1139] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:15:20.049358 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27252d-0574-46dd-8a32-762f7789f5d0 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:20.049805 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27252d-0574-46dd-8a32-762f7789f5d0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:20.049937 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27252d-0574-46dd-8a32-762f7789f5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:20.068209 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-4b27252d-0574-46dd-8a32-762f7789f5d0 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:15:20.069383 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4b27252d-0574-46dd-8a32-762f7789f5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:15:20.134357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 563/1140] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:15:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:15:20.397282 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732ff45-36e6-425d-8627-ab8bb83c7c22 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:20.496097 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732ff45-36e6-425d-8627-ab8bb83c7c22 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:20.521636 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:20.530034 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad70fd9-8e3f-443f-ac92-a76b4355d4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:20.530670 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad70fd9-8e3f-443f-ac92-a76b4355d4a6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:20.530952 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad70fd9-8e3f-443f-ac92-a76b4355d4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:20.531226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad70fd9-8e3f-443f-ac92-a76b4355d4a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:20.543560 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad70fd9-8e3f-443f-ac92-a76b4355d4a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:15:20.548370 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-fad70fd9-8e3f-443f-ac92-a76b4355d4a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:15:20.548370 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:15:20.548370 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:15:20.548370 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:15:20.548370 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:15:20.548370 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:15:20.548370 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:15:20.548370 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:15:20.548370 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:15:20.548370 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:15:20.548370 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:15:20.548370 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:15:20.548370 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:15:20.548370 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:15:20.548370 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:15:20.548370 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:15:20.549642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:15:20.549642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:15:20.549642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:15:20.549642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:15:20.549642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:15:20.549642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:15:20.549642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:15:20.549642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:15:20.549642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:15:20.549642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:15:20.549642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:15:20.549642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:15:20.549642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:15:20.549642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:15:20.549642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:15:20.549642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:15:20.550741 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:15:20.550741 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:15:20.550741 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:15:20.550741 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:15:20.550741 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:15:20.550741 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:15:20.550741 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:15:20.550741 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:15:20.550741 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:15:20.550741 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:15:20.550741 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:15:20.550741 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:15:20.550741 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 578/1141] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:15:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:15:20.555420 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27252d-0574-46dd-8a32-762f7789f5d0 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:20.602558 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:20.650272 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27252d-0574-46dd-8a32-762f7789f5d0 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:20.682297 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6f368-8b0f-40ff-91a7-b54a7d0bf40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:20.682888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6f368-8b0f-40ff-91a7-b54a7d0bf40c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:20.683182 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6f368-8b0f-40ff-91a7-b54a7d0bf40c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:20.683984 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6f368-8b0f-40ff-91a7-b54a7d0bf40c None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:20.684637 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6f368-8b0f-40ff-91a7-b54a7d0bf40c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:15:20.684932 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6f368-8b0f-40ff-91a7-b54a7d0bf40c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:20.686309 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6f368-8b0f-40ff-91a7-b54a7d0bf40c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:20.693934 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 564/1142] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:15:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:20.699986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad70fd9-8e3f-443f-ac92-a76b4355d4a6 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:20.796081 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad70fd9-8e3f-443f-ac92-a76b4355d4a6 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:20.829492 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae53a1-0366-40c0-973f-fc279da0c8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:20.830106 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae53a1-0366-40c0-973f-fc279da0c8ce None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:20.830386 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae53a1-0366-40c0-973f-fc279da0c8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:20.830655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae53a1-0366-40c0-973f-fc279da0c8ce None admin] PATH_INFO: `/v3/users/5de329fe03284d9fa72bb3299cc73601` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:20.843195 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae53a1-0366-40c0-973f-fc279da0c8ce None admin] RBAC: Authorizing `identity:get_user(user_id=5de329fe03284d9fa72bb3299cc73601)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:20.844624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae53a1-0366-40c0-973f-fc279da0c8ce None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:20.846293 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 579/1143] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:15:20 2022] GET /identity/v3/users/5de329fe03284d9fa72bb3299cc73601 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:20.852114 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6f368-8b0f-40ff-91a7-b54a7d0bf40c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:20.947351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6f368-8b0f-40ff-91a7-b54a7d0bf40c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:20.961230 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:20.982908 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16436a-0d9d-47eb-b026-5f20255052ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:20.983505 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16436a-0d9d-47eb-b026-5f20255052ac None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:20.983779 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16436a-0d9d-47eb-b026-5f20255052ac None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:20.984045 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16436a-0d9d-47eb-b026-5f20255052ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:21.049879 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16436a-0d9d-47eb-b026-5f20255052ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:21.051317 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16436a-0d9d-47eb-b026-5f20255052ac None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:21.144978 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 565/1144] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:15:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 17:15:21.151057 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae53a1-0366-40c0-973f-fc279da0c8ce None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:21.195902 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:21.247259 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae53a1-0366-40c0-973f-fc279da0c8ce None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:21.279425 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1338f0b-b0ae-417f-9684-c777ea202e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:21.280039 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1338f0b-b0ae-417f-9684-c777ea202e38 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:21.280314 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1338f0b-b0ae-417f-9684-c777ea202e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:21.280581 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1338f0b-b0ae-417f-9684-c777ea202e38 None admin] PATH_INFO: `/v3/projects/3e255ca00f7a4873bdc0c525919fc0c0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:21.281705 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1338f0b-b0ae-417f-9684-c777ea202e38 None admin] RBAC: Authorizing `identity:get_project(project_id=3e255ca00f7a4873bdc0c525919fc0c0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:21.283124 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1338f0b-b0ae-417f-9684-c777ea202e38 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:21.284718 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 580/1145] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:15:21 2022] GET /identity/v3/projects/3e255ca00f7a4873bdc0c525919fc0c0 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:21.290683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16436a-0d9d-47eb-b026-5f20255052ac None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:21.304331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:21.394322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16436a-0d9d-47eb-b026-5f20255052ac None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:21.427836 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3735b0-d648-4bd5-b8f4-05fe242a8f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:21.428424 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3735b0-d648-4bd5-b8f4-05fe242a8f6c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:21.428698 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3735b0-d648-4bd5-b8f4-05fe242a8f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:21.428963 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3735b0-d648-4bd5-b8f4-05fe242a8f6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:21.429693 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3735b0-d648-4bd5-b8f4-05fe242a8f6c None admin] RBAC: Adding query filter params (role.id=70f911a75b7b40a19f65857b9d19cfad, scope.project.id=3e255ca00f7a4873bdc0c525919fc0c0, user.id=5de329fe03284d9fa72bb3299cc73601) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:15:21.429993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3735b0-d648-4bd5-b8f4-05fe242a8f6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:21.431397 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3735b0-d648-4bd5-b8f4-05fe242a8f6c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:21.437061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 566/1146] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:15:21 2022] GET /identity/v3/role_assignments?user.id=5de329fe03284d9fa72bb3299cc73601&scope.project.id=3e255ca00f7a4873bdc0c525919fc0c0&role.id=70f911a75b7b40a19f65857b9d19cfad => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:23.296918 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19fcfb-4921-4981-a787-92645181d3cf None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:23.297469 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19fcfb-4921-4981-a787-92645181d3cf None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:23.297563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19fcfb-4921-4981-a787-92645181d3cf None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:23.298835 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 581/1147] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:15:23.304070 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325919f6-3614-4ca5-bdc1-5476bc144fcb None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:23.304440 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325919f6-3614-4ca5-bdc1-5476bc144fcb None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:23.304613 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325919f6-3614-4ca5-bdc1-5476bc144fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:23.322676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-325919f6-3614-4ca5-bdc1-5476bc144fcb None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:15:23.324405 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-325919f6-3614-4ca5-bdc1-5476bc144fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:15:23.388212 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 567/1148] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:15:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:15:23.655717 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19fcfb-4921-4981-a787-92645181d3cf None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:23.754162 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19fcfb-4921-4981-a787-92645181d3cf None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:23.767792 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:23.787107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb897a-cb5d-49b4-b7c8-affe28cb7bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:23.787718 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb897a-cb5d-49b4-b7c8-affe28cb7bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:23.787990 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb897a-cb5d-49b4-b7c8-affe28cb7bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:23.788256 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb897a-cb5d-49b4-b7c8-affe28cb7bf3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:23.798437 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb897a-cb5d-49b4-b7c8-affe28cb7bf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:15:23.803169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-1dbb897a-cb5d-49b4-b7c8-affe28cb7bf3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:15:23.803169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:15:23.803169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:15:23.803169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:15:23.803169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:15:23.803169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:15:23.803169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:15:23.803169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:15:23.803169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:15:23.803169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:15:23.803169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:15:23.803169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:15:23.803169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:15:23.803169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:15:23.803169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:15:23.803169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:15:23.804244 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:15:23.804244 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:15:23.804244 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:15:23.804244 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:15:23.804244 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:15:23.804244 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:15:23.804244 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:15:23.804244 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:15:23.804244 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:15:23.804244 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:15:23.804244 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:15:23.804244 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:15:23.804244 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:15:23.804244 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:15:23.804244 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:15:23.804244 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:15:23.805257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:15:23.805257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:15:23.805257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:15:23.805257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:15:23.805257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:15:23.805257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:15:23.805257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:15:23.805257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:15:23.805257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:15:23.805257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:15:23.805257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:15:23.805257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:15:23.805257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 582/1149] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:15:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:15:23.810660 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325919f6-3614-4ca5-bdc1-5476bc144fcb None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:23.818687 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:23.906151 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325919f6-3614-4ca5-bdc1-5476bc144fcb None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:23.938376 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e686a0-e300-4d6d-97e9-c5a6787d52d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:23.938968 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e686a0-e300-4d6d-97e9-c5a6787d52d2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:23.939243 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e686a0-e300-4d6d-97e9-c5a6787d52d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:23.939513 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e686a0-e300-4d6d-97e9-c5a6787d52d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:23.940165 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e686a0-e300-4d6d-97e9-c5a6787d52d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:15:23.940464 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e686a0-e300-4d6d-97e9-c5a6787d52d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:23.941840 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e686a0-e300-4d6d-97e9-c5a6787d52d2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:23.950177 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 568/1150] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:15:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:15:23.956055 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb897a-cb5d-49b4-b7c8-affe28cb7bf3 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:24.051026 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb897a-cb5d-49b4-b7c8-affe28cb7bf3 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:24.084425 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ecf2e-9bc3-4343-9152-e2f11044cd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:24.085032 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ecf2e-9bc3-4343-9152-e2f11044cd3b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:24.085308 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ecf2e-9bc3-4343-9152-e2f11044cd3b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:24.085606 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ecf2e-9bc3-4343-9152-e2f11044cd3b None admin] PATH_INFO: `/v3/users/5de329fe03284d9fa72bb3299cc73601` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:24.086702 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ecf2e-9bc3-4343-9152-e2f11044cd3b None admin] RBAC: Authorizing `identity:get_user(user_id=5de329fe03284d9fa72bb3299cc73601)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:24.088124 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ecf2e-9bc3-4343-9152-e2f11044cd3b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:24.089693 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 583/1151] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:15:23 2022] GET /identity/v3/users/5de329fe03284d9fa72bb3299cc73601 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:24.095142 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e686a0-e300-4d6d-97e9-c5a6787d52d2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:24.159608 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:24.191925 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e686a0-e300-4d6d-97e9-c5a6787d52d2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:24.224083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c37988-c811-475f-bb8f-cfddc03bf733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:24.224693 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c37988-c811-475f-bb8f-cfddc03bf733 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:24.224976 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c37988-c811-475f-bb8f-cfddc03bf733 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:24.225246 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c37988-c811-475f-bb8f-cfddc03bf733 None admin] PATH_INFO: `/v3/projects/3e255ca00f7a4873bdc0c525919fc0c0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:24.226371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c37988-c811-475f-bb8f-cfddc03bf733 None admin] RBAC: Authorizing `identity:get_project(project_id=3e255ca00f7a4873bdc0c525919fc0c0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:24.227778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c37988-c811-475f-bb8f-cfddc03bf733 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:24.229379 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 569/1152] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:15:24 2022] GET /identity/v3/projects/3e255ca00f7a4873bdc0c525919fc0c0 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:24.235213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ecf2e-9bc3-4343-9152-e2f11044cd3b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:24.277522 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:24.332261 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ecf2e-9bc3-4343-9152-e2f11044cd3b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:24.365186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924aebf2-da94-40ca-a38d-1d1dd1137c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:24.365854 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924aebf2-da94-40ca-a38d-1d1dd1137c43 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:24.366131 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924aebf2-da94-40ca-a38d-1d1dd1137c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:24.366396 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924aebf2-da94-40ca-a38d-1d1dd1137c43 None admin] PATH_INFO: `/v3/projects/3e255ca00f7a4873bdc0c525919fc0c0/users/5de329fe03284d9fa72bb3299cc73601/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:24.368245 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924aebf2-da94-40ca-a38d-1d1dd1137c43 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e255ca00f7a4873bdc0c525919fc0c0, user_id=5de329fe03284d9fa72bb3299cc73601, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:24.369695 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924aebf2-da94-40ca-a38d-1d1dd1137c43 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:24.382607 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 584/1153] 10.222.0.94 () {58 vars in 1439 bytes} [Thu Sep 1 17:15:24 2022] PUT /identity/v3/projects/3e255ca00f7a4873bdc0c525919fc0c0/users/5de329fe03284d9fa72bb3299cc73601/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:15:26.247918 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac4292-029f-4af3-b722-23c11d7433a7 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:26.248448 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac4292-029f-4af3-b722-23c11d7433a7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:26.248448 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac4292-029f-4af3-b722-23c11d7433a7 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:26.249797 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 570/1154] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:15:26.254781 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa9792-b98f-4801-ad62-8f9d17ca742b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:26.255194 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa9792-b98f-4801-ad62-8f9d17ca742b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:26.255332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa9792-b98f-4801-ad62-8f9d17ca742b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:26.273804 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-60fa9792-b98f-4801-ad62-8f9d17ca742b None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:15:26.274995 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-60fa9792-b98f-4801-ad62-8f9d17ca742b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:15:26.339731 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 585/1155] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:15:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:15:26.608703 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac4292-029f-4af3-b722-23c11d7433a7 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:26.706071 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac4292-029f-4af3-b722-23c11d7433a7 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:26.739311 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be5052-1799-4fd7-9932-11513ec84df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:26.739913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be5052-1799-4fd7-9932-11513ec84df3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:26.740186 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be5052-1799-4fd7-9932-11513ec84df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:26.740452 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be5052-1799-4fd7-9932-11513ec84df3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:26.743026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:26.751027 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be5052-1799-4fd7-9932-11513ec84df3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:15:26.755763 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-79be5052-1799-4fd7-9932-11513ec84df3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:15:26.755763 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:15:26.755763 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:15:26.755763 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:15:26.755763 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:15:26.755763 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:15:26.755763 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:15:26.755763 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:15:26.755763 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:15:26.755763 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:15:26.755763 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:15:26.755763 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:15:26.755763 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:15:26.755763 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:15:26.755763 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:15:26.755763 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:15:26.756869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:15:26.756869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:15:26.756869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:15:26.756869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:15:26.756869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:15:26.756869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:15:26.756869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:15:26.756869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:15:26.756869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:15:26.756869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:15:26.756869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:15:26.756869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:15:26.756869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:15:26.756869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:15:26.756869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:15:26.756869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:15:26.757910 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:15:26.757910 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:15:26.757910 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:15:26.757910 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:15:26.757910 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:15:26.757910 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:15:26.757910 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:15:26.757910 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:15:26.757910 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:15:26.757910 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:15:26.757910 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:15:26.757910 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:15:26.757910 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 571/1156] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:15:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:15:26.763401 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa9792-b98f-4801-ad62-8f9d17ca742b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:26.792895 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:26.858818 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa9792-b98f-4801-ad62-8f9d17ca742b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:26.894006 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8148c-3248-45ce-9915-f64b50e9352e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:26.894610 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8148c-3248-45ce-9915-f64b50e9352e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:26.894887 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8148c-3248-45ce-9915-f64b50e9352e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:26.895153 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8148c-3248-45ce-9915-f64b50e9352e None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:26.895838 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8148c-3248-45ce-9915-f64b50e9352e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:15:26.896139 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8148c-3248-45ce-9915-f64b50e9352e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:26.897530 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8148c-3248-45ce-9915-f64b50e9352e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:26.905991 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 586/1157] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:15:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:26.911836 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be5052-1799-4fd7-9932-11513ec84df3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:27.013986 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be5052-1799-4fd7-9932-11513ec84df3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:27.046625 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e80c1-7e32-4708-a97e-896cae6b3516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:27.047172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e80c1-7e32-4708-a97e-896cae6b3516 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:27.047444 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e80c1-7e32-4708-a97e-896cae6b3516 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:27.047707 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e80c1-7e32-4708-a97e-896cae6b3516 None admin] PATH_INFO: `/v3/users/5de329fe03284d9fa72bb3299cc73601` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:27.048792 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e80c1-7e32-4708-a97e-896cae6b3516 None admin] RBAC: Authorizing `identity:get_user(user_id=5de329fe03284d9fa72bb3299cc73601)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:27.050223 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e80c1-7e32-4708-a97e-896cae6b3516 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:27.051762 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 572/1158] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:15:26 2022] GET /identity/v3/users/5de329fe03284d9fa72bb3299cc73601 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:27.057844 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8148c-3248-45ce-9915-f64b50e9352e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:27.148249 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:27.155236 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8148c-3248-45ce-9915-f64b50e9352e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:27.187468 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23a4c2-74ad-410e-b08b-188483b09040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:27.188062 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23a4c2-74ad-410e-b08b-188483b09040 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:27.188340 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23a4c2-74ad-410e-b08b-188483b09040 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:27.188612 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23a4c2-74ad-410e-b08b-188483b09040 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:27.252900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23a4c2-74ad-410e-b08b-188483b09040 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:27.254367 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23a4c2-74ad-410e-b08b-188483b09040 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:27.345628 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:27.353686 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 587/1159] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:15:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 17:15:27.360050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e80c1-7e32-4708-a97e-896cae6b3516 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:27.420654 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:27.457818 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e80c1-7e32-4708-a97e-896cae6b3516 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:27.491119 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fd962-951c-49fb-8377-e9ca72bb39b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:27.491733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fd962-951c-49fb-8377-e9ca72bb39b2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:27.492008 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fd962-951c-49fb-8377-e9ca72bb39b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:27.492278 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fd962-951c-49fb-8377-e9ca72bb39b2 None admin] PATH_INFO: `/v3/projects/3e255ca00f7a4873bdc0c525919fc0c0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:27.493373 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2fd962-951c-49fb-8377-e9ca72bb39b2 None admin] RBAC: Authorizing `identity:get_project(project_id=3e255ca00f7a4873bdc0c525919fc0c0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:27.494823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2fd962-951c-49fb-8377-e9ca72bb39b2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:27.497005 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 573/1160] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:15:27 2022] GET /identity/v3/projects/3e255ca00f7a4873bdc0c525919fc0c0 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:27.503006 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23a4c2-74ad-410e-b08b-188483b09040 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:27.599352 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23a4c2-74ad-410e-b08b-188483b09040 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:27.630824 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db10c6e-de09-4c79-aa2c-00375cd1cfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:27.631412 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db10c6e-de09-4c79-aa2c-00375cd1cfd2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:27.631687 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db10c6e-de09-4c79-aa2c-00375cd1cfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:27.631953 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db10c6e-de09-4c79-aa2c-00375cd1cfd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:27.632662 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db10c6e-de09-4c79-aa2c-00375cd1cfd2 None admin] RBAC: Adding query filter params (role.id=70f911a75b7b40a19f65857b9d19cfad, scope.project.id=3e255ca00f7a4873bdc0c525919fc0c0, user.id=5de329fe03284d9fa72bb3299cc73601) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:15:27.632965 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db10c6e-de09-4c79-aa2c-00375cd1cfd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:27.634411 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db10c6e-de09-4c79-aa2c-00375cd1cfd2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:27.640414 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 588/1161] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:15:27 2022] GET /identity/v3/role_assignments?user.id=5de329fe03284d9fa72bb3299cc73601&scope.project.id=3e255ca00f7a4873bdc0c525919fc0c0&role.id=70f911a75b7b40a19f65857b9d19cfad => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:29.537698 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e894c-494c-4594-9fe5-73620ce93da5 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:29.538129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e894c-494c-4594-9fe5-73620ce93da5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:29.538249 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e894c-494c-4594-9fe5-73620ce93da5 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:29.539618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 574/1162] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:15:29.545447 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f79d5-e82d-4a85-9197-a24ebc630abf None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:29.545846 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f79d5-e82d-4a85-9197-a24ebc630abf None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:29.545988 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f79d5-e82d-4a85-9197-a24ebc630abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:29.564488 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a24f79d5-e82d-4a85-9197-a24ebc630abf None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:15:29.565694 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a24f79d5-e82d-4a85-9197-a24ebc630abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:15:29.616231 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:29.629676 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 589/1163] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:15:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:15:29.895608 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e894c-494c-4594-9fe5-73620ce93da5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:29.993643 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e894c-494c-4594-9fe5-73620ce93da5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:30.022048 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:30.027139 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e64f26-6586-4ce3-9e91-e0312ecf3948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:30.027740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e64f26-6586-4ce3-9e91-e0312ecf3948 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:30.028020 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e64f26-6586-4ce3-9e91-e0312ecf3948 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:30.028294 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e64f26-6586-4ce3-9e91-e0312ecf3948 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:30.092424 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e64f26-6586-4ce3-9e91-e0312ecf3948 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:30.093893 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e64f26-6586-4ce3-9e91-e0312ecf3948 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:30.187740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 575/1164] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:15:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 17:15:30.193637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f79d5-e82d-4a85-9197-a24ebc630abf None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:30.289413 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f79d5-e82d-4a85-9197-a24ebc630abf None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:30.322368 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a419a2-a7c4-4539-98b7-b215a9956544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:30.322983 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a419a2-a7c4-4539-98b7-b215a9956544 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:30.323258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a419a2-a7c4-4539-98b7-b215a9956544 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:30.324047 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a419a2-a7c4-4539-98b7-b215a9956544 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:30.330769 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a419a2-a7c4-4539-98b7-b215a9956544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:30.332190 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a419a2-a7c4-4539-98b7-b215a9956544 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:30.343986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-62a419a2-a7c4-4539-98b7-b215a9956544 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 17:15:30.343986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:15:30.343986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 01 17:15:30.343986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 01 17:15:30.343986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:15:30.343986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:15:30.343986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:15:30.343986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:15:30.343986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 01 17:15:30.343986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:15:30.343986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:15:30.343986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:15:30.343986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:15:30.343986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:15:30.343986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:15:30.343986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:15:30.343986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:15:30.345234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:15:30.345234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:15:30.345234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:15:30.345234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:15:30.345234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:15:30.345234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:15:30.345234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:15:30.345234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:15:30.345234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:15:30.345234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:15:30.345234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:15:30.345234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:15:30.345234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:15:30.345234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:15:30.345234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:15:30.345234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:15:30.346169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:15:30.346169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:15:30.346169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:15:30.346169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:15:30.346169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:15:30.346169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:15:30.346169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:15:30.346169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:15:30.346169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:15:30.346169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:15:30.346169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 01 17:15:30.346169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:15:30.346169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 17:15:30.346169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:15:30.346169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 590/1165] 10.222.0.94 () {56 vars in 1117 bytes} [Thu Sep 1 17:15:30 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:15:30.350916 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e64f26-6586-4ce3-9e91-e0312ecf3948 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:30.380151 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:30.454980 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e64f26-6586-4ce3-9e91-e0312ecf3948 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:30.487378 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0bd84-82b7-42e7-83bd-700a3864186d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:30.487970 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0bd84-82b7-42e7-83bd-700a3864186d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:30.488250 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0bd84-82b7-42e7-83bd-700a3864186d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:30.488524 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0bd84-82b7-42e7-83bd-700a3864186d None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:30.489163 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0bd84-82b7-42e7-83bd-700a3864186d None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:15:30.489493 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0bd84-82b7-42e7-83bd-700a3864186d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:30.490847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0bd84-82b7-42e7-83bd-700a3864186d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:30.497756 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 576/1166] 10.222.0.94 () {56 vars in 1115 bytes} [Thu Sep 1 17:15:30 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:32.383069 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406ece7-7a9f-40b3-a827-196375e63099 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:32.383619 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406ece7-7a9f-40b3-a827-196375e63099 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:32.383619 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406ece7-7a9f-40b3-a827-196375e63099 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:32.384987 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 591/1167] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:15:32.390685 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c69d9-4a6a-466c-befb-008550cdc728 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:32.391090 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c69d9-4a6a-466c-befb-008550cdc728 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:32.391226 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c69d9-4a6a-466c-befb-008550cdc728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:32.409980 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f80c69d9-4a6a-466c-befb-008550cdc728 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:15:32.411184 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f80c69d9-4a6a-466c-befb-008550cdc728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:15:32.476516 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 577/1168] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:15:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:15:32.751125 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406ece7-7a9f-40b3-a827-196375e63099 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:32.801350 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:32.850468 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406ece7-7a9f-40b3-a827-196375e63099 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:32.882793 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db324bd1-6f87-45b5-9829-c11205ae3c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:32.883377 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db324bd1-6f87-45b5-9829-c11205ae3c88 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:32.883652 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db324bd1-6f87-45b5-9829-c11205ae3c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:32.883918 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db324bd1-6f87-45b5-9829-c11205ae3c88 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:32.884568 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db324bd1-6f87-45b5-9829-c11205ae3c88 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:32.885977 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db324bd1-6f87-45b5-9829-c11205ae3c88 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:32.900812 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 592/1169] 10.222.0.94 () {60 vars in 1138 bytes} [Thu Sep 1 17:15:32 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:15:34.811937 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b1043-d1d1-4803-a72c-c2f333557ca1 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:34.812464 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b1043-d1d1-4803-a72c-c2f333557ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:34.812464 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b1043-d1d1-4803-a72c-c2f333557ca1 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:34.813788 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 578/1170] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:15:34.818855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c7bdf-c4fd-4920-93cc-57d51a48444f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:34.819244 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c7bdf-c4fd-4920-93cc-57d51a48444f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:34.819404 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c7bdf-c4fd-4920-93cc-57d51a48444f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:34.838037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-028c7bdf-c4fd-4920-93cc-57d51a48444f None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:15:34.839378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-028c7bdf-c4fd-4920-93cc-57d51a48444f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:15:34.903948 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 593/1171] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:15:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:15:35.171488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b1043-d1d1-4803-a72c-c2f333557ca1 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:35.199226 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:35.270753 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b1043-d1d1-4803-a72c-c2f333557ca1 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:35.302530 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5f904-a526-4b94-9996-45588d458036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:35.303141 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5f904-a526-4b94-9996-45588d458036 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:35.303419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5f904-a526-4b94-9996-45588d458036 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:35.303690 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5f904-a526-4b94-9996-45588d458036 None admin] PATH_INFO: `/v3/domains/ddbde3866be043419e12c6fa0551b188` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:35.314225 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5f904-a526-4b94-9996-45588d458036 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ddbde3866be043419e12c6fa0551b188)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:35.315659 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5f904-a526-4b94-9996-45588d458036 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:35.317219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 579/1172] 10.222.0.94 () {56 vars in 1183 bytes} [Thu Sep 1 17:15:35 2022] GET /identity/v3/domains/ddbde3866be043419e12c6fa0551b188 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:35.322958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c7bdf-c4fd-4920-93cc-57d51a48444f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:35.361133 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:35.417713 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c7bdf-c4fd-4920-93cc-57d51a48444f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:35.449756 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9878011-d5a3-4de9-8fc4-085fe4f4b5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:35.450288 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9878011-d5a3-4de9-8fc4-085fe4f4b5ad None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:35.450560 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9878011-d5a3-4de9-8fc4-085fe4f4b5ad None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:35.450825 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9878011-d5a3-4de9-8fc4-085fe4f4b5ad None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:35.451458 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9878011-d5a3-4de9-8fc4-085fe4f4b5ad None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:35.452871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9878011-d5a3-4de9-8fc4-085fe4f4b5ad None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:35.478315 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 594/1173] 10.222.0.94 () {60 vars in 1141 bytes} [Thu Sep 1 17:15:35 2022] POST /identity/v3/projects => generated 361 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:15:37.397202 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c3028-70be-4651-b6ee-92175d5f8ca6 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:37.397792 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c3028-70be-4651-b6ee-92175d5f8ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:37.397792 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c3028-70be-4651-b6ee-92175d5f8ca6 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:37.399112 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 580/1174] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:15:37.404964 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c2549-4e9b-44e6-a2c8-3a869e8a077d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:37.405367 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c2549-4e9b-44e6-a2c8-3a869e8a077d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:37.405570 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c2549-4e9b-44e6-a2c8-3a869e8a077d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:37.423404 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-449c2549-4e9b-44e6-a2c8-3a869e8a077d None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:15:37.424619 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-449c2549-4e9b-44e6-a2c8-3a869e8a077d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:15:37.490110 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 595/1175] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:15:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:15:37.763930 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c3028-70be-4651-b6ee-92175d5f8ca6 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:37.846499 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:37.862435 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c3028-70be-4651-b6ee-92175d5f8ca6 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:37.900779 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618086e0-2517-412d-aed3-5e12568de2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:37.902010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618086e0-2517-412d-aed3-5e12568de2b7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:37.902293 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618086e0-2517-412d-aed3-5e12568de2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:37.902558 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618086e0-2517-412d-aed3-5e12568de2b7 None admin] PATH_INFO: `/v3/domains/ddbde3866be043419e12c6fa0551b188` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:37.903659 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618086e0-2517-412d-aed3-5e12568de2b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ddbde3866be043419e12c6fa0551b188)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:37.905074 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618086e0-2517-412d-aed3-5e12568de2b7 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:37.906687 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 581/1176] 10.222.0.94 () {56 vars in 1183 bytes} [Thu Sep 1 17:15:37 2022] GET /identity/v3/domains/ddbde3866be043419e12c6fa0551b188 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:37.912397 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c2549-4e9b-44e6-a2c8-3a869e8a077d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:37.932579 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:38.008046 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c2549-4e9b-44e6-a2c8-3a869e8a077d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:38.041028 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4a5a9-be2b-4a46-854b-52396c2781af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:38.041598 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4a5a9-be2b-4a46-854b-52396c2781af None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:38.041880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4a5a9-be2b-4a46-854b-52396c2781af None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:38.042152 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4a5a9-be2b-4a46-854b-52396c2781af None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:38.042792 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4a5a9-be2b-4a46-854b-52396c2781af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:38.044220 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4a5a9-be2b-4a46-854b-52396c2781af None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:38.064950 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 596/1177] 10.222.0.94 () {60 vars in 1132 bytes} [Thu Sep 1 17:15:37 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:15:40.003205 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0c1e2-e8a5-4f55-a118-1c78f395d853 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:40.003781 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0c1e2-e8a5-4f55-a118-1c78f395d853 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:40.003781 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0c1e2-e8a5-4f55-a118-1c78f395d853 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:40.005074 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 582/1178] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:15:40.010074 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dee2e1-f149-499e-b7f7-2f30d7ca3403 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:40.010521 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dee2e1-f149-499e-b7f7-2f30d7ca3403 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:40.010645 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dee2e1-f149-499e-b7f7-2f30d7ca3403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:40.028662 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-39dee2e1-f149-499e-b7f7-2f30d7ca3403 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:15:40.029865 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-39dee2e1-f149-499e-b7f7-2f30d7ca3403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:15:40.093253 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 597/1179] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:15:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:15:40.359292 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0c1e2-e8a5-4f55-a118-1c78f395d853 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:40.457331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0c1e2-e8a5-4f55-a118-1c78f395d853 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:40.489470 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019c47f-70e3-4724-85d6-eabef41bdfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:40.490079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019c47f-70e3-4724-85d6-eabef41bdfaa None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:40.490356 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019c47f-70e3-4724-85d6-eabef41bdfaa None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:40.490626 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019c47f-70e3-4724-85d6-eabef41bdfaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:40.500679 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019c47f-70e3-4724-85d6-eabef41bdfaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:15:40.505446 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-3019c47f-70e3-4724-85d6-eabef41bdfaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:15:40.505446 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:15:40.505446 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:15:40.505446 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:15:40.505446 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:15:40.505446 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:15:40.505446 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:15:40.505446 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:15:40.505446 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:15:40.505446 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:15:40.505446 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:15:40.505446 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:15:40.505446 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:15:40.505446 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:15:40.505446 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:15:40.505446 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:15:40.506630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:15:40.506630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:15:40.506630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:15:40.506630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:15:40.506630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:15:40.506630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:15:40.506630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:15:40.506630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:15:40.506630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:15:40.506630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:15:40.506630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:15:40.506630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:15:40.506630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:15:40.506630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:15:40.506630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:15:40.506630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:15:40.507689 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:15:40.507689 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:15:40.507689 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:15:40.507689 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:15:40.507689 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:15:40.507689 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:15:40.507689 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:15:40.507689 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:15:40.507689 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:15:40.507689 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:15:40.507689 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:15:40.507689 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:15:40.507689 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 583/1180] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:15:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:15:40.512880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dee2e1-f149-499e-b7f7-2f30d7ca3403 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:40.520770 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:40.610603 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dee2e1-f149-499e-b7f7-2f30d7ca3403 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:40.651564 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbe532-a16e-424c-97b7-3bddee4dfae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:40.652168 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbe532-a16e-424c-97b7-3bddee4dfae8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:40.652444 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbe532-a16e-424c-97b7-3bddee4dfae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:40.652713 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbe532-a16e-424c-97b7-3bddee4dfae8 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:40.653371 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafbe532-a16e-424c-97b7-3bddee4dfae8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:15:40.653770 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafbe532-a16e-424c-97b7-3bddee4dfae8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:40.655140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafbe532-a16e-424c-97b7-3bddee4dfae8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:40.663099 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 598/1181] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:15:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:40.669013 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019c47f-70e3-4724-85d6-eabef41bdfaa None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:40.685625 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:40.766126 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019c47f-70e3-4724-85d6-eabef41bdfaa None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:40.798262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297dd67c-664c-4fc0-b088-03c71975f14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:40.798878 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dd67c-664c-4fc0-b088-03c71975f14a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:40.799153 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dd67c-664c-4fc0-b088-03c71975f14a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:40.799424 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dd67c-664c-4fc0-b088-03c71975f14a None admin] PATH_INFO: `/v3/users/79f001da883c4124b53513050794c09a` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:40.812966 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297dd67c-664c-4fc0-b088-03c71975f14a None admin] RBAC: Authorizing `identity:get_user(user_id=79f001da883c4124b53513050794c09a)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:40.814426 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297dd67c-664c-4fc0-b088-03c71975f14a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:40.815991 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 584/1182] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:15:40 2022] GET /identity/v3/users/79f001da883c4124b53513050794c09a => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:40.822002 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbe532-a16e-424c-97b7-3bddee4dfae8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:40.887222 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:40.922909 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbe532-a16e-424c-97b7-3bddee4dfae8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:40.955276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e706a-2ee4-4ef3-bbd8-4db95fda76c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:40.955873 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e706a-2ee4-4ef3-bbd8-4db95fda76c7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:40.956158 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e706a-2ee4-4ef3-bbd8-4db95fda76c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:40.956427 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e706a-2ee4-4ef3-bbd8-4db95fda76c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:41.025158 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e706a-2ee4-4ef3-bbd8-4db95fda76c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:41.026993 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e706a-2ee4-4ef3-bbd8-4db95fda76c7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:41.088092 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:41.122850 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 599/1183] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:15:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 17:15:41.128808 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297dd67c-664c-4fc0-b088-03c71975f14a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:41.196332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:41.226039 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297dd67c-664c-4fc0-b088-03c71975f14a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:41.258032 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c21b7c-dbbf-498a-afa0-8deff635a568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:41.258643 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c21b7c-dbbf-498a-afa0-8deff635a568 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:41.258918 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c21b7c-dbbf-498a-afa0-8deff635a568 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:41.259187 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c21b7c-dbbf-498a-afa0-8deff635a568 None admin] PATH_INFO: `/v3/projects/5fbc92893e3b41468392746a7a2de405` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:41.260283 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c21b7c-dbbf-498a-afa0-8deff635a568 None admin] RBAC: Authorizing `identity:get_project(project_id=5fbc92893e3b41468392746a7a2de405)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:41.261727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c21b7c-dbbf-498a-afa0-8deff635a568 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:41.263331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 585/1184] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:15:41 2022] GET /identity/v3/projects/5fbc92893e3b41468392746a7a2de405 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:41.269345 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e706a-2ee4-4ef3-bbd8-4db95fda76c7 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:41.366778 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e706a-2ee4-4ef3-bbd8-4db95fda76c7 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:41.402797 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c988814-883d-45fd-a839-745e2ef0a052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:41.403396 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c988814-883d-45fd-a839-745e2ef0a052 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:41.403673 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c988814-883d-45fd-a839-745e2ef0a052 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:41.403941 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c988814-883d-45fd-a839-745e2ef0a052 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:41.404663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c988814-883d-45fd-a839-745e2ef0a052 None admin] RBAC: Adding query filter params (role.id=70f911a75b7b40a19f65857b9d19cfad, scope.project.id=5fbc92893e3b41468392746a7a2de405, user.id=79f001da883c4124b53513050794c09a) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:15:41.404969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c988814-883d-45fd-a839-745e2ef0a052 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:41.406432 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c988814-883d-45fd-a839-745e2ef0a052 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:41.411921 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 600/1185] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:15:41 2022] GET /identity/v3/role_assignments?user.id=79f001da883c4124b53513050794c09a&scope.project.id=5fbc92893e3b41468392746a7a2de405&role.id=70f911a75b7b40a19f65857b9d19cfad => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:43.278145 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d4779-4b37-415d-bc3b-f8677c32a518 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:43.278678 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d4779-4b37-415d-bc3b-f8677c32a518 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:43.278678 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d4779-4b37-415d-bc3b-f8677c32a518 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:43.279994 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 586/1186] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:15:43.285243 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fcbac-ea1c-4453-ba93-faf31b867c4a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:43.285679 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fcbac-ea1c-4453-ba93-faf31b867c4a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:43.285829 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fcbac-ea1c-4453-ba93-faf31b867c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:43.304036 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8a7fcbac-ea1c-4453-ba93-faf31b867c4a None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:15:43.305223 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8a7fcbac-ea1c-4453-ba93-faf31b867c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:15:43.331673 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:43.371237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 601/1187] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:15:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:15:43.643077 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d4779-4b37-415d-bc3b-f8677c32a518 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:43.743301 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d4779-4b37-415d-bc3b-f8677c32a518 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:43.774801 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69c6b4-ac71-4cca-a6fa-cfc5a5c3924e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:43.775407 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69c6b4-ac71-4cca-a6fa-cfc5a5c3924e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:43.775680 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69c6b4-ac71-4cca-a6fa-cfc5a5c3924e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:43.775946 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69c6b4-ac71-4cca-a6fa-cfc5a5c3924e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:43.783573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:43.786979 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69c6b4-ac71-4cca-a6fa-cfc5a5c3924e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:15:43.792552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-fc69c6b4-ac71-4cca-a6fa-cfc5a5c3924e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:15:43.792552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:15:43.792552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:15:43.792552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:15:43.792552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:15:43.792552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:15:43.792552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:15:43.792552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:15:43.792552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:15:43.792552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:15:43.792552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:15:43.792552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:15:43.792552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:15:43.792552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:15:43.792552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:15:43.792552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:15:43.793707 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:15:43.793707 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:15:43.793707 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:15:43.793707 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:15:43.793707 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:15:43.793707 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:15:43.793707 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:15:43.793707 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:15:43.793707 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:15:43.793707 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:15:43.793707 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:15:43.793707 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:15:43.793707 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:15:43.793707 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:15:43.793707 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:15:43.793707 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:15:43.794913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:15:43.794913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:15:43.794913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:15:43.794913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:15:43.794913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:15:43.794913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:15:43.794913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:15:43.794913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:15:43.794913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:15:43.794913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:15:43.794913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:15:43.794913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:15:43.794913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 587/1188] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:15:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:15:43.799741 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fcbac-ea1c-4453-ba93-faf31b867c4a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:43.894899 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fcbac-ea1c-4453-ba93-faf31b867c4a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:43.927569 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81ffa7-9f60-4a78-bb1f-5f78149d89cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:43.928163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81ffa7-9f60-4a78-bb1f-5f78149d89cd None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:43.928438 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81ffa7-9f60-4a78-bb1f-5f78149d89cd None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:43.928706 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81ffa7-9f60-4a78-bb1f-5f78149d89cd None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:43.929363 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81ffa7-9f60-4a78-bb1f-5f78149d89cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:15:43.929690 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81ffa7-9f60-4a78-bb1f-5f78149d89cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:43.931037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81ffa7-9f60-4a78-bb1f-5f78149d89cd None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:43.938751 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 602/1189] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:15:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:43.944470 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69c6b4-ac71-4cca-a6fa-cfc5a5c3924e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:44.040301 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69c6b4-ac71-4cca-a6fa-cfc5a5c3924e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:44.072343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfb8f2-20c4-40ed-ac80-f3a3a2a0b96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:44.073482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfb8f2-20c4-40ed-ac80-f3a3a2a0b96d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:44.073759 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfb8f2-20c4-40ed-ac80-f3a3a2a0b96d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:44.074023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfb8f2-20c4-40ed-ac80-f3a3a2a0b96d None admin] PATH_INFO: `/v3/users/79f001da883c4124b53513050794c09a` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:44.075112 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bfb8f2-20c4-40ed-ac80-f3a3a2a0b96d None admin] RBAC: Authorizing `identity:get_user(user_id=79f001da883c4124b53513050794c09a)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:44.076519 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bfb8f2-20c4-40ed-ac80-f3a3a2a0b96d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:44.078096 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 588/1190] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:15:43 2022] GET /identity/v3/users/79f001da883c4124b53513050794c09a => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:44.084247 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81ffa7-9f60-4a78-bb1f-5f78149d89cd None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:44.109537 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:44.180511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81ffa7-9f60-4a78-bb1f-5f78149d89cd None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:44.212571 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcc2f6-a3b1-44aa-9ff8-93112c321405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:44.213188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcc2f6-a3b1-44aa-9ff8-93112c321405 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:44.213490 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcc2f6-a3b1-44aa-9ff8-93112c321405 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:44.214340 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcc2f6-a3b1-44aa-9ff8-93112c321405 None admin] PATH_INFO: `/v3/projects/5fbc92893e3b41468392746a7a2de405` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:44.215438 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bcc2f6-a3b1-44aa-9ff8-93112c321405 None admin] RBAC: Authorizing `identity:get_project(project_id=5fbc92893e3b41468392746a7a2de405)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:44.216848 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bcc2f6-a3b1-44aa-9ff8-93112c321405 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:44.218466 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 603/1191] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:15:44 2022] GET /identity/v3/projects/5fbc92893e3b41468392746a7a2de405 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:44.224307 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfb8f2-20c4-40ed-ac80-f3a3a2a0b96d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:44.287182 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:44.319153 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfb8f2-20c4-40ed-ac80-f3a3a2a0b96d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:44.350908 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ebef0-45d2-4dfd-b81e-2f9eb5415e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:44.351539 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ebef0-45d2-4dfd-b81e-2f9eb5415e2d None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:44.351813 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ebef0-45d2-4dfd-b81e-2f9eb5415e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:44.352078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ebef0-45d2-4dfd-b81e-2f9eb5415e2d None admin] PATH_INFO: `/v3/projects/5fbc92893e3b41468392746a7a2de405/users/79f001da883c4124b53513050794c09a/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:44.353937 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ebef0-45d2-4dfd-b81e-2f9eb5415e2d None admin] RBAC: Authorizing `identity:create_grant(project_id=5fbc92893e3b41468392746a7a2de405, user_id=79f001da883c4124b53513050794c09a, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:44.355894 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ebef0-45d2-4dfd-b81e-2f9eb5415e2d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:44.367886 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 589/1192] 10.222.0.94 () {58 vars in 1439 bytes} [Thu Sep 1 17:15:44 2022] PUT /identity/v3/projects/5fbc92893e3b41468392746a7a2de405/users/79f001da883c4124b53513050794c09a/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:15:46.419317 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852af6b-8f35-40db-932c-be0cc2c615c2 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:46.419851 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852af6b-8f35-40db-932c-be0cc2c615c2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:46.419851 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852af6b-8f35-40db-932c-be0cc2c615c2 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:46.421188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 604/1193] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:15:46.426370 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfb49b-ea96-4098-8193-93ac827e38e7 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:46.426800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfb49b-ea96-4098-8193-93ac827e38e7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:46.426923 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfb49b-ea96-4098-8193-93ac827e38e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:46.444722 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-0abfb49b-ea96-4098-8193-93ac827e38e7 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:15:46.446015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0abfb49b-ea96-4098-8193-93ac827e38e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:15:46.511666 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 590/1194] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:15:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:15:46.779285 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852af6b-8f35-40db-932c-be0cc2c615c2 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:46.868419 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:46.878659 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852af6b-8f35-40db-932c-be0cc2c615c2 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:46.911766 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1624ff1-7679-4479-9660-693a73fb789f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:46.912380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1624ff1-7679-4479-9660-693a73fb789f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:46.912687 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1624ff1-7679-4479-9660-693a73fb789f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:46.912954 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1624ff1-7679-4479-9660-693a73fb789f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:46.923813 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1624ff1-7679-4479-9660-693a73fb789f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:15:46.928625 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-e1624ff1-7679-4479-9660-693a73fb789f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:15:46.928625 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:15:46.928625 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:15:46.928625 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:15:46.928625 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:15:46.928625 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:15:46.928625 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:15:46.928625 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:15:46.928625 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:15:46.928625 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:15:46.928625 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:15:46.928625 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:15:46.928625 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:15:46.928625 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:15:46.928625 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:15:46.928625 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:15:46.929754 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:15:46.929754 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:15:46.929754 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:15:46.929754 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:15:46.929754 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:15:46.929754 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:15:46.929754 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:15:46.929754 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:15:46.929754 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:15:46.929754 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:15:46.929754 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:15:46.929754 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:15:46.929754 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:15:46.929754 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:15:46.929754 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:15:46.929754 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:15:46.930624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:15:46.930624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:15:46.930624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:15:46.930624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:15:46.930624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:15:46.930624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:15:46.930624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:15:46.930624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:15:46.930624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:15:46.930624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:15:46.930624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:15:46.930624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:15:46.930624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 605/1195] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:15:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:15:46.936546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfb49b-ea96-4098-8193-93ac827e38e7 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:46.991264 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:47.031383 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfb49b-ea96-4098-8193-93ac827e38e7 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:47.063827 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c885f-8e99-4b1f-b6a7-6c731430deed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:47.064411 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c885f-8e99-4b1f-b6a7-6c731430deed None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:47.064685 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c885f-8e99-4b1f-b6a7-6c731430deed None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:47.064951 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c885f-8e99-4b1f-b6a7-6c731430deed None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:47.065623 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c885f-8e99-4b1f-b6a7-6c731430deed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:15:47.065921 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c885f-8e99-4b1f-b6a7-6c731430deed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:47.067262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c885f-8e99-4b1f-b6a7-6c731430deed None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:47.074889 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 591/1196] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:15:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:15:47.080837 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1624ff1-7679-4479-9660-693a73fb789f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:47.179437 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1624ff1-7679-4479-9660-693a73fb789f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:47.211733 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eee466-4fe9-4eb1-a439-ec74de580262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:47.212341 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eee466-4fe9-4eb1-a439-ec74de580262 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:47.212616 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eee466-4fe9-4eb1-a439-ec74de580262 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:47.212885 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eee466-4fe9-4eb1-a439-ec74de580262 None admin] PATH_INFO: `/v3/users/79f001da883c4124b53513050794c09a` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:47.214502 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eee466-4fe9-4eb1-a439-ec74de580262 None admin] RBAC: Authorizing `identity:get_user(user_id=79f001da883c4124b53513050794c09a)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:47.215925 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eee466-4fe9-4eb1-a439-ec74de580262 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:47.217477 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 606/1197] 10.222.0.94 () {56 vars in 1177 bytes} [Thu Sep 1 17:15:47 2022] GET /identity/v3/users/79f001da883c4124b53513050794c09a => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:47.223347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c885f-8e99-4b1f-b6a7-6c731430deed None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:47.317342 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c885f-8e99-4b1f-b6a7-6c731430deed None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:47.335761 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:47.349759 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba49d3-1b7e-4c45-b365-fef4495f2859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:47.350352 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba49d3-1b7e-4c45-b365-fef4495f2859 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:47.350626 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba49d3-1b7e-4c45-b365-fef4495f2859 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:47.350892 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba49d3-1b7e-4c45-b365-fef4495f2859 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:47.413705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba49d3-1b7e-4c45-b365-fef4495f2859 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:47.415121 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba49d3-1b7e-4c45-b365-fef4495f2859 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:47.507354 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 592/1198] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:15:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 17:15:47.513239 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eee466-4fe9-4eb1-a439-ec74de580262 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:47.535546 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:47.626963 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eee466-4fe9-4eb1-a439-ec74de580262 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:47.659523 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3902572-9e7b-4dd3-abfc-1339f4c961f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:47.660137 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3902572-9e7b-4dd3-abfc-1339f4c961f4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:47.660407 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3902572-9e7b-4dd3-abfc-1339f4c961f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:47.660670 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3902572-9e7b-4dd3-abfc-1339f4c961f4 None admin] PATH_INFO: `/v3/projects/5fbc92893e3b41468392746a7a2de405` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:47.661836 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3902572-9e7b-4dd3-abfc-1339f4c961f4 None admin] RBAC: Authorizing `identity:get_project(project_id=5fbc92893e3b41468392746a7a2de405)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:47.663249 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3902572-9e7b-4dd3-abfc-1339f4c961f4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:47.664849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 607/1199] 10.222.0.94 () {56 vars in 1186 bytes} [Thu Sep 1 17:15:47 2022] GET /identity/v3/projects/5fbc92893e3b41468392746a7a2de405 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:47.671117 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba49d3-1b7e-4c45-b365-fef4495f2859 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:15:47.691590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:47.767253 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba49d3-1b7e-4c45-b365-fef4495f2859 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:15:47.799814 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5d4e0-c888-42ed-a154-d1b4c384ce74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:15:47.800407 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5d4e0-c888-42ed-a154-d1b4c384ce74 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:15:47.800687 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5d4e0-c888-42ed-a154-d1b4c384ce74 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:15:47.800957 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5d4e0-c888-42ed-a154-d1b4c384ce74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:15:47.801707 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5d4e0-c888-42ed-a154-d1b4c384ce74 None admin] RBAC: Adding query filter params (role.id=70f911a75b7b40a19f65857b9d19cfad, scope.project.id=5fbc92893e3b41468392746a7a2de405, user.id=79f001da883c4124b53513050794c09a) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:15:47.802015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5d4e0-c888-42ed-a154-d1b4c384ce74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:15:47.803436 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5d4e0-c888-42ed-a154-d1b4c384ce74 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:15:47.809041 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 593/1200] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:15:47 2022] GET /identity/v3/role_assignments?user.id=79f001da883c4124b53513050794c09a&scope.project.id=5fbc92893e3b41468392746a7a2de405&role.id=70f911a75b7b40a19f65857b9d19cfad => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:15:57.655520 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=56 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:15:57.806579 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=58 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:16:42.918981 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad40e2-7af4-4d09-828b-81b680756db8 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:42.919644 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad40e2-7af4-4d09-828b-81b680756db8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:42.919644 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad40e2-7af4-4d09-828b-81b680756db8 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:42.921292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 608/1201] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:16:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:16:42.927172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01ddb6-e1d5-407b-a6eb-7dade4b16a9f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:42.927676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01ddb6-e1d5-407b-a6eb-7dade4b16a9f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:42.927764 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01ddb6-e1d5-407b-a6eb-7dade4b16a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:42.949067 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-4d01ddb6-e1d5-407b-a6eb-7dade4b16a9f None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:16:42.950325 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4d01ddb6-e1d5-407b-a6eb-7dade4b16a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:16:43.049980 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 594/1202] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:16:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:16:43.363441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad40e2-7af4-4d09-828b-81b680756db8 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:43.516725 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad40e2-7af4-4d09-828b-81b680756db8 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:43.575385 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f32cf-e074-44e1-98a1-5367714a1e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:43.576102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f32cf-e074-44e1-98a1-5367714a1e41 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:43.576357 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f32cf-e074-44e1-98a1-5367714a1e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:43.576659 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f32cf-e074-44e1-98a1-5367714a1e41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:43.591941 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f32cf-e074-44e1-98a1-5367714a1e41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:43.593813 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f32cf-e074-44e1-98a1-5367714a1e41 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:43.611346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-b32f32cf-e074-44e1-98a1-5367714a1e41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:16:43.611346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:16:43.611346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:16:43.611346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:16:43.611346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:16:43.611346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:16:43.611346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:16:43.611346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:16:43.611346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:16:43.611346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:16:43.611346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:16:43.611346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:16:43.611346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:16:43.611346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:16:43.611346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:16:43.611346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:16:43.612561 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:16:43.612561 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:16:43.612561 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:16:43.612561 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:16:43.612561 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:16:43.612561 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:16:43.612561 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:16:43.612561 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:16:43.612561 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:16:43.612561 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:16:43.612561 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:16:43.612561 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:16:43.612561 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:16:43.612561 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:16:43.612561 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:16:43.612561 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:16:43.612561 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:16:43.613619 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:16:43.613619 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:16:43.613619 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:16:43.613619 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 609/1203] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:16:43.620790 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01ddb6-e1d5-407b-a6eb-7dade4b16a9f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:43.750405 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01ddb6-e1d5-407b-a6eb-7dade4b16a9f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:43.785483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:16:43.796719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429d9ff-cac1-4481-9e0b-f93e641de72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:43.797360 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429d9ff-cac1-4481-9e0b-f93e641de72b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:43.797803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429d9ff-cac1-4481-9e0b-f93e641de72b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:43.798073 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429d9ff-cac1-4481-9e0b-f93e641de72b None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:43.799012 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429d9ff-cac1-4481-9e0b-f93e641de72b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:16:43.799242 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429d9ff-cac1-4481-9e0b-f93e641de72b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:43.800774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429d9ff-cac1-4481-9e0b-f93e641de72b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:43.827752 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 595/1204] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:16:43.828969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f32cf-e074-44e1-98a1-5367714a1e41 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:43.897843 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:16:43.955645 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f32cf-e074-44e1-98a1-5367714a1e41 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:43.992772 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba2a75-4662-42ac-a045-0c313f08f558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:43.993425 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba2a75-4662-42ac-a045-0c313f08f558 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:43.993738 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba2a75-4662-42ac-a045-0c313f08f558 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:43.994093 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba2a75-4662-42ac-a045-0c313f08f558 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:43.994796 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba2a75-4662-42ac-a045-0c313f08f558 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:43.996286 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba2a75-4662-42ac-a045-0c313f08f558 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:44.033429 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 610/1205] 10.222.0.94 () {60 vars in 1132 bytes} [Thu Sep 1 17:16:43 2022] POST /identity/v3/users => generated 251 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:16:46.212401 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65526e0f-8706-4a1c-9af4-7958694b6db4 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:46.212932 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65526e0f-8706-4a1c-9af4-7958694b6db4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:46.212932 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65526e0f-8706-4a1c-9af4-7958694b6db4 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:46.214488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 596/1206] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:16:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:16:46.219522 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb089e04-132c-4270-b7cd-29139a24eebb None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:46.219973 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb089e04-132c-4270-b7cd-29139a24eebb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:46.220086 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb089e04-132c-4270-b7cd-29139a24eebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:46.239564 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-fb089e04-132c-4270-b7cd-29139a24eebb None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:16:46.241018 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fb089e04-132c-4270-b7cd-29139a24eebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:16:46.319922 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 611/1207] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:16:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:16:46.615970 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65526e0f-8706-4a1c-9af4-7958694b6db4 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:46.752952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65526e0f-8706-4a1c-9af4-7958694b6db4 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:46.791059 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ca755-e8a4-435f-b52f-5112a4aec2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:46.791613 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ca755-e8a4-435f-b52f-5112a4aec2ce None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:46.791956 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ca755-e8a4-435f-b52f-5112a4aec2ce None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:46.792164 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ca755-e8a4-435f-b52f-5112a4aec2ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:46.803489 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ca755-e8a4-435f-b52f-5112a4aec2ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:16:46.809774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-de0ca755-e8a4-435f-b52f-5112a4aec2ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:16:46.809774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:16:46.809774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:16:46.809774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:16:46.809774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:16:46.809774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:16:46.809774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:16:46.809774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:16:46.809774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:16:46.809774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:16:46.809774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:16:46.809774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:16:46.809774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:16:46.809774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:16:46.809774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:16:46.809774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:16:46.811102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:16:46.811102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:16:46.811102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:16:46.811102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:16:46.811102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:16:46.811102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:16:46.811102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:16:46.811102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:16:46.811102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:16:46.811102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:16:46.811102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:16:46.811102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:16:46.811102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:16:46.811102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:16:46.811102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:16:46.811102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:16:46.812553 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:16:46.812553 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:16:46.812553 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:16:46.812553 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:16:46.812553 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:16:46.812553 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:16:46.812553 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:16:46.812553 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:16:46.812553 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:16:46.812553 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:16:46.812553 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:16:46.812553 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:16:46.812553 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 597/1208] 10.222.0.94 () {56 vars in 1102 bytes} [Thu Sep 1 17:16:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:16:46.817806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb089e04-132c-4270-b7cd-29139a24eebb None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:46.864152 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:16:46.942747 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb089e04-132c-4270-b7cd-29139a24eebb None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:46.981498 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0c837-d5fb-4bbe-9aa5-aaa145a5087b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:46.982407 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0c837-d5fb-4bbe-9aa5-aaa145a5087b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:46.982724 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0c837-d5fb-4bbe-9aa5-aaa145a5087b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:46.983012 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0c837-d5fb-4bbe-9aa5-aaa145a5087b None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:46.983678 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0c837-d5fb-4bbe-9aa5-aaa145a5087b None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:16:46.984022 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0c837-d5fb-4bbe-9aa5-aaa145a5087b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:46.985469 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0c837-d5fb-4bbe-9aa5-aaa145a5087b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:46.994729 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 612/1209] 10.222.0.94 () {56 vars in 1103 bytes} [Thu Sep 1 17:16:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:16:47.000344 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ca755-e8a4-435f-b52f-5112a4aec2ce None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:47.056825 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:16:47.115721 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ca755-e8a4-435f-b52f-5112a4aec2ce None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:47.161480 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea6299-0659-47ff-8586-471533ac4967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:47.162165 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea6299-0659-47ff-8586-471533ac4967 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:47.162465 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea6299-0659-47ff-8586-471533ac4967 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:47.162737 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea6299-0659-47ff-8586-471533ac4967 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:47.175136 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea6299-0659-47ff-8586-471533ac4967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:47.176948 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea6299-0659-47ff-8586-471533ac4967 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:47.198894 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-36ea6299-0659-47ff-8586-471533ac4967 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:16:47.198894 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:16:47.198894 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:16:47.198894 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:16:47.198894 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:16:47.198894 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:16:47.198894 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:16:47.198894 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:16:47.198894 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:16:47.198894 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:16:47.198894 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:16:47.198894 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:16:47.198894 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:16:47.198894 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:16:47.198894 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:16:47.198894 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:16:47.200253 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:16:47.200253 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:16:47.200253 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:16:47.200253 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:16:47.200253 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:16:47.200253 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:16:47.200253 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:16:47.200253 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:16:47.200253 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:16:47.200253 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:16:47.200253 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:16:47.200253 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:16:47.200253 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:16:47.200253 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:16:47.200253 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:16:47.200253 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:16:47.200253 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:16:47.201305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:16:47.201305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:16:47.201305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:16:47.203240 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 598/1210] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:16:47.209383 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0c837-d5fb-4bbe-9aa5-aaa145a5087b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:47.325438 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:16:47.329280 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0c837-d5fb-4bbe-9aa5-aaa145a5087b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:47.369840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17e5e8-905d-4e65-b410-91eca5b9071d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:47.370568 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17e5e8-905d-4e65-b410-91eca5b9071d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:47.371080 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17e5e8-905d-4e65-b410-91eca5b9071d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:47.371246 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17e5e8-905d-4e65-b410-91eca5b9071d None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:47.371946 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa17e5e8-905d-4e65-b410-91eca5b9071d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:16:47.374544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa17e5e8-905d-4e65-b410-91eca5b9071d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:47.374544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa17e5e8-905d-4e65-b410-91eca5b9071d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:47.387925 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 613/1211] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:16:47.393806 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea6299-0659-47ff-8586-471533ac4967 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:47.513288 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea6299-0659-47ff-8586-471533ac4967 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:47.514958 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:16:47.553250 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f000abf-3c11-4201-9b4b-6bf394569d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:47.554026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f000abf-3c11-4201-9b4b-6bf394569d30 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:47.555004 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f000abf-3c11-4201-9b4b-6bf394569d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:47.555334 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f000abf-3c11-4201-9b4b-6bf394569d30 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:47.563614 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f000abf-3c11-4201-9b4b-6bf394569d30 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:47.565359 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f000abf-3c11-4201-9b4b-6bf394569d30 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:47.580053 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-8f000abf-3c11-4201-9b4b-6bf394569d30 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 17:16:47.580053 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:16:47.580053 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:16:47.580053 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:16:47.580053 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:16:47.580053 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:16:47.580053 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:16:47.580053 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:16:47.580053 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:16:47.580053 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:16:47.580053 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:16:47.580053 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:16:47.580053 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:16:47.580053 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:16:47.580053 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:16:47.580053 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:16:47.581287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:16:47.581287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:16:47.581287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:16:47.581287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:16:47.581287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:16:47.581287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:16:47.581287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:16:47.581287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:16:47.581287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:16:47.581287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:16:47.581287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:16:47.581287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:16:47.581287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:16:47.581287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:16:47.581287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:16:47.581287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:16:47.581287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:16:47.581287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:16:47.582695 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:16:47.582695 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:16:47.582695 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:16:47.582695 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:16:47.582695 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:16:47.582695 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:16:47.582695 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:16:47.582695 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:16:47.582695 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 17:16:47.582695 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:16:47.582695 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 599/1212] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:16:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:16:47.587198 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17e5e8-905d-4e65-b410-91eca5b9071d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:47.706637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17e5e8-905d-4e65-b410-91eca5b9071d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:47.749330 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5128c-7b69-43f2-8908-442d60dffb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:47.750052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5128c-7b69-43f2-8908-442d60dffb6d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:47.750361 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5128c-7b69-43f2-8908-442d60dffb6d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:47.750902 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5128c-7b69-43f2-8908-442d60dffb6d None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:47.751491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5128c-7b69-43f2-8908-442d60dffb6d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:16:47.751783 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5128c-7b69-43f2-8908-442d60dffb6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:47.753313 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5128c-7b69-43f2-8908-442d60dffb6d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:47.780172 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 614/1213] 10.222.0.94 () {56 vars in 1143 bytes} [Thu Sep 1 17:16:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:16:47.781676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f000abf-3c11-4201-9b4b-6bf394569d30 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:47.910160 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f000abf-3c11-4201-9b4b-6bf394569d30 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:47.954568 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a8c12-90c1-4d8f-b3e9-39d24d3dd41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:47.955832 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a8c12-90c1-4d8f-b3e9-39d24d3dd41b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:47.955832 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a8c12-90c1-4d8f-b3e9-39d24d3dd41b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:47.955832 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a8c12-90c1-4d8f-b3e9-39d24d3dd41b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:47.991463 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:16:48.039174 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a8c12-90c1-4d8f-b3e9-39d24d3dd41b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:48.040674 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a8c12-90c1-4d8f-b3e9-39d24d3dd41b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:48.157392 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 600/1214] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:16:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 17:16:48.159377 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5128c-7b69-43f2-8908-442d60dffb6d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:48.183541 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:16:48.289967 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5128c-7b69-43f2-8908-442d60dffb6d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:48.328546 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed90242-aad2-402f-9303-90780531ca80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:48.330056 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed90242-aad2-402f-9303-90780531ca80 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:48.330056 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed90242-aad2-402f-9303-90780531ca80 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:48.330056 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed90242-aad2-402f-9303-90780531ca80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:48.341935 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed90242-aad2-402f-9303-90780531ca80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:48.343673 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed90242-aad2-402f-9303-90780531ca80 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:48.359277 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-7ed90242-aad2-402f-9303-90780531ca80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:16:48.359277 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:16:48.359277 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:16:48.359277 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:16:48.359277 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:16:48.359277 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:16:48.359277 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:16:48.359277 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:16:48.359277 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:16:48.359277 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:16:48.359277 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:16:48.359277 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:16:48.359277 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:16:48.359277 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:16:48.359277 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:16:48.359277 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:16:48.360506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:16:48.360506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:16:48.360506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:16:48.360506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:16:48.360506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:16:48.360506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:16:48.360506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:16:48.360506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:16:48.360506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:16:48.360506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:16:48.360506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:16:48.360506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:16:48.360506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:16:48.360506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:16:48.360506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:16:48.360506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:16:48.360506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:16:48.361710 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:16:48.361710 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:16:48.361710 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:16:48.366981 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 615/1215] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:16:48.368051 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a8c12-90c1-4d8f-b3e9-39d24d3dd41b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:48.431573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:16:48.471442 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a8c12-90c1-4d8f-b3e9-39d24d3dd41b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:48.506901 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f26ea9-1a63-4348-8f70-ee6d16991040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:48.508096 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f26ea9-1a63-4348-8f70-ee6d16991040 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:48.508432 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f26ea9-1a63-4348-8f70-ee6d16991040 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:48.508787 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f26ea9-1a63-4348-8f70-ee6d16991040 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:48.509618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f26ea9-1a63-4348-8f70-ee6d16991040 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:16:48.509988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f26ea9-1a63-4348-8f70-ee6d16991040 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:48.511442 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f26ea9-1a63-4348-8f70-ee6d16991040 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:48.525103 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 601/1216] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:16:48.532252 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed90242-aad2-402f-9303-90780531ca80 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:48.615919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:16:48.659533 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed90242-aad2-402f-9303-90780531ca80 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:48.701293 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cddfd-fb31-43d1-b5d9-f79cb2091dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:48.701918 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cddfd-fb31-43d1-b5d9-f79cb2091dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:48.702453 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cddfd-fb31-43d1-b5d9-f79cb2091dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:48.702749 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cddfd-fb31-43d1-b5d9-f79cb2091dd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:48.709757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247cddfd-fb31-43d1-b5d9-f79cb2091dd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:48.711255 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247cddfd-fb31-43d1-b5d9-f79cb2091dd0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:48.723901 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-247cddfd-fb31-43d1-b5d9-f79cb2091dd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:16:48.723901 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:16:48.723901 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:16:48.723901 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:16:48.723901 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:16:48.723901 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:16:48.723901 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:16:48.723901 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:16:48.723901 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:16:48.723901 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:16:48.723901 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:16:48.723901 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:16:48.723901 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:16:48.723901 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:16:48.723901 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:16:48.724945 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:16:48.724945 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:16:48.724945 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:16:48.724945 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:16:48.724945 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:16:48.724945 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:16:48.724945 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:16:48.724945 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:16:48.724945 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:16:48.724945 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:16:48.724945 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:16:48.724945 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:16:48.724945 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:16:48.724945 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:16:48.724945 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:16:48.724945 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:16:48.724945 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:16:48.725927 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:16:48.725927 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:16:48.725927 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:16:48.725927 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:16:48.725927 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:16:48.725927 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:16:48.725927 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:16:48.725927 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:16:48.725927 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 616/1217] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:16:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:16:48.731878 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f26ea9-1a63-4348-8f70-ee6d16991040 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:48.848751 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f26ea9-1a63-4348-8f70-ee6d16991040 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:48.877085 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:16:48.892900 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838c5b0-8457-4553-ba0c-58f30f8fcf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:48.893575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838c5b0-8457-4553-ba0c-58f30f8fcf15 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:48.893900 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838c5b0-8457-4553-ba0c-58f30f8fcf15 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:48.894180 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838c5b0-8457-4553-ba0c-58f30f8fcf15 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:48.894951 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838c5b0-8457-4553-ba0c-58f30f8fcf15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:16:48.895279 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838c5b0-8457-4553-ba0c-58f30f8fcf15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:48.896907 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838c5b0-8457-4553-ba0c-58f30f8fcf15 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:48.912863 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 602/1218] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:16:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:16:48.919968 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cddfd-fb31-43d1-b5d9-f79cb2091dd0 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:49.052745 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cddfd-fb31-43d1-b5d9-f79cb2091dd0 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:49.091646 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:16:49.099879 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d13691-840d-4794-b4fb-fc4a447be1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:49.100617 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d13691-840d-4794-b4fb-fc4a447be1bd None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:49.100896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d13691-840d-4794-b4fb-fc4a447be1bd None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:49.101716 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d13691-840d-4794-b4fb-fc4a447be1bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:49.102451 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d13691-840d-4794-b4fb-fc4a447be1bd None admin] RBAC: Adding query filter params (role.id=e903cb11e2bf466fa1b3fae894847c3e, scope.project.id=c8f9428f37354c82ac52b6b8eccc424a, user.id=e3622621761f4f18ae3e9dfb5ba99bef) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:16:49.102753 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d13691-840d-4794-b4fb-fc4a447be1bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:49.104195 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d13691-840d-4794-b4fb-fc4a447be1bd None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:49.110305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 617/1219] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:16:48 2022] GET /identity/v3/role_assignments?user.id=e3622621761f4f18ae3e9dfb5ba99bef&scope.project.id=c8f9428f37354c82ac52b6b8eccc424a&role.id=e903cb11e2bf466fa1b3fae894847c3e => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:16:51.168848 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c54bc2-0f86-42ca-91db-983a164ea2ec None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:51.169526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c54bc2-0f86-42ca-91db-983a164ea2ec None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:51.169526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c54bc2-0f86-42ca-91db-983a164ea2ec None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:51.170771 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 603/1220] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:16:51.176032 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21978a3b-bab6-43ef-b413-53849dd31d1b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:51.176476 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21978a3b-bab6-43ef-b413-53849dd31d1b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:51.176563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21978a3b-bab6-43ef-b413-53849dd31d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:51.195431 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-21978a3b-bab6-43ef-b413-53849dd31d1b None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:16:51.196669 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-21978a3b-bab6-43ef-b413-53849dd31d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:16:51.264667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 618/1221] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:16:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:16:51.575634 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c54bc2-0f86-42ca-91db-983a164ea2ec None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:51.692733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c54bc2-0f86-42ca-91db-983a164ea2ec None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:51.729628 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbdfc2-546a-455b-8ecd-32ecd7b71aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:51.730267 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbdfc2-546a-455b-8ecd-32ecd7b71aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:51.730550 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbdfc2-546a-455b-8ecd-32ecd7b71aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:51.730820 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbdfc2-546a-455b-8ecd-32ecd7b71aa4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:51.741005 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbdfc2-546a-455b-8ecd-32ecd7b71aa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:16:51.746322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-cdfbdfc2-546a-455b-8ecd-32ecd7b71aa4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:16:51.746322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:16:51.746322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:16:51.746322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:16:51.746322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:16:51.746322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:16:51.746322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:16:51.746322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:16:51.746322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:16:51.746322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:16:51.746322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:16:51.746322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:16:51.746322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:16:51.746322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:16:51.746322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:16:51.746322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:16:51.747367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:16:51.747367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:16:51.747367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:16:51.747367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:16:51.747367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:16:51.747367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:16:51.747367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:16:51.747367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:16:51.747367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:16:51.747367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:16:51.747367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:16:51.747367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:16:51.747367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:16:51.747367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:16:51.747367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:16:51.747367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:16:51.748333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:16:51.748333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:16:51.748333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:16:51.748333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:16:51.748333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:16:51.748333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:16:51.748333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:16:51.748333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:16:51.748333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:16:51.748333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:16:51.748333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:16:51.748333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:16:51.748333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 604/1222] 10.222.0.94 () {56 vars in 1102 bytes} [Thu Sep 1 17:16:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:16:51.753900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21978a3b-bab6-43ef-b413-53849dd31d1b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:51.863333 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21978a3b-bab6-43ef-b413-53849dd31d1b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:51.888167 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:16:51.902320 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7a533-7bd0-4572-af01-e73c0d9e98ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:51.903146 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7a533-7bd0-4572-af01-e73c0d9e98ef None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:51.903506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7a533-7bd0-4572-af01-e73c0d9e98ef None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:51.903855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7a533-7bd0-4572-af01-e73c0d9e98ef None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:51.904793 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7a533-7bd0-4572-af01-e73c0d9e98ef None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:16:51.905310 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7a533-7bd0-4572-af01-e73c0d9e98ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:51.907317 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7a533-7bd0-4572-af01-e73c0d9e98ef None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:51.920295 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 619/1223] 10.222.0.94 () {56 vars in 1103 bytes} [Thu Sep 1 17:16:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:16:51.928882 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbdfc2-546a-455b-8ecd-32ecd7b71aa4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:51.988049 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:16:52.050457 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbdfc2-546a-455b-8ecd-32ecd7b71aa4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:52.092081 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c81b3-c7de-4687-8aef-aad1f46b0c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:52.092762 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c81b3-c7de-4687-8aef-aad1f46b0c9f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:52.093215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c81b3-c7de-4687-8aef-aad1f46b0c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:52.093427 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c81b3-c7de-4687-8aef-aad1f46b0c9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:52.104870 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c81b3-c7de-4687-8aef-aad1f46b0c9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:52.106516 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c81b3-c7de-4687-8aef-aad1f46b0c9f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:52.122845 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-a39c81b3-c7de-4687-8aef-aad1f46b0c9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:16:52.122845 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:16:52.122845 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:16:52.122845 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:16:52.122845 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:16:52.122845 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:16:52.122845 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:16:52.122845 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:16:52.122845 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:16:52.122845 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:16:52.122845 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:16:52.122845 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:16:52.122845 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:16:52.122845 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:16:52.122845 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:16:52.122845 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:16:52.124054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:16:52.124054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:16:52.124054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:16:52.124054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:16:52.124054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:16:52.124054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:16:52.124054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:16:52.124054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:16:52.124054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:16:52.124054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:16:52.124054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:16:52.124054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:16:52.124054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:16:52.124054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:16:52.124054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:16:52.124054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:16:52.124054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:16:52.125221 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:16:52.125221 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:16:52.125221 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:16:52.125221 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 605/1224] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:16:52.130328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7a533-7bd0-4572-af01-e73c0d9e98ef None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:52.233695 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7a533-7bd0-4572-af01-e73c0d9e98ef None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:52.268931 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d50b7-f6e1-41eb-b49d-a57a8533af41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:52.269575 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d50b7-f6e1-41eb-b49d-a57a8533af41 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:52.269865 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d50b7-f6e1-41eb-b49d-a57a8533af41 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:52.270192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d50b7-f6e1-41eb-b49d-a57a8533af41 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:52.270913 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d50b7-f6e1-41eb-b49d-a57a8533af41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:16:52.271228 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d50b7-f6e1-41eb-b49d-a57a8533af41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:52.272733 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d50b7-f6e1-41eb-b49d-a57a8533af41 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:52.285421 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 620/1225] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:16:52.291896 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c81b3-c7de-4687-8aef-aad1f46b0c9f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:52.399398 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:16:52.407543 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c81b3-c7de-4687-8aef-aad1f46b0c9f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:52.442626 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b504f9-15d1-458c-a644-943681a162b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:52.443632 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b504f9-15d1-458c-a644-943681a162b7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:52.443632 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b504f9-15d1-458c-a644-943681a162b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:52.443823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b504f9-15d1-458c-a644-943681a162b7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:52.451270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b504f9-15d1-458c-a644-943681a162b7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:52.453057 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b504f9-15d1-458c-a644-943681a162b7 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:52.464454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-d7b504f9-15d1-458c-a644-943681a162b7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 17:16:52.464454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:16:52.464454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:16:52.464454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:16:52.464454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:16:52.464454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:16:52.464454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:16:52.464454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:16:52.464454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:16:52.464454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:16:52.464454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:16:52.464454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:16:52.464454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:16:52.464454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:16:52.464454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:16:52.464454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:16:52.466082 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:16:52.466082 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:16:52.466082 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:16:52.466082 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:16:52.466082 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:16:52.466082 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:16:52.466082 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:16:52.466082 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:16:52.466082 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:16:52.466082 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:16:52.466082 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:16:52.466082 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:16:52.466082 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:16:52.466082 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:16:52.466082 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:16:52.466082 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:16:52.466082 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:16:52.466082 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:16:52.467372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:16:52.467372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:16:52.467372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:16:52.467372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:16:52.467372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:16:52.467372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:16:52.467372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:16:52.467372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:16:52.467372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 17:16:52.467372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:16:52.467372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 606/1226] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:16:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:16:52.471508 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d50b7-f6e1-41eb-b49d-a57a8533af41 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:52.522058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:16:52.582832 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d50b7-f6e1-41eb-b49d-a57a8533af41 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:52.619090 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7389fe-a5c5-4fdd-91e9-8209b6c3bd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:52.619693 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7389fe-a5c5-4fdd-91e9-8209b6c3bd14 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:52.619977 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7389fe-a5c5-4fdd-91e9-8209b6c3bd14 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:52.620248 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7389fe-a5c5-4fdd-91e9-8209b6c3bd14 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:52.620977 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7389fe-a5c5-4fdd-91e9-8209b6c3bd14 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:16:52.621293 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7389fe-a5c5-4fdd-91e9-8209b6c3bd14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:52.622872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7389fe-a5c5-4fdd-91e9-8209b6c3bd14 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:52.641030 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 621/1227] 10.222.0.94 () {56 vars in 1143 bytes} [Thu Sep 1 17:16:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:16:52.646840 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b504f9-15d1-458c-a644-943681a162b7 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:52.756239 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b504f9-15d1-458c-a644-943681a162b7 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:52.797366 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2cf794-37a6-47a2-9951-ae35c15bc7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:52.797366 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cf794-37a6-47a2-9951-ae35c15bc7f0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:52.797366 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cf794-37a6-47a2-9951-ae35c15bc7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:52.797366 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cf794-37a6-47a2-9951-ae35c15bc7f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:52.809868 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2cf794-37a6-47a2-9951-ae35c15bc7f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:52.811697 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2cf794-37a6-47a2-9951-ae35c15bc7f0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:52.831150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-dc2cf794-37a6-47a2-9951-ae35c15bc7f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:16:52.831150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:16:52.831150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:16:52.831150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:16:52.831150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:16:52.831150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:16:52.831150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:16:52.831150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:16:52.831150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:16:52.831150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:16:52.831150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:16:52.831150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:16:52.831150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:16:52.831150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:16:52.831150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:16:52.831150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:16:52.832430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:16:52.832430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:16:52.832430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:16:52.832430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:16:52.832430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:16:52.832430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:16:52.832430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:16:52.832430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:16:52.832430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:16:52.832430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:16:52.832430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:16:52.832430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:16:52.832430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:16:52.832430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:16:52.832430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:16:52.832430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:16:52.832430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:16:52.833597 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:16:52.833597 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:16:52.833597 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:16:52.833597 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 607/1228] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:16:52.839655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7389fe-a5c5-4fdd-91e9-8209b6c3bd14 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:52.951455 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7389fe-a5c5-4fdd-91e9-8209b6c3bd14 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:52.954146 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:16:52.989178 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f17a96-f205-4eca-8c3b-e637d143c492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:52.989791 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f17a96-f205-4eca-8c3b-e637d143c492 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:52.990088 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f17a96-f205-4eca-8c3b-e637d143c492 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:52.990343 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f17a96-f205-4eca-8c3b-e637d143c492 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:52.990984 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f17a96-f205-4eca-8c3b-e637d143c492 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:16:52.991288 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f17a96-f205-4eca-8c3b-e637d143c492 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:52.993222 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f17a96-f205-4eca-8c3b-e637d143c492 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:53.004645 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 622/1229] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:16:53.011046 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2cf794-37a6-47a2-9951-ae35c15bc7f0 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:53.020544 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:16:53.124802 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2cf794-37a6-47a2-9951-ae35c15bc7f0 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:53.168166 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a44a4f-856a-4ca1-bd52-e4f438268bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:53.169080 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a44a4f-856a-4ca1-bd52-e4f438268bae None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:53.169363 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a44a4f-856a-4ca1-bd52-e4f438268bae None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:53.169774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a44a4f-856a-4ca1-bd52-e4f438268bae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:53.177356 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a44a4f-856a-4ca1-bd52-e4f438268bae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:53.179806 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a44a4f-856a-4ca1-bd52-e4f438268bae None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:53.193244 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-72a44a4f-856a-4ca1-bd52-e4f438268bae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:16:53.193244 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:16:53.193244 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:16:53.193244 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:16:53.193244 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:16:53.193244 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:16:53.193244 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:16:53.193244 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:16:53.193244 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:16:53.193244 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:16:53.193244 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:16:53.193244 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:16:53.193244 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:16:53.193244 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:16:53.193244 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:16:53.194587 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:16:53.194587 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:16:53.194587 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:16:53.194587 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:16:53.194587 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:16:53.194587 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:16:53.194587 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:16:53.194587 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:16:53.194587 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:16:53.194587 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:16:53.194587 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:16:53.194587 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:16:53.194587 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:16:53.194587 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:16:53.194587 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:16:53.194587 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:16:53.194587 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:16:53.195655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:16:53.195655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:16:53.195655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:16:53.195655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:16:53.195655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:16:53.195655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:16:53.195655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:16:53.195655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:16:53.195655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 608/1230] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:16:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:16:53.202515 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f17a96-f205-4eca-8c3b-e637d143c492 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:53.312981 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f17a96-f205-4eca-8c3b-e637d143c492 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:53.349213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515b0d7-824e-4589-ba9b-d40185afd420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:53.349922 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515b0d7-824e-4589-ba9b-d40185afd420 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:53.350236 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515b0d7-824e-4589-ba9b-d40185afd420 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:53.350583 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515b0d7-824e-4589-ba9b-d40185afd420 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:53.351709 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515b0d7-824e-4589-ba9b-d40185afd420 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:16:53.352086 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515b0d7-824e-4589-ba9b-d40185afd420 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:53.354878 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515b0d7-824e-4589-ba9b-d40185afd420 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:53.371642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 623/1231] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:16:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:16:53.379412 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a44a4f-856a-4ca1-bd52-e4f438268bae None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:53.451957 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:16:53.492473 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a44a4f-856a-4ca1-bd52-e4f438268bae None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:53.530954 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d25583-7f83-46a5-97ca-a59407d06490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:53.531642 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d25583-7f83-46a5-97ca-a59407d06490 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:53.531918 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d25583-7f83-46a5-97ca-a59407d06490 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:53.532206 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d25583-7f83-46a5-97ca-a59407d06490 None admin] PATH_INFO: `/v3/projects/c8f9428f37354c82ac52b6b8eccc424a/users/e3622621761f4f18ae3e9dfb5ba99bef/roles/e903cb11e2bf466fa1b3fae894847c3e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:53.548681 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d25583-7f83-46a5-97ca-a59407d06490 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8f9428f37354c82ac52b6b8eccc424a, user_id=e3622621761f4f18ae3e9dfb5ba99bef, role_id=e903cb11e2bf466fa1b3fae894847c3e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:53.551860 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d25583-7f83-46a5-97ca-a59407d06490 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:53.564716 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 609/1232] 10.222.0.94 () {58 vars in 1439 bytes} [Thu Sep 1 17:16:53 2022] PUT /identity/v3/projects/c8f9428f37354c82ac52b6b8eccc424a/users/e3622621761f4f18ae3e9dfb5ba99bef/roles/e903cb11e2bf466fa1b3fae894847c3e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:16:55.525109 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b8c7c-f608-4b5e-a36c-04a51f6fa015 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:55.525775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b8c7c-f608-4b5e-a36c-04a51f6fa015 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:55.525775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b8c7c-f608-4b5e-a36c-04a51f6fa015 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:55.534196 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 624/1233] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:16:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:16:55.536618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e9a0d-fea3-4641-ba48-10223e5bb0eb None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:55.537098 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e9a0d-fea3-4641-ba48-10223e5bb0eb None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:55.537189 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e9a0d-fea3-4641-ba48-10223e5bb0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:55.557054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ec2e9a0d-fea3-4641-ba48-10223e5bb0eb None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:16:55.558512 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ec2e9a0d-fea3-4641-ba48-10223e5bb0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:16:55.634463 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 610/1234] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:16:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:16:55.923853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b8c7c-f608-4b5e-a36c-04a51f6fa015 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:55.956133 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:16:56.038276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b8c7c-f608-4b5e-a36c-04a51f6fa015 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:56.077803 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922cbad-8864-4f4b-bc7e-225ec3272f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:56.078439 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922cbad-8864-4f4b-bc7e-225ec3272f4d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:56.078707 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922cbad-8864-4f4b-bc7e-225ec3272f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:56.078974 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922cbad-8864-4f4b-bc7e-225ec3272f4d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:56.090518 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922cbad-8864-4f4b-bc7e-225ec3272f4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:16:56.096201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-1922cbad-8864-4f4b-bc7e-225ec3272f4d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:16:56.096201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:16:56.096201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:16:56.096201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:16:56.096201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:16:56.096201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:16:56.096201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:16:56.096201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:16:56.096201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:16:56.096201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:16:56.096201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:16:56.096201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:16:56.096201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:16:56.096201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:16:56.096201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:16:56.096201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:16:56.101593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:16:56.101593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:16:56.101593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:16:56.101593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:16:56.101593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:16:56.101593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:16:56.101593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:16:56.101593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:16:56.101593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:16:56.101593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:16:56.101593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:16:56.101593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:16:56.101593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:16:56.101593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:16:56.101593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:16:56.101593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:16:56.102658 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:16:56.102658 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:16:56.102658 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:16:56.102658 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:16:56.102658 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:16:56.102658 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:16:56.102658 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:16:56.102658 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:16:56.102658 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:16:56.102658 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:16:56.102658 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 17:16:56.102658 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:16:56.102658 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 625/1235] 10.222.0.94 () {56 vars in 1102 bytes} [Thu Sep 1 17:16:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:16:56.103921 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e9a0d-fea3-4641-ba48-10223e5bb0eb None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:56.156483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:16:56.215591 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e9a0d-fea3-4641-ba48-10223e5bb0eb None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:56.253518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29987faf-bbbd-4efc-a982-de1b6ee6f522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:56.254274 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29987faf-bbbd-4efc-a982-de1b6ee6f522 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:56.254765 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29987faf-bbbd-4efc-a982-de1b6ee6f522 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:56.254975 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29987faf-bbbd-4efc-a982-de1b6ee6f522 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:56.255698 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29987faf-bbbd-4efc-a982-de1b6ee6f522 None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:16:56.256113 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29987faf-bbbd-4efc-a982-de1b6ee6f522 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:56.258194 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29987faf-bbbd-4efc-a982-de1b6ee6f522 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:56.272097 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 611/1236] 10.222.0.94 () {56 vars in 1103 bytes} [Thu Sep 1 17:16:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:16:56.273878 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922cbad-8864-4f4b-bc7e-225ec3272f4d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:56.370312 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:16:56.387009 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922cbad-8864-4f4b-bc7e-225ec3272f4d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:56.423857 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135cb48-de1f-4c06-be3a-e275ab998493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:56.424499 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135cb48-de1f-4c06-be3a-e275ab998493 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:56.424773 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135cb48-de1f-4c06-be3a-e275ab998493 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:56.425044 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135cb48-de1f-4c06-be3a-e275ab998493 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:56.436538 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135cb48-de1f-4c06-be3a-e275ab998493 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:56.438038 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135cb48-de1f-4c06-be3a-e275ab998493 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:56.455308 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-9135cb48-de1f-4c06-be3a-e275ab998493 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:16:56.455308 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:16:56.455308 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:16:56.455308 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:16:56.455308 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:16:56.455308 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:16:56.455308 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:16:56.455308 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:16:56.455308 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:16:56.455308 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:16:56.455308 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:16:56.455308 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:16:56.455308 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:16:56.455308 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:16:56.455308 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:16:56.455308 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:16:56.456598 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:16:56.456598 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:16:56.456598 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:16:56.456598 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:16:56.456598 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:16:56.456598 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:16:56.456598 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:16:56.456598 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:16:56.456598 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:16:56.456598 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:16:56.456598 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:16:56.456598 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:16:56.456598 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:16:56.456598 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:16:56.456598 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:16:56.456598 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:16:56.456598 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:16:56.457878 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:16:56.457878 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:16:56.457878 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:16:56.457878 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 626/1237] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:16:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:16:56.462870 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29987faf-bbbd-4efc-a982-de1b6ee6f522 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:56.569510 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29987faf-bbbd-4efc-a982-de1b6ee6f522 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:56.579145 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:16:56.607834 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7a5e5-fd4f-4ea9-8f46-762b9670c74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:56.608558 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7a5e5-fd4f-4ea9-8f46-762b9670c74f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:56.608834 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7a5e5-fd4f-4ea9-8f46-762b9670c74f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:56.609104 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7a5e5-fd4f-4ea9-8f46-762b9670c74f None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:56.609763 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba7a5e5-fd4f-4ea9-8f46-762b9670c74f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:16:56.610068 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba7a5e5-fd4f-4ea9-8f46-762b9670c74f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:56.611419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba7a5e5-fd4f-4ea9-8f46-762b9670c74f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:56.624494 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 612/1238] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:16:56.630455 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135cb48-de1f-4c06-be3a-e275ab998493 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:56.742717 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135cb48-de1f-4c06-be3a-e275ab998493 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:56.780446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fe3ff-76dd-4d51-bc3d-d0c426b35ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:56.781246 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fe3ff-76dd-4d51-bc3d-d0c426b35ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:56.781581 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fe3ff-76dd-4d51-bc3d-d0c426b35ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:56.781955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fe3ff-76dd-4d51-bc3d-d0c426b35ed4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:56.784914 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:16:56.790839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fe3ff-76dd-4d51-bc3d-d0c426b35ed4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:56.792620 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fe3ff-76dd-4d51-bc3d-d0c426b35ed4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:56.804630 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-d75fe3ff-76dd-4d51-bc3d-d0c426b35ed4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 17:16:56.804630 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:16:56.804630 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:16:56.804630 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:16:56.804630 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:16:56.804630 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:16:56.804630 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:16:56.804630 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:16:56.804630 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:16:56.804630 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:16:56.804630 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:16:56.804630 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:16:56.804630 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:16:56.804630 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:16:56.804630 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:16:56.804630 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:16:56.805849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:16:56.805849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:16:56.805849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:16:56.805849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:16:56.805849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:16:56.805849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:16:56.805849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:16:56.805849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:16:56.805849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:16:56.805849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:16:56.805849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:16:56.805849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:16:56.805849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:16:56.805849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:16:56.805849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:16:56.805849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:16:56.805849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:16:56.805849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:16:56.811573 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:16:56.811573 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:16:56.811573 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:16:56.811573 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:16:56.811573 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:16:56.811573 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:16:56.811573 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:16:56.811573 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:16:56.811573 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 17:16:56.811573 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:16:56.811573 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 627/1239] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:16:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:16:56.812320 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7a5e5-fd4f-4ea9-8f46-762b9670c74f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:56.925971 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7a5e5-fd4f-4ea9-8f46-762b9670c74f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:56.970723 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290827b-4a0e-44be-87ec-1f953073b43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:56.971365 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290827b-4a0e-44be-87ec-1f953073b43b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:56.971645 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290827b-4a0e-44be-87ec-1f953073b43b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:56.971918 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290827b-4a0e-44be-87ec-1f953073b43b None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:56.972871 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290827b-4a0e-44be-87ec-1f953073b43b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:16:56.973230 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290827b-4a0e-44be-87ec-1f953073b43b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:56.974848 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290827b-4a0e-44be-87ec-1f953073b43b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:56.996165 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 613/1240] 10.222.0.94 () {56 vars in 1143 bytes} [Thu Sep 1 17:16:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:16:57.002912 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fe3ff-76dd-4d51-bc3d-d0c426b35ed4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:57.120077 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fe3ff-76dd-4d51-bc3d-d0c426b35ed4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:57.155489 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35a288-747c-46f4-9f08-e5dcabd85983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:57.156091 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35a288-747c-46f4-9f08-e5dcabd85983 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:57.156366 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35a288-747c-46f4-9f08-e5dcabd85983 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:57.156629 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35a288-747c-46f4-9f08-e5dcabd85983 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:57.219114 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:16:57.227340 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35a288-747c-46f4-9f08-e5dcabd85983 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:57.228796 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35a288-747c-46f4-9f08-e5dcabd85983 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:57.347742 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 628/1241] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:16:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 17:16:57.349465 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290827b-4a0e-44be-87ec-1f953073b43b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:57.385318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:16:57.473111 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290827b-4a0e-44be-87ec-1f953073b43b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:57.511045 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc27a33-df73-4e28-9778-0114b351eee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:57.511679 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc27a33-df73-4e28-9778-0114b351eee4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:57.511980 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc27a33-df73-4e28-9778-0114b351eee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:57.512276 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc27a33-df73-4e28-9778-0114b351eee4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:57.523284 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc27a33-df73-4e28-9778-0114b351eee4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:57.524726 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc27a33-df73-4e28-9778-0114b351eee4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:57.539456 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-9dc27a33-df73-4e28-9778-0114b351eee4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:16:57.539456 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:16:57.539456 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:16:57.539456 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:16:57.539456 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:16:57.539456 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:16:57.539456 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:16:57.539456 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:16:57.539456 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:16:57.539456 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:16:57.539456 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:16:57.539456 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:16:57.539456 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:16:57.539456 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:16:57.539456 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:16:57.539456 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:16:57.540637 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:16:57.540637 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:16:57.540637 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:16:57.540637 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:16:57.540637 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:16:57.540637 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:16:57.540637 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:16:57.540637 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:16:57.540637 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:16:57.540637 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:16:57.540637 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:16:57.540637 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:16:57.540637 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:16:57.540637 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:16:57.540637 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:16:57.540637 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:16:57.540637 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:16:57.541718 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:16:57.541718 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:16:57.541718 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:16:57.541718 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 614/1242] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:16:57.546514 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35a288-747c-46f4-9f08-e5dcabd85983 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:57.646207 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:16:57.652402 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35a288-747c-46f4-9f08-e5dcabd85983 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:57.689341 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8aa705-dd2e-498a-bde4-279f40ea0219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:57.689966 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8aa705-dd2e-498a-bde4-279f40ea0219 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:57.690281 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8aa705-dd2e-498a-bde4-279f40ea0219 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:57.690519 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8aa705-dd2e-498a-bde4-279f40ea0219 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:57.691166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8aa705-dd2e-498a-bde4-279f40ea0219 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:16:57.691470 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8aa705-dd2e-498a-bde4-279f40ea0219 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:57.693813 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8aa705-dd2e-498a-bde4-279f40ea0219 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:57.706088 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 629/1243] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:16:57.714015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc27a33-df73-4e28-9778-0114b351eee4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:57.801591 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:16:57.825638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc27a33-df73-4e28-9778-0114b351eee4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:57.864245 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30b010-b2b5-4995-a2e3-03ab82655dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:57.864882 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30b010-b2b5-4995-a2e3-03ab82655dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:57.865154 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30b010-b2b5-4995-a2e3-03ab82655dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:57.865446 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30b010-b2b5-4995-a2e3-03ab82655dc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:57.873219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30b010-b2b5-4995-a2e3-03ab82655dc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:57.874721 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30b010-b2b5-4995-a2e3-03ab82655dc9 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:57.888809 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-8c30b010-b2b5-4995-a2e3-03ab82655dc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:16:57.888809 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:16:57.888809 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:16:57.888809 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:16:57.888809 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:16:57.888809 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:16:57.888809 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:16:57.888809 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:16:57.888809 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:16:57.888809 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:16:57.888809 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:16:57.888809 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:16:57.888809 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:16:57.888809 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:16:57.888809 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:16:57.889770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:16:57.889770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:16:57.889770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:16:57.889770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:16:57.889770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:16:57.889770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:16:57.889770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:16:57.889770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:16:57.889770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:16:57.889770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:16:57.889770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:16:57.889770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:16:57.889770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:16:57.889770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:16:57.889770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:16:57.889770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:16:57.889770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:16:57.895717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:16:57.895717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:16:57.895717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:16:57.895717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:16:57.895717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:16:57.895717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:16:57.895717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:16:57.895717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:16:57.895717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 615/1244] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:16:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:16:57.896379 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8aa705-dd2e-498a-bde4-279f40ea0219 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:58.010379 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8aa705-dd2e-498a-bde4-279f40ea0219 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:58.046067 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2f861-3d42-4828-a8b9-b1dac154638a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:58.046783 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2f861-3d42-4828-a8b9-b1dac154638a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:58.047068 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2f861-3d42-4828-a8b9-b1dac154638a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:58.047351 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2f861-3d42-4828-a8b9-b1dac154638a None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:58.048023 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2f861-3d42-4828-a8b9-b1dac154638a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:16:58.048327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2f861-3d42-4828-a8b9-b1dac154638a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:58.049853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2f861-3d42-4828-a8b9-b1dac154638a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:58.062529 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 630/1245] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:16:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:16:58.070155 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30b010-b2b5-4995-a2e3-03ab82655dc9 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:16:58.174971 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30b010-b2b5-4995-a2e3-03ab82655dc9 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:16:58.208801 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63974e5-1968-40ca-b213-ba2989008d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:16:58.209396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63974e5-1968-40ca-b213-ba2989008d61 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:16:58.209697 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63974e5-1968-40ca-b213-ba2989008d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:16:58.210540 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63974e5-1968-40ca-b213-ba2989008d61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:16:58.211241 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63974e5-1968-40ca-b213-ba2989008d61 None admin] RBAC: Adding query filter params (role.id=e903cb11e2bf466fa1b3fae894847c3e, scope.project.id=c8f9428f37354c82ac52b6b8eccc424a, user.id=e3622621761f4f18ae3e9dfb5ba99bef) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:16:58.211546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63974e5-1968-40ca-b213-ba2989008d61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:16:58.213006 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63974e5-1968-40ca-b213-ba2989008d61 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:16:58.220016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 616/1246] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:16:58 2022] GET /identity/v3/role_assignments?user.id=e3622621761f4f18ae3e9dfb5ba99bef&scope.project.id=c8f9428f37354c82ac52b6b8eccc424a&role.id=e903cb11e2bf466fa1b3fae894847c3e => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:17:00.341692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49cb50-6a57-403d-896e-1cfc1620f482 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:00.342271 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49cb50-6a57-403d-896e-1cfc1620f482 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:00.342377 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49cb50-6a57-403d-896e-1cfc1620f482 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:00.343741 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 631/1247] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:17:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:17:00.349304 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e935d5-cef7-4983-9ad9-130c4f7937e4 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:00.349789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e935d5-cef7-4983-9ad9-130c4f7937e4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:00.349885 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e935d5-cef7-4983-9ad9-130c4f7937e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:00.356983 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:00.371252 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-15e935d5-cef7-4983-9ad9-130c4f7937e4 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:17:00.372545 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-15e935d5-cef7-4983-9ad9-130c4f7937e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:17:00.446018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 617/1248] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:17:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:17:00.732069 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49cb50-6a57-403d-896e-1cfc1620f482 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:00.755219 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:00.858252 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49cb50-6a57-403d-896e-1cfc1620f482 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:00.904295 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3790f91-eec5-482e-8767-150221e75603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:00.904953 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3790f91-eec5-482e-8767-150221e75603 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:00.905297 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3790f91-eec5-482e-8767-150221e75603 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:00.905543 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3790f91-eec5-482e-8767-150221e75603 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:00.918425 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3790f91-eec5-482e-8767-150221e75603 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:17:00.925544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-b3790f91-eec5-482e-8767-150221e75603 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:17:00.925544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:17:00.925544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:17:00.925544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:17:00.925544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:17:00.925544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:17:00.925544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:17:00.925544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:17:00.925544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:17:00.925544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:17:00.925544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:17:00.925544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:17:00.925544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:17:00.925544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:17:00.925544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:17:00.925544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:17:00.926729 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:17:00.926729 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:17:00.926729 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:17:00.926729 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:17:00.926729 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:17:00.926729 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:17:00.926729 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:17:00.926729 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:17:00.926729 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:17:00.926729 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:17:00.926729 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:17:00.926729 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:17:00.926729 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:17:00.926729 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:17:00.926729 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:17:00.926729 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:17:00.927689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:17:00.927689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:17:00.927689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:17:00.927689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:17:00.927689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:17:00.927689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:17:00.927689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:17:00.927689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:17:00.927689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:17:00.927689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:17:00.927689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:17:00.927689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:17:00.927689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 632/1249] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:17:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:17:00.933595 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e935d5-cef7-4983-9ad9-130c4f7937e4 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:01.047173 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e935d5-cef7-4983-9ad9-130c4f7937e4 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:01.078036 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:01.084122 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82608a9-77b7-48cc-a648-bdf862ae4d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:01.084904 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82608a9-77b7-48cc-a648-bdf862ae4d93 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:01.085213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82608a9-77b7-48cc-a648-bdf862ae4d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:01.085555 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82608a9-77b7-48cc-a648-bdf862ae4d93 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:01.086316 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82608a9-77b7-48cc-a648-bdf862ae4d93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:17:01.086575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82608a9-77b7-48cc-a648-bdf862ae4d93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:01.088075 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82608a9-77b7-48cc-a648-bdf862ae4d93 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:01.096834 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 618/1250] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:17:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:17:01.103442 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3790f91-eec5-482e-8767-150221e75603 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:01.187350 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:01.216702 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3790f91-eec5-482e-8767-150221e75603 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:01.256659 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f09aa-561b-4e24-8048-9fd6e98a7b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:01.257313 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f09aa-561b-4e24-8048-9fd6e98a7b31 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:01.257753 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f09aa-561b-4e24-8048-9fd6e98a7b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:01.258009 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f09aa-561b-4e24-8048-9fd6e98a7b31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:01.268669 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f09aa-561b-4e24-8048-9fd6e98a7b31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:01.270203 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f09aa-561b-4e24-8048-9fd6e98a7b31 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:01.284777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-cc2f09aa-561b-4e24-8048-9fd6e98a7b31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:17:01.284777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:17:01.284777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:17:01.284777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:17:01.284777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:17:01.284777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:17:01.284777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:17:01.284777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:17:01.284777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:17:01.284777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:17:01.284777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:17:01.284777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:17:01.284777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:17:01.284777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:17:01.284777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:17:01.284777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:17:01.285977 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:17:01.285977 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:17:01.285977 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:17:01.285977 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:17:01.285977 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:17:01.285977 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:17:01.285977 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:17:01.285977 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:17:01.285977 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:17:01.285977 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:17:01.285977 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:17:01.285977 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:17:01.285977 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:17:01.285977 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:17:01.285977 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:17:01.285977 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:17:01.285977 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:17:01.286912 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:17:01.286912 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:17:01.286912 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:17:01.286912 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 633/1251] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:17:01.292480 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82608a9-77b7-48cc-a648-bdf862ae4d93 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:01.406435 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82608a9-77b7-48cc-a648-bdf862ae4d93 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:01.442600 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e2465-15a7-4a34-a582-a70dcff72521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:01.443210 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e2465-15a7-4a34-a582-a70dcff72521 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:01.443493 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e2465-15a7-4a34-a582-a70dcff72521 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:01.443761 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e2465-15a7-4a34-a582-a70dcff72521 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:01.444918 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e2465-15a7-4a34-a582-a70dcff72521 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:17:01.445218 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e2465-15a7-4a34-a582-a70dcff72521 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:01.446615 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e2465-15a7-4a34-a582-a70dcff72521 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:01.463874 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 619/1252] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:17:01.465203 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f09aa-561b-4e24-8048-9fd6e98a7b31 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:01.575317 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f09aa-561b-4e24-8048-9fd6e98a7b31 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:01.603269 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:01.615131 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1b85e-ed58-4474-a43c-7103928239a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:01.616587 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1b85e-ed58-4474-a43c-7103928239a5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:01.616862 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1b85e-ed58-4474-a43c-7103928239a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:01.617129 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1b85e-ed58-4474-a43c-7103928239a5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:01.626784 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1b85e-ed58-4474-a43c-7103928239a5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:01.628674 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1b85e-ed58-4474-a43c-7103928239a5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:01.641580 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-e8d1b85e-ed58-4474-a43c-7103928239a5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 17:17:01.641580 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:17:01.641580 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:17:01.641580 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:17:01.641580 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:17:01.641580 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:17:01.641580 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:17:01.641580 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:17:01.641580 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:17:01.641580 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:17:01.641580 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:17:01.641580 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:17:01.641580 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:17:01.641580 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:17:01.641580 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:17:01.641580 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:17:01.642871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:17:01.642871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:17:01.642871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:17:01.642871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:17:01.642871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:17:01.642871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:17:01.642871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:17:01.642871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:17:01.642871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:17:01.642871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:17:01.642871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:17:01.642871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:17:01.642871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:17:01.642871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:17:01.642871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:17:01.642871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:17:01.642871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:17:01.642871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:17:01.643952 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:17:01.643952 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:17:01.643952 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:17:01.643952 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:17:01.643952 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:17:01.643952 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:17:01.643952 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:17:01.643952 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:17:01.643952 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 17:17:01.643952 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:17:01.643952 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 634/1253] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:17:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:17:01.649650 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e2465-15a7-4a34-a582-a70dcff72521 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:01.714026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:01.766998 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e2465-15a7-4a34-a582-a70dcff72521 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:01.804733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd809b-4116-4676-bc8a-c0f27375ebfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:01.805570 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd809b-4116-4676-bc8a-c0f27375ebfe None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:01.805885 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd809b-4116-4676-bc8a-c0f27375ebfe None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:01.806203 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd809b-4116-4676-bc8a-c0f27375ebfe None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:01.806961 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd809b-4116-4676-bc8a-c0f27375ebfe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:17:01.807268 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd809b-4116-4676-bc8a-c0f27375ebfe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:01.808695 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd809b-4116-4676-bc8a-c0f27375ebfe None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:01.826061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 620/1254] 10.222.0.94 () {56 vars in 1143 bytes} [Thu Sep 1 17:17:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:17:01.832084 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1b85e-ed58-4474-a43c-7103928239a5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:01.945800 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1b85e-ed58-4474-a43c-7103928239a5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:01.990088 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93038570-78da-45db-9a41-9323ce192525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:01.990617 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93038570-78da-45db-9a41-9323ce192525 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:01.990887 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93038570-78da-45db-9a41-9323ce192525 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:01.991178 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93038570-78da-45db-9a41-9323ce192525 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:02.046519 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:02.061169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93038570-78da-45db-9a41-9323ce192525 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:02.062653 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93038570-78da-45db-9a41-9323ce192525 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:02.173068 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 635/1255] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:17:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 17:17:02.179463 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd809b-4116-4676-bc8a-c0f27375ebfe None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:02.285617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd809b-4116-4676-bc8a-c0f27375ebfe None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:02.301161 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:02.324955 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5555fed-03ae-44f7-8eef-103f36882581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:02.325615 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5555fed-03ae-44f7-8eef-103f36882581 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:02.325914 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5555fed-03ae-44f7-8eef-103f36882581 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:02.326186 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5555fed-03ae-44f7-8eef-103f36882581 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:02.337956 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5555fed-03ae-44f7-8eef-103f36882581 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:02.339525 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5555fed-03ae-44f7-8eef-103f36882581 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:02.354837 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-d5555fed-03ae-44f7-8eef-103f36882581 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:17:02.354837 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:17:02.354837 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:17:02.354837 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:17:02.354837 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:17:02.354837 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:17:02.354837 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:17:02.354837 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:17:02.354837 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:17:02.354837 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:17:02.354837 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:17:02.354837 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:17:02.354837 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:17:02.354837 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:17:02.354837 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:17:02.354837 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:17:02.356262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:17:02.356262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:17:02.356262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:17:02.356262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:17:02.356262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:17:02.356262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:17:02.356262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:17:02.356262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:17:02.356262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:17:02.356262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:17:02.356262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:17:02.356262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:17:02.356262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:17:02.356262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:17:02.356262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:17:02.356262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:17:02.356262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:17:02.357491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:17:02.357491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:17:02.357491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:17:02.357491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 621/1256] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:17:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:17:02.361861 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93038570-78da-45db-9a41-9323ce192525 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:02.454570 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:02.469816 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93038570-78da-45db-9a41-9323ce192525 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:02.506482 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b582302-f875-4f10-a076-e13f4b299cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:02.507229 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b582302-f875-4f10-a076-e13f4b299cca None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:02.507533 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b582302-f875-4f10-a076-e13f4b299cca None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:02.507804 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b582302-f875-4f10-a076-e13f4b299cca None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:02.508505 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b582302-f875-4f10-a076-e13f4b299cca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:17:02.508847 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b582302-f875-4f10-a076-e13f4b299cca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:02.510561 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b582302-f875-4f10-a076-e13f4b299cca None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:02.523783 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 636/1257] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:17:02.529825 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5555fed-03ae-44f7-8eef-103f36882581 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:02.638967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5555fed-03ae-44f7-8eef-103f36882581 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:02.676951 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b422e31-4984-4e21-84b5-f53e56094b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:02.677612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b422e31-4984-4e21-84b5-f53e56094b72 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:02.677891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b422e31-4984-4e21-84b5-f53e56094b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:02.678159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b422e31-4984-4e21-84b5-f53e56094b72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:02.685769 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b422e31-4984-4e21-84b5-f53e56094b72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:02.687525 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b422e31-4984-4e21-84b5-f53e56094b72 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:02.700800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-8b422e31-4984-4e21-84b5-f53e56094b72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:17:02.700800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:17:02.700800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:17:02.700800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:17:02.700800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:17:02.700800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:17:02.700800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:17:02.700800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:17:02.700800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:17:02.700800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:17:02.700800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:17:02.700800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:17:02.700800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:17:02.700800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:17:02.700800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:17:02.702252 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:17:02.702252 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:17:02.702252 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:17:02.702252 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:17:02.702252 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:17:02.702252 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:17:02.702252 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:17:02.702252 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:17:02.702252 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:17:02.702252 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:17:02.702252 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:17:02.702252 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:17:02.702252 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:17:02.702252 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:17:02.702252 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:17:02.702252 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:17:02.702252 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:17:02.708113 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:17:02.708113 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:17:02.708113 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:17:02.708113 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:17:02.708113 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:17:02.708113 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:17:02.708113 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:17:02.708113 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:17:02.708113 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 622/1258] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:17:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:17:02.708617 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b582302-f875-4f10-a076-e13f4b299cca None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:02.822187 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b582302-f875-4f10-a076-e13f4b299cca None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:02.858825 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4237e-c8a2-4c85-adeb-bf65e3220515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:02.859455 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4237e-c8a2-4c85-adeb-bf65e3220515 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:02.859734 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4237e-c8a2-4c85-adeb-bf65e3220515 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:02.860006 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4237e-c8a2-4c85-adeb-bf65e3220515 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:02.860708 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4237e-c8a2-4c85-adeb-bf65e3220515 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:17:02.861010 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4237e-c8a2-4c85-adeb-bf65e3220515 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:02.862516 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4237e-c8a2-4c85-adeb-bf65e3220515 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:02.876561 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 637/1259] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:17:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:17:02.882737 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b422e31-4984-4e21-84b5-f53e56094b72 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:02.913672 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:02.997937 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b422e31-4984-4e21-84b5-f53e56094b72 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:03.032733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f578203-f6c7-4638-bc41-77429039d0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:03.033343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f578203-f6c7-4638-bc41-77429039d0c8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:03.033646 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f578203-f6c7-4638-bc41-77429039d0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:03.033916 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f578203-f6c7-4638-bc41-77429039d0c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:03.034644 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f578203-f6c7-4638-bc41-77429039d0c8 None admin] RBAC: Adding query filter params (role.id=70f911a75b7b40a19f65857b9d19cfad, scope.project.id=c8f9428f37354c82ac52b6b8eccc424a, user.id=e3622621761f4f18ae3e9dfb5ba99bef) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:17:03.034947 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f578203-f6c7-4638-bc41-77429039d0c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:03.036372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f578203-f6c7-4638-bc41-77429039d0c8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:03.042129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 623/1260] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:17:02 2022] GET /identity/v3/role_assignments?user.id=e3622621761f4f18ae3e9dfb5ba99bef&scope.project.id=c8f9428f37354c82ac52b6b8eccc424a&role.id=70f911a75b7b40a19f65857b9d19cfad => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:17:04.949965 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd0528-cdad-42e7-afbf-c4a732b782c7 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:04.950501 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd0528-cdad-42e7-afbf-c4a732b782c7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:04.950501 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd0528-cdad-42e7-afbf-c4a732b782c7 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:04.952099 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 638/1261] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:17:04.957375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13927a55-a865-4901-a354-77980cf702e1 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:04.957846 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13927a55-a865-4901-a354-77980cf702e1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:04.957940 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13927a55-a865-4901-a354-77980cf702e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:04.976167 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-13927a55-a865-4901-a354-77980cf702e1 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:17:04.977425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-13927a55-a865-4901-a354-77980cf702e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:17:05.040753 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 624/1262] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:17:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:17:05.301948 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd0528-cdad-42e7-afbf-c4a732b782c7 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:05.313077 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:05.400790 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd0528-cdad-42e7-afbf-c4a732b782c7 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:05.433055 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1091eeb-67b2-4160-995c-c40cf8a9dc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:05.433694 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1091eeb-67b2-4160-995c-c40cf8a9dc13 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:05.433971 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1091eeb-67b2-4160-995c-c40cf8a9dc13 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:05.434239 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1091eeb-67b2-4160-995c-c40cf8a9dc13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:05.443914 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1091eeb-67b2-4160-995c-c40cf8a9dc13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:17:05.448689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-b1091eeb-67b2-4160-995c-c40cf8a9dc13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:17:05.448689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:17:05.448689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:17:05.448689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:17:05.448689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:17:05.448689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:17:05.448689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:17:05.448689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:17:05.448689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:17:05.448689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:17:05.448689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:17:05.448689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:17:05.448689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:17:05.448689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:17:05.448689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:17:05.448689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:17:05.449805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:17:05.449805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:17:05.449805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:17:05.449805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:17:05.449805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:17:05.449805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:17:05.449805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:17:05.449805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:17:05.449805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:17:05.449805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:17:05.449805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:17:05.449805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:17:05.449805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:17:05.449805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:17:05.449805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:17:05.449805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:17:05.450801 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:17:05.450801 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:17:05.450801 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:17:05.450801 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:17:05.450801 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:17:05.450801 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:17:05.450801 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:17:05.450801 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:17:05.450801 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:17:05.450801 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:17:05.450801 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:17:05.450801 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:17:05.450801 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 639/1263] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:17:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:17:05.455854 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13927a55-a865-4901-a354-77980cf702e1 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:05.473831 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:05.550609 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13927a55-a865-4901-a354-77980cf702e1 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:05.583750 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4c162-ef29-4f0a-a2bb-bdbfcbcdc9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:05.584277 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4c162-ef29-4f0a-a2bb-bdbfcbcdc9df None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:05.584576 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4c162-ef29-4f0a-a2bb-bdbfcbcdc9df None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:05.584845 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4c162-ef29-4f0a-a2bb-bdbfcbcdc9df None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:05.585517 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4c162-ef29-4f0a-a2bb-bdbfcbcdc9df None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:17:05.585815 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4c162-ef29-4f0a-a2bb-bdbfcbcdc9df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:05.587159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4c162-ef29-4f0a-a2bb-bdbfcbcdc9df None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:05.594760 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 625/1264] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:17:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:17:05.600903 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1091eeb-67b2-4160-995c-c40cf8a9dc13 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:05.668576 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:05.705083 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1091eeb-67b2-4160-995c-c40cf8a9dc13 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:05.738044 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7613da-9807-4eb2-9af6-346f336e324c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:05.738661 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7613da-9807-4eb2-9af6-346f336e324c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:05.738936 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7613da-9807-4eb2-9af6-346f336e324c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:05.739201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7613da-9807-4eb2-9af6-346f336e324c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:05.749378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7613da-9807-4eb2-9af6-346f336e324c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:05.750834 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7613da-9807-4eb2-9af6-346f336e324c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:05.765563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-5b7613da-9807-4eb2-9af6-346f336e324c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:17:05.765563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:17:05.765563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:17:05.765563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:17:05.765563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:17:05.765563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:17:05.765563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:17:05.765563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:17:05.765563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:17:05.765563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:17:05.765563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:17:05.765563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:17:05.765563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:17:05.765563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:17:05.765563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:17:05.765563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:17:05.766563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:17:05.766563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:17:05.766563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:17:05.766563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:17:05.766563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:17:05.766563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:17:05.766563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:17:05.766563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:17:05.766563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:17:05.766563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:17:05.766563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:17:05.766563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:17:05.766563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:17:05.766563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:17:05.766563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:17:05.766563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:17:05.766563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:17:05.767692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:17:05.767692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:17:05.767692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:17:05.767692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 640/1265] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:17:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:17:05.772431 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4c162-ef29-4f0a-a2bb-bdbfcbcdc9df None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:05.851267 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:05.870532 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4c162-ef29-4f0a-a2bb-bdbfcbcdc9df None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:05.904775 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f80fc1-aa98-449a-aed8-070651b540ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:05.905460 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f80fc1-aa98-449a-aed8-070651b540ba None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:05.905787 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f80fc1-aa98-449a-aed8-070651b540ba None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:05.906102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f80fc1-aa98-449a-aed8-070651b540ba None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:05.906785 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f80fc1-aa98-449a-aed8-070651b540ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:17:05.907133 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f80fc1-aa98-449a-aed8-070651b540ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:05.908563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f80fc1-aa98-449a-aed8-070651b540ba None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:05.922728 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 626/1266] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:17:05.929354 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7613da-9807-4eb2-9af6-346f336e324c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:06.039587 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7613da-9807-4eb2-9af6-346f336e324c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:06.065984 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:06.080531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54617003-e83f-4333-8c73-3263539b9e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:06.081151 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54617003-e83f-4333-8c73-3263539b9e3a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:06.081457 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54617003-e83f-4333-8c73-3263539b9e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:06.081755 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54617003-e83f-4333-8c73-3263539b9e3a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:06.088929 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54617003-e83f-4333-8c73-3263539b9e3a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:06.090351 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54617003-e83f-4333-8c73-3263539b9e3a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:06.101115 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-54617003-e83f-4333-8c73-3263539b9e3a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 17:17:06.101115 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:17:06.101115 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:17:06.101115 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:17:06.101115 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:17:06.101115 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:17:06.101115 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:17:06.101115 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:17:06.101115 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:17:06.101115 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:17:06.101115 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:17:06.101115 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:17:06.101115 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:17:06.101115 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:17:06.101115 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:17:06.101115 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:17:06.102305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:17:06.102305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:17:06.102305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:17:06.102305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:17:06.102305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:17:06.102305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:17:06.102305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:17:06.102305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:17:06.102305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:17:06.102305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:17:06.102305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:17:06.102305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:17:06.102305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:17:06.102305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:17:06.102305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:17:06.102305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:17:06.102305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:17:06.102305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:17:06.103673 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:17:06.103673 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:17:06.103673 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:17:06.103673 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:17:06.103673 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:17:06.103673 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:17:06.103673 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:17:06.103673 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:17:06.103673 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 17:17:06.103673 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:17:06.103673 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 641/1267] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:17:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:17:06.108065 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f80fc1-aa98-449a-aed8-070651b540ba None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:06.203739 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f80fc1-aa98-449a-aed8-070651b540ba None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:06.235106 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65733c7d-bf3f-43b5-9eef-23a3e0abe1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:06.235681 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65733c7d-bf3f-43b5-9eef-23a3e0abe1da None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:06.235956 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65733c7d-bf3f-43b5-9eef-23a3e0abe1da None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:06.236219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65733c7d-bf3f-43b5-9eef-23a3e0abe1da None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:06.236923 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65733c7d-bf3f-43b5-9eef-23a3e0abe1da None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:17:06.237217 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65733c7d-bf3f-43b5-9eef-23a3e0abe1da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:06.238635 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65733c7d-bf3f-43b5-9eef-23a3e0abe1da None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:06.247491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:06.256073 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 627/1268] 10.222.0.94 () {56 vars in 1143 bytes} [Thu Sep 1 17:17:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:17:06.262333 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54617003-e83f-4333-8c73-3263539b9e3a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:06.358209 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54617003-e83f-4333-8c73-3263539b9e3a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:06.390995 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a1b3e-c112-4a64-a94c-6df141e2189d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:06.391608 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a1b3e-c112-4a64-a94c-6df141e2189d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:06.391885 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a1b3e-c112-4a64-a94c-6df141e2189d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:06.392154 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a1b3e-c112-4a64-a94c-6df141e2189d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:06.402792 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a1b3e-c112-4a64-a94c-6df141e2189d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:06.404234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a1b3e-c112-4a64-a94c-6df141e2189d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:06.417849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-9d3a1b3e-c112-4a64-a94c-6df141e2189d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:17:06.417849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:17:06.417849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:17:06.417849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:17:06.417849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:17:06.417849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:17:06.417849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:17:06.417849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:17:06.417849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:17:06.417849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:17:06.417849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:17:06.417849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:17:06.417849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:17:06.417849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:17:06.417849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:17:06.417849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:17:06.418985 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:17:06.418985 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:17:06.418985 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:17:06.418985 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:17:06.418985 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:17:06.418985 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:17:06.418985 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:17:06.418985 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:17:06.418985 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:17:06.418985 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:17:06.418985 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:17:06.418985 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:17:06.418985 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:17:06.418985 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:17:06.418985 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:17:06.418985 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:17:06.418985 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:17:06.420146 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:17:06.420146 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:17:06.420146 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:17:06.420146 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 642/1269] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:17:06.424687 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65733c7d-bf3f-43b5-9eef-23a3e0abe1da None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:06.519065 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65733c7d-bf3f-43b5-9eef-23a3e0abe1da None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:06.552382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27324689-eb26-418b-b400-d9ef86587658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:06.552973 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27324689-eb26-418b-b400-d9ef86587658 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:06.553333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27324689-eb26-418b-b400-d9ef86587658 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:06.553648 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27324689-eb26-418b-b400-d9ef86587658 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:06.554278 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27324689-eb26-418b-b400-d9ef86587658 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:17:06.554580 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27324689-eb26-418b-b400-d9ef86587658 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:06.555922 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27324689-eb26-418b-b400-d9ef86587658 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:06.566724 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 628/1270] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:17:06.573070 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a1b3e-c112-4a64-a94c-6df141e2189d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:06.604640 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:06.670218 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a1b3e-c112-4a64-a94c-6df141e2189d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:06.702824 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eec1e7-41dd-483e-9ecd-415cb891b990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:06.703439 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eec1e7-41dd-483e-9ecd-415cb891b990 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:06.703716 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eec1e7-41dd-483e-9ecd-415cb891b990 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:06.703985 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eec1e7-41dd-483e-9ecd-415cb891b990 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:06.710873 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eec1e7-41dd-483e-9ecd-415cb891b990 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:06.712302 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eec1e7-41dd-483e-9ecd-415cb891b990 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:06.723219 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-15eec1e7-41dd-483e-9ecd-415cb891b990 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:17:06.723219 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:17:06.723219 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:17:06.723219 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:17:06.723219 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:17:06.723219 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:17:06.723219 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:17:06.723219 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:17:06.723219 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:17:06.723219 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:17:06.723219 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:17:06.723219 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:17:06.723219 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:17:06.723219 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:17:06.723219 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:17:06.724258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:17:06.724258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:17:06.724258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:17:06.724258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:17:06.724258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:17:06.724258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:17:06.724258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:17:06.724258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:17:06.724258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:17:06.724258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:17:06.724258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:17:06.724258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:17:06.724258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:17:06.724258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:17:06.724258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:17:06.724258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:17:06.724258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:17:06.725692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:17:06.725692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:17:06.725692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:17:06.725692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:17:06.725692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:17:06.725692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:17:06.725692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:17:06.725692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:17:06.725692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 643/1271] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:17:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:17:06.730040 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27324689-eb26-418b-b400-d9ef86587658 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:06.786396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:06.827429 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27324689-eb26-418b-b400-d9ef86587658 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:06.860194 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75e6b8-cc24-4013-8c4d-022daf6f2ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:06.860787 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75e6b8-cc24-4013-8c4d-022daf6f2ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:06.861063 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75e6b8-cc24-4013-8c4d-022daf6f2ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:06.861332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75e6b8-cc24-4013-8c4d-022daf6f2ee6 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:06.862056 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d75e6b8-cc24-4013-8c4d-022daf6f2ee6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:17:06.862358 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d75e6b8-cc24-4013-8c4d-022daf6f2ee6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:06.863767 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d75e6b8-cc24-4013-8c4d-022daf6f2ee6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:06.875088 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 629/1272] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:17:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:17:06.881170 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eec1e7-41dd-483e-9ecd-415cb891b990 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:06.977285 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:06.985896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eec1e7-41dd-483e-9ecd-415cb891b990 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:07.018598 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6303d7-f259-458e-8e17-000ab84fc40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:07.019243 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6303d7-f259-458e-8e17-000ab84fc40c None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:07.019524 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6303d7-f259-458e-8e17-000ab84fc40c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:07.019791 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6303d7-f259-458e-8e17-000ab84fc40c None admin] PATH_INFO: `/v3/projects/c8f9428f37354c82ac52b6b8eccc424a/users/e3622621761f4f18ae3e9dfb5ba99bef/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:07.021656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6303d7-f259-458e-8e17-000ab84fc40c None admin] RBAC: Authorizing `identity:create_grant(project_id=c8f9428f37354c82ac52b6b8eccc424a, user_id=e3622621761f4f18ae3e9dfb5ba99bef, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:07.023129 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6303d7-f259-458e-8e17-000ab84fc40c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:07.035176 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 644/1273] 10.222.0.94 () {58 vars in 1439 bytes} [Thu Sep 1 17:17:06 2022] PUT /identity/v3/projects/c8f9428f37354c82ac52b6b8eccc424a/users/e3622621761f4f18ae3e9dfb5ba99bef/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:17:08.918199 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bd334-3fb7-4f11-aeb4-21996622e380 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:08.918749 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bd334-3fb7-4f11-aeb4-21996622e380 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:08.918845 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bd334-3fb7-4f11-aeb4-21996622e380 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:08.920306 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 630/1274] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:17:08.925808 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d832c-6c9d-4dab-b450-ef54ed20cf45 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:08.926270 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d832c-6c9d-4dab-b450-ef54ed20cf45 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:08.926383 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d832c-6c9d-4dab-b450-ef54ed20cf45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:08.949182 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-016d832c-6c9d-4dab-b450-ef54ed20cf45 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:17:08.950595 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-016d832c-6c9d-4dab-b450-ef54ed20cf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:17:09.018445 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 645/1275] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:17:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:17:09.291381 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bd334-3fb7-4f11-aeb4-21996622e380 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:09.389030 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bd334-3fb7-4f11-aeb4-21996622e380 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:09.405848 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:09.421981 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56729f0c-707e-4597-ae5d-afed5e3368b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:09.422594 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56729f0c-707e-4597-ae5d-afed5e3368b4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:09.422867 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56729f0c-707e-4597-ae5d-afed5e3368b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:09.423133 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56729f0c-707e-4597-ae5d-afed5e3368b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:09.432724 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56729f0c-707e-4597-ae5d-afed5e3368b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 17:17:09.437483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-56729f0c-707e-4597-ae5d-afed5e3368b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:17:09.437483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:17:09.437483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:17:09.437483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:17:09.437483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:17:09.437483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:17:09.437483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:17:09.437483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:17:09.437483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:17:09.437483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:17:09.437483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:17:09.437483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:17:09.437483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 17:17:09.437483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 17:17:09.437483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 17:17:09.437483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 17:17:09.438657 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 17:17:09.438657 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 17:17:09.438657 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 17:17:09.438657 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 17:17:09.438657 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:17:09.438657 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:17:09.438657 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:17:09.438657 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:17:09.438657 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:17:09.438657 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:17:09.438657 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:17:09.438657 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:17:09.438657 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:17:09.438657 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:17:09.438657 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:17:09.438657 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:17:09.439741 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:17:09.439741 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:17:09.439741 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:17:09.439741 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:17:09.439741 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 17:17:09.439741 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 17:17:09.439741 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 17:17:09.439741 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 17:17:09.439741 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 17:17:09.439741 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 17:17:09.439741 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 17:17:09.439741 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:17:09.439741 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 631/1276] 10.222.0.94 () {56 vars in 1096 bytes} [Thu Sep 1 17:17:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:17:09.444926 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d832c-6c9d-4dab-b450-ef54ed20cf45 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:09.522732 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:09.540973 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d832c-6c9d-4dab-b450-ef54ed20cf45 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:09.574011 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64421af-53b0-489c-8125-dd13462d0b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:09.574554 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64421af-53b0-489c-8125-dd13462d0b09 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:09.574830 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64421af-53b0-489c-8125-dd13462d0b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:09.575098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64421af-53b0-489c-8125-dd13462d0b09 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:09.575753 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64421af-53b0-489c-8125-dd13462d0b09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:17:09.576052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64421af-53b0-489c-8125-dd13462d0b09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:09.577696 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64421af-53b0-489c-8125-dd13462d0b09 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:09.585977 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 646/1277] 10.222.0.94 () {56 vars in 1099 bytes} [Thu Sep 1 17:17:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:17:09.591663 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56729f0c-707e-4597-ae5d-afed5e3368b4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:09.690778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56729f0c-707e-4597-ae5d-afed5e3368b4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:09.725119 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c42ac-970a-48d3-a203-ab5e21166312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:09.725777 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c42ac-970a-48d3-a203-ab5e21166312 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:09.726058 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c42ac-970a-48d3-a203-ab5e21166312 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:09.726331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c42ac-970a-48d3-a203-ab5e21166312 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:09.735915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c42ac-970a-48d3-a203-ab5e21166312 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:09.737350 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c42ac-970a-48d3-a203-ab5e21166312 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:09.752000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-867c42ac-970a-48d3-a203-ab5e21166312 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:17:09.752000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:17:09.752000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:17:09.752000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:17:09.752000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:17:09.752000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:17:09.752000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:17:09.752000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:17:09.752000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:17:09.752000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:17:09.752000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:17:09.752000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:17:09.752000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:17:09.752000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:17:09.752000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:17:09.752000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:17:09.753157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:17:09.753157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:17:09.753157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:17:09.753157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:17:09.753157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:17:09.753157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:17:09.753157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:17:09.753157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:17:09.753157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:17:09.753157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:17:09.753157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:17:09.753157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:17:09.753157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:17:09.753157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:17:09.753157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:17:09.753157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:17:09.753157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:17:09.754464 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:17:09.754464 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:17:09.754464 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:17:09.754464 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 632/1278] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:17:09.759818 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64421af-53b0-489c-8125-dd13462d0b09 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:09.857642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64421af-53b0-489c-8125-dd13462d0b09 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:09.890882 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895511d-d41a-48c1-a37a-175eb8bd7827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:09.891478 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895511d-d41a-48c1-a37a-175eb8bd7827 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:09.891757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895511d-d41a-48c1-a37a-175eb8bd7827 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:09.892027 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895511d-d41a-48c1-a37a-175eb8bd7827 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:09.892663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895511d-d41a-48c1-a37a-175eb8bd7827 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:17:09.892970 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895511d-d41a-48c1-a37a-175eb8bd7827 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:09.894351 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895511d-d41a-48c1-a37a-175eb8bd7827 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:09.906226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 647/1279] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:17:09.912112 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c42ac-970a-48d3-a203-ab5e21166312 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:09.946203 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:10.017423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c42ac-970a-48d3-a203-ab5e21166312 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:10.062547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465e29b-8e7c-4b49-a0a0-3d120237d3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:10.063166 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465e29b-8e7c-4b49-a0a0-3d120237d3f8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:10.063440 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465e29b-8e7c-4b49-a0a0-3d120237d3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:10.063705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465e29b-8e7c-4b49-a0a0-3d120237d3f8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:10.071491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465e29b-8e7c-4b49-a0a0-3d120237d3f8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:10.072930 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465e29b-8e7c-4b49-a0a0-3d120237d3f8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:10.084270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-8465e29b-8e7c-4b49-a0a0-3d120237d3f8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 17:17:10.084270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:17:10.084270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:17:10.084270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:17:10.084270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:17:10.084270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:17:10.084270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:17:10.084270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:17:10.084270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:17:10.084270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:17:10.084270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:17:10.084270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:17:10.084270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 17:17:10.084270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 17:17:10.084270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 17:17:10.084270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 17:17:10.086018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:17:10.086018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:17:10.086018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 17:17:10.086018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:17:10.086018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 17:17:10.086018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 17:17:10.086018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:17:10.086018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:17:10.086018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:17:10.086018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:17:10.086018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:17:10.086018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:17:10.086018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:17:10.086018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:17:10.086018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:17:10.086018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:17:10.086018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:17:10.086018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:17:10.086998 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:17:10.086998 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:17:10.086998 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 17:17:10.086998 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 17:17:10.086998 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 17:17:10.086998 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 17:17:10.086998 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 17:17:10.086998 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 17:17:10.086998 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 17:17:10.086998 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:17:10.086998 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 633/1280] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:17:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 17:17:10.091886 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895511d-d41a-48c1-a37a-175eb8bd7827 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:10.095642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:10.186580 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895511d-d41a-48c1-a37a-175eb8bd7827 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:10.220122 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134ed3b-573a-41bc-8e69-85f9f09c1376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:10.220709 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134ed3b-573a-41bc-8e69-85f9f09c1376 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:10.220983 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134ed3b-573a-41bc-8e69-85f9f09c1376 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:10.221255 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134ed3b-573a-41bc-8e69-85f9f09c1376 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:10.221993 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134ed3b-573a-41bc-8e69-85f9f09c1376 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:17:10.222295 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134ed3b-573a-41bc-8e69-85f9f09c1376 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:10.223707 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134ed3b-573a-41bc-8e69-85f9f09c1376 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:10.239996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 648/1281] 10.222.0.94 () {56 vars in 1143 bytes} [Thu Sep 1 17:17:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:17:10.245743 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465e29b-8e7c-4b49-a0a0-3d120237d3f8 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:10.333189 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:10.344725 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465e29b-8e7c-4b49-a0a0-3d120237d3f8 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:10.376736 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df27ac3-f433-4e41-94f8-329a61ff0f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:10.377329 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df27ac3-f433-4e41-94f8-329a61ff0f94 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:10.377635 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df27ac3-f433-4e41-94f8-329a61ff0f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:10.377908 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df27ac3-f433-4e41-94f8-329a61ff0f94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:10.449626 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df27ac3-f433-4e41-94f8-329a61ff0f94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:10.451001 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df27ac3-f433-4e41-94f8-329a61ff0f94 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:10.538417 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:10.548764 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 634/1282] 10.222.0.94 () {58 vars in 1282 bytes} [Thu Sep 1 17:17:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 17:17:10.555064 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134ed3b-573a-41bc-8e69-85f9f09c1376 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:10.613079 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:10.650399 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134ed3b-573a-41bc-8e69-85f9f09c1376 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:10.682455 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7a478-4ba3-4de1-8c37-2bb87b4ce215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:10.683068 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7a478-4ba3-4de1-8c37-2bb87b4ce215 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:10.683342 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7a478-4ba3-4de1-8c37-2bb87b4ce215 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:10.683608 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7a478-4ba3-4de1-8c37-2bb87b4ce215 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:10.694958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7a478-4ba3-4de1-8c37-2bb87b4ce215 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:10.696386 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7a478-4ba3-4de1-8c37-2bb87b4ce215 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:10.711482 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-ced7a478-4ba3-4de1-8c37-2bb87b4ce215 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:17:10.711482 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:17:10.711482 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:17:10.711482 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:17:10.711482 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:17:10.711482 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:17:10.711482 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:17:10.711482 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:17:10.711482 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:17:10.711482 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:17:10.711482 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:17:10.711482 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:17:10.711482 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 17:17:10.711482 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 17:17:10.711482 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 17:17:10.711482 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 17:17:10.716679 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:17:10.716679 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:17:10.716679 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:17:10.716679 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:17:10.716679 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:17:10.716679 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:17:10.716679 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:17:10.716679 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:17:10.716679 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:17:10.716679 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:17:10.716679 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:17:10.716679 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:17:10.716679 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:17:10.716679 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:17:10.716679 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:17:10.716679 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:17:10.716679 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 17:17:10.717717 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 17:17:10.717717 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 17:17:10.717717 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:17:10.717717 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 649/1283] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:17:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:17:10.718201 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df27ac3-f433-4e41-94f8-329a61ff0f94 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:10.812150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df27ac3-f433-4e41-94f8-329a61ff0f94 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:10.844609 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6652c8-4642-4e4f-861e-737bcad2e261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:10.845191 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6652c8-4642-4e4f-861e-737bcad2e261 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:10.845493 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6652c8-4642-4e4f-861e-737bcad2e261 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:10.845763 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6652c8-4642-4e4f-861e-737bcad2e261 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:10.846388 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6652c8-4642-4e4f-861e-737bcad2e261 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:17:10.846686 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6652c8-4642-4e4f-861e-737bcad2e261 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:10.848026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6652c8-4642-4e4f-861e-737bcad2e261 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:10.859430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 635/1284] 10.222.0.94 () {56 vars in 1109 bytes} [Thu Sep 1 17:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:17:10.864976 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7a478-4ba3-4de1-8c37-2bb87b4ce215 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:10.970074 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7a478-4ba3-4de1-8c37-2bb87b4ce215 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:10.983009 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:11.002317 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafb1d8-81a0-47dc-9122-a810f176d590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:11.002961 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafb1d8-81a0-47dc-9122-a810f176d590 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:11.003221 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafb1d8-81a0-47dc-9122-a810f176d590 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:11.003490 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafb1d8-81a0-47dc-9122-a810f176d590 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:11.010352 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eafb1d8-81a0-47dc-9122-a810f176d590 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:11.011776 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eafb1d8-81a0-47dc-9122-a810f176d590 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:11.022757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-7eafb1d8-81a0-47dc-9122-a810f176d590 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:17:11.022757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:17:11.022757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:17:11.022757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:17:11.022757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:17:11.022757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:17:11.022757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:17:11.022757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:17:11.022757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:17:11.022757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:17:11.022757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:17:11.022757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:17:11.022757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 17:17:11.022757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 17:17:11.022757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 17:17:11.023683 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 17:17:11.023683 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:17:11.023683 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:17:11.023683 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:17:11.023683 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:17:11.023683 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:17:11.023683 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:17:11.023683 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:17:11.023683 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 01 17:17:11.023683 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:17:11.023683 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:17:11.023683 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:17:11.023683 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:17:11.023683 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:17:11.023683 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:17:11.023683 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:17:11.023683 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:17:11.024660 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 17:17:11.024660 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 17:17:11.024660 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 17:17:11.024660 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 17:17:11.024660 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 17:17:11.024660 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 17:17:11.024660 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 17:17:11.024660 dv-cinder-852211-8-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 01 17:17:11.024660 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 650/1285] 10.222.0.94 () {56 vars in 1111 bytes} [Thu Sep 1 17:17:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:17:11.029742 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6652c8-4642-4e4f-861e-737bcad2e261 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:11.079489 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:11.128114 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6652c8-4642-4e4f-861e-737bcad2e261 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:11.160015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddd1c1-6f9d-4efe-8b52-ff9f67342f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:11.160618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddd1c1-6f9d-4efe-8b52-ff9f67342f2c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:11.160901 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddd1c1-6f9d-4efe-8b52-ff9f67342f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:11.161173 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddd1c1-6f9d-4efe-8b52-ff9f67342f2c None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:11.161883 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddd1c1-6f9d-4efe-8b52-ff9f67342f2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:17:11.162188 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddd1c1-6f9d-4efe-8b52-ff9f67342f2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:11.164126 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddd1c1-6f9d-4efe-8b52-ff9f67342f2c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:11.175537 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 636/1286] 10.222.0.94 () {56 vars in 1148 bytes} [Thu Sep 1 17:17:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:17:11.181694 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafb1d8-81a0-47dc-9122-a810f176d590 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:11.279314 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafb1d8-81a0-47dc-9122-a810f176d590 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:11.311341 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9106d86-eab1-495c-813d-ec0d3e303f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:11.311925 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9106d86-eab1-495c-813d-ec0d3e303f75 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:11.312202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9106d86-eab1-495c-813d-ec0d3e303f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:11.312472 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9106d86-eab1-495c-813d-ec0d3e303f75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:11.313190 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9106d86-eab1-495c-813d-ec0d3e303f75 None admin] RBAC: Adding query filter params (role.id=70f911a75b7b40a19f65857b9d19cfad, scope.project.id=c8f9428f37354c82ac52b6b8eccc424a, user.id=e3622621761f4f18ae3e9dfb5ba99bef) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:17:11.313528 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9106d86-eab1-495c-813d-ec0d3e303f75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:11.314949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9106d86-eab1-495c-813d-ec0d3e303f75 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:11.320503 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 651/1287] 10.222.0.94 () {56 vars in 1374 bytes} [Thu Sep 1 17:17:11 2022] GET /identity/v3/role_assignments?user.id=e3622621761f4f18ae3e9dfb5ba99bef&scope.project.id=c8f9428f37354c82ac52b6b8eccc424a&role.id=70f911a75b7b40a19f65857b9d19cfad => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:17:13.212065 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b14c2-9a11-4215-beb7-ab2c4de29fd7 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:13.212624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b14c2-9a11-4215-beb7-ab2c4de29fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:13.212624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b14c2-9a11-4215-beb7-ab2c4de29fd7 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:13.213960 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 637/1288] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:17:13.218893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3935d3-fcb5-4a59-a1b3-8cc8eced0ea4 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:13.219267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3935d3-fcb5-4a59-a1b3-8cc8eced0ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:13.219448 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3935d3-fcb5-4a59-a1b3-8cc8eced0ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:13.237750 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ce3935d3-fcb5-4a59-a1b3-8cc8eced0ea4 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:17:13.238926 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ce3935d3-fcb5-4a59-a1b3-8cc8eced0ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:17:13.267731 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:13.305152 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 652/1289] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:17:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:17:13.566628 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b14c2-9a11-4215-beb7-ab2c4de29fd7 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:13.663374 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b14c2-9a11-4215-beb7-ab2c4de29fd7 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:13.673349 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:13.695582 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b979fd-da84-4bf1-ac07-0ebed663bf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:13.696192 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b979fd-da84-4bf1-ac07-0ebed663bf79 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:13.696464 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b979fd-da84-4bf1-ac07-0ebed663bf79 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:13.696727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b979fd-da84-4bf1-ac07-0ebed663bf79 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:13.697296 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b979fd-da84-4bf1-ac07-0ebed663bf79 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:13.698662 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b979fd-da84-4bf1-ac07-0ebed663bf79 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:13.707371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-d1b979fd-da84-4bf1-ac07-0ebed663bf79 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 17:17:13.707371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:17:13.707371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:17:13.707371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:17:13.707371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:17:13.707371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:17:13.707371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:17:13.707371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:17:13.707371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 17:17:13.707371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:17:13.707371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:17:13.707371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:17:13.707371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:17:13.707371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:17:13.707371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:17:13.707371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:17:13.707371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:17:13.708592 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:17:13.708592 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:17:13.708592 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:17:13.708592 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:17:13.708592 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:17:13.708592 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:17:13.708592 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:17:13.708592 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:17:13.708592 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:17:13.708592 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:17:13.708592 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:17:13.708592 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:17:13.708592 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:17:13.708592 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:17:13.708592 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:17:13.708592 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:17:13.710399 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:17:13.710399 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:17:13.710399 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:17:13.710399 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:17:13.710399 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:17:13.710399 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:17:13.710399 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:17:13.710399 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:17:13.710399 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:17:13.710399 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:17:13.710399 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:17:13.710399 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:17:13.710399 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 17:17:13.710399 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:17:13.710399 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 638/1290] 10.222.0.94 () {56 vars in 1117 bytes} [Thu Sep 1 17:17:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:17:13.715816 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3935d3-fcb5-4a59-a1b3-8cc8eced0ea4 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:13.811292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3935d3-fcb5-4a59-a1b3-8cc8eced0ea4 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:13.844689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf12d2-a3f4-472a-ad75-f74f6bf1034a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:13.845283 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf12d2-a3f4-472a-ad75-f74f6bf1034a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:13.845599 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf12d2-a3f4-472a-ad75-f74f6bf1034a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:13.845874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf12d2-a3f4-472a-ad75-f74f6bf1034a None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:13.846498 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf12d2-a3f4-472a-ad75-f74f6bf1034a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:17:13.846799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf12d2-a3f4-472a-ad75-f74f6bf1034a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:13.848160 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf12d2-a3f4-472a-ad75-f74f6bf1034a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:13.853351 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 653/1291] 10.222.0.94 () {56 vars in 1116 bytes} [Thu Sep 1 17:17:13 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:17:13.859061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b979fd-da84-4bf1-ac07-0ebed663bf79 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:13.972087 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b979fd-da84-4bf1-ac07-0ebed663bf79 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:14.006316 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9cb9d7-d29d-4633-883b-f88576bc8aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:14.006914 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cb9d7-d29d-4633-883b-f88576bc8aac None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:14.007194 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cb9d7-d29d-4633-883b-f88576bc8aac None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:14.007468 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cb9d7-d29d-4633-883b-f88576bc8aac None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:14.008095 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9cb9d7-d29d-4633-883b-f88576bc8aac None admin] RBAC: Adding query filter params (type=placement) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:17:14.008398 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9cb9d7-d29d-4633-883b-f88576bc8aac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:14.009791 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9cb9d7-d29d-4633-883b-f88576bc8aac None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:14.014124 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 639/1292] 10.222.0.94 () {56 vars in 1116 bytes} [Thu Sep 1 17:17:13 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:17:15.908303 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe9e7a-e479-4d35-9144-426ad0b8983d None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:15.909038 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe9e7a-e479-4d35-9144-426ad0b8983d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:15.909152 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe9e7a-e479-4d35-9144-426ad0b8983d None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:15.910947 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 654/1293] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:17:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:17:15.916763 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a690c-eb1b-4b7f-987b-a62ce329bd3a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:15.917164 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a690c-eb1b-4b7f-987b-a62ce329bd3a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:15.917321 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a690c-eb1b-4b7f-987b-a62ce329bd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:15.935058 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2f0a690c-eb1b-4b7f-987b-a62ce329bd3a None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:17:15.936232 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2f0a690c-eb1b-4b7f-987b-a62ce329bd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:17:15.965513 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:16.002825 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 640/1294] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:17:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 17:17:16.266343 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe9e7a-e479-4d35-9144-426ad0b8983d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:16.296879 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:16.365367 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe9e7a-e479-4d35-9144-426ad0b8983d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:16.397684 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3a7a3-43bf-43f7-a17f-47dccd056e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:16.398270 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3a7a3-43bf-43f7-a17f-47dccd056e35 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:16.398545 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3a7a3-43bf-43f7-a17f-47dccd056e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:16.398814 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3a7a3-43bf-43f7-a17f-47dccd056e35 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:16.399452 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3a7a3-43bf-43f7-a17f-47dccd056e35 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:16.400805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3a7a3-43bf-43f7-a17f-47dccd056e35 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:16.415188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 655/1295] 10.222.0.94 () {60 vars in 1141 bytes} [Thu Sep 1 17:17:16 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:17:18.345854 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daccd1b-bb81-43b1-b70f-6b6c2bd75e79 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:18.346406 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daccd1b-bb81-43b1-b70f-6b6c2bd75e79 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:18.346406 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daccd1b-bb81-43b1-b70f-6b6c2bd75e79 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:18.347737 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 641/1296] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:17:18.353372 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945de23-c983-450a-a8c8-2386eba91c5f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:18.353810 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945de23-c983-450a-a8c8-2386eba91c5f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:18.353951 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945de23-c983-450a-a8c8-2386eba91c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:18.372861 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1945de23-c983-450a-a8c8-2386eba91c5f None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:17:18.374085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1945de23-c983-450a-a8c8-2386eba91c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:17:18.443978 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 656/1297] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:17:18 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:17:18.710972 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daccd1b-bb81-43b1-b70f-6b6c2bd75e79 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:18.807771 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daccd1b-bb81-43b1-b70f-6b6c2bd75e79 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:18.840790 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88a118-99a8-4526-8fca-4a7b3a37df23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:18.841431 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88a118-99a8-4526-8fca-4a7b3a37df23 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:18.841706 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88a118-99a8-4526-8fca-4a7b3a37df23 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:18.841979 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88a118-99a8-4526-8fca-4a7b3a37df23 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:18.842629 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88a118-99a8-4526-8fca-4a7b3a37df23 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:18.843983 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88a118-99a8-4526-8fca-4a7b3a37df23 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:18.852551 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-6f88a118-99a8-4526-8fca-4a7b3a37df23 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 17:17:18.852551 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:17:18.852551 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:17:18.852551 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:17:18.852551 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:17:18.852551 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:17:18.852551 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:17:18.852551 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:17:18.852551 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 17:17:18.852551 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:17:18.852551 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:17:18.852551 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:17:18.852551 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:17:18.852551 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:17:18.852551 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:17:18.852551 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:17:18.852551 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:17:18.853563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:17:18.853563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:17:18.853563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:17:18.853563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:17:18.853563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:17:18.853563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:17:18.853563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:17:18.853563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:17:18.853563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:17:18.853563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:17:18.853563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:17:18.853563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:17:18.853563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:17:18.853563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:17:18.853563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:17:18.853563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:17:18.854437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:17:18.854437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:17:18.854437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:17:18.854437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:17:18.854437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:17:18.854437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:17:18.854437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:17:18.854437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:17:18.854437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:17:18.854437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:17:18.854437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:17:18.854437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:17:18.854437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 17:17:18.854437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:17:18.854437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 642/1298] 10.222.0.94 () {56 vars in 1117 bytes} [Thu Sep 1 17:17:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:17:18.859669 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945de23-c983-450a-a8c8-2386eba91c5f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:18.877916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:18.957195 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945de23-c983-450a-a8c8-2386eba91c5f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:18.989298 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b7db8-36e2-41fb-b1ba-cefbb6238191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:18.989872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b7db8-36e2-41fb-b1ba-cefbb6238191 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:18.990653 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b7db8-36e2-41fb-b1ba-cefbb6238191 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:18.990923 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b7db8-36e2-41fb-b1ba-cefbb6238191 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:18.991545 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b7db8-36e2-41fb-b1ba-cefbb6238191 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:17:18.991843 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b7db8-36e2-41fb-b1ba-cefbb6238191 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:18.993201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b7db8-36e2-41fb-b1ba-cefbb6238191 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:18.998175 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 657/1299] 10.222.0.94 () {56 vars in 1116 bytes} [Thu Sep 1 17:17:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:17:19.004170 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88a118-99a8-4526-8fca-4a7b3a37df23 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:19.035761 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:19.104385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88a118-99a8-4526-8fca-4a7b3a37df23 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:19.137216 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba066c-430d-4865-97a1-a433baab2d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:19.137836 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba066c-430d-4865-97a1-a433baab2d01 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:19.138117 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba066c-430d-4865-97a1-a433baab2d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:19.138389 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba066c-430d-4865-97a1-a433baab2d01 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:19.139084 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba066c-430d-4865-97a1-a433baab2d01 None admin] RBAC: Adding query filter params (interface=public, service_id=2b9707fdc8244320937e0ebdc0c46f94, region_id=RegionOne) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:17:19.139391 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba066c-430d-4865-97a1-a433baab2d01 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:19.140751 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba066c-430d-4865-97a1-a433baab2d01 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:19.145720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 643/1300] 10.222.0.94 () {56 vars in 1251 bytes} [Thu Sep 1 17:17:19 2022] GET /identity/v3/endpoints?service_id=2b9707fdc8244320937e0ebdc0c46f94&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:17:19.151337 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b7db8-36e2-41fb-b1ba-cefbb6238191 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:19.231126 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:19.249279 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b7db8-36e2-41fb-b1ba-cefbb6238191 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:19.281365 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b1c9b-50f4-4ed7-acaf-b8f16782e987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:19.281988 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b1c9b-50f4-4ed7-acaf-b8f16782e987 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:19.282272 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b1c9b-50f4-4ed7-acaf-b8f16782e987 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:19.282536 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b1c9b-50f4-4ed7-acaf-b8f16782e987 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:19.283136 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b1c9b-50f4-4ed7-acaf-b8f16782e987 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:19.284491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b1c9b-50f4-4ed7-acaf-b8f16782e987 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:19.291746 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 658/1301] 10.222.0.94 () {56 vars in 1087 bytes} [Thu Sep 1 17:17:19 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:17:21.193617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59b9d0-a6df-4105-aed4-852282818de8 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:21.194159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59b9d0-a6df-4105-aed4-852282818de8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:21.194159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59b9d0-a6df-4105-aed4-852282818de8 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:21.195497 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 644/1302] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:17:21.200514 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90209e2-70f0-48ba-881e-e8c42bfb313c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:21.200908 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90209e2-70f0-48ba-881e-e8c42bfb313c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:21.201064 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90209e2-70f0-48ba-881e-e8c42bfb313c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:21.219485 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f90209e2-70f0-48ba-881e-e8c42bfb313c None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:17:21.220655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f90209e2-70f0-48ba-881e-e8c42bfb313c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:17:21.286275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 659/1303] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:17:21 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 17:17:21.550852 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59b9d0-a6df-4105-aed4-852282818de8 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:21.643347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:21.650780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59b9d0-a6df-4105-aed4-852282818de8 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:21.682156 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb75da0-2ba0-40f7-82c5-57b9b5426689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:21.682761 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb75da0-2ba0-40f7-82c5-57b9b5426689 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:21.683033 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb75da0-2ba0-40f7-82c5-57b9b5426689 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:21.683300 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb75da0-2ba0-40f7-82c5-57b9b5426689 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:21.683862 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb75da0-2ba0-40f7-82c5-57b9b5426689 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:21.685207 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb75da0-2ba0-40f7-82c5-57b9b5426689 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:21.694129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-6bb75da0-2ba0-40f7-82c5-57b9b5426689 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 17:17:21.694129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:17:21.694129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 17:17:21.694129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 17:17:21.694129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 17:17:21.694129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 17:17:21.694129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 17:17:21.694129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:17:21.694129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 17:17:21.694129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:17:21.694129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 17:17:21.694129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:17:21.694129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 17:17:21.694129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 17:17:21.694129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 17:17:21.694129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 17:17:21.694129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 17:17:21.695346 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 17:17:21.695346 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 17:17:21.695346 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 17:17:21.695346 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 17:17:21.695346 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 17:17:21.695346 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 17:17:21.695346 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 17:17:21.695346 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 17:17:21.695346 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 17:17:21.695346 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 17:17:21.695346 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 17:17:21.695346 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 17:17:21.695346 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 17:17:21.695346 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 17:17:21.695346 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 17:17:21.695346 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 17:17:21.696419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 17:17:21.696419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 17:17:21.696419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 17:17:21.696419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 17:17:21.696419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 17:17:21.696419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 17:17:21.696419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 17:17:21.696419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 17:17:21.696419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 17:17:21.696419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 17:17:21.696419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 17:17:21.696419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 17:17:21.696419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 17:17:21.696419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 17:17:21.696419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 645/1304] 10.222.0.94 () {56 vars in 1117 bytes} [Thu Sep 1 17:17:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 17:17:21.701090 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90209e2-70f0-48ba-881e-e8c42bfb313c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:21.781920 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:21.804675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90209e2-70f0-48ba-881e-e8c42bfb313c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:21.837746 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1789647-e033-43d0-960e-95611c43f1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:21.838340 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1789647-e033-43d0-960e-95611c43f1b8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:21.838613 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1789647-e033-43d0-960e-95611c43f1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:21.838875 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1789647-e033-43d0-960e-95611c43f1b8 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:21.839490 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1789647-e033-43d0-960e-95611c43f1b8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:17:21.839784 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1789647-e033-43d0-960e-95611c43f1b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:21.841134 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1789647-e033-43d0-960e-95611c43f1b8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:21.846426 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 660/1305] 10.222.0.94 () {56 vars in 1116 bytes} [Thu Sep 1 17:17:21 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:17:21.852205 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb75da0-2ba0-40f7-82c5-57b9b5426689 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:17:21.956801 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb75da0-2ba0-40f7-82c5-57b9b5426689 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:17:21.988416 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21856f5a-06d3-4f3e-9938-4e723960752a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:17:21.989015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21856f5a-06d3-4f3e-9938-4e723960752a None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:17:21.989308 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21856f5a-06d3-4f3e-9938-4e723960752a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:17:21.989593 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21856f5a-06d3-4f3e-9938-4e723960752a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:17:21.990782 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21856f5a-06d3-4f3e-9938-4e723960752a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:17:21.992130 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21856f5a-06d3-4f3e-9938-4e723960752a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:17:22.011003 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 646/1306] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:17:21 2022] POST /identity/v3/endpoints => generated 331 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:17:31.843665 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=30 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:17:32.006895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:18:25.810465 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4b625-a6ce-456d-bf7f-3ac890d36541 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:25.810943 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4b625-a6ce-456d-bf7f-3ac890d36541 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:25.810943 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4b625-a6ce-456d-bf7f-3ac890d36541 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:25.818824 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428080c-e4a5-4ff5-a9f9-3d6ab2d29401 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:25.819230 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428080c-e4a5-4ff5-a9f9-3d6ab2d29401 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:25.819371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428080c-e4a5-4ff5-a9f9-3d6ab2d29401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:25.824822 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 661/1307] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:18:25 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:18:25.976750 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9428080c-e4a5-4ff5-a9f9-3d6ab2d29401 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:18:25.977987 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9428080c-e4a5-4ff5-a9f9-3d6ab2d29401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:26.096615 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 647/1308] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:18:26.389345 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906399ba-87f9-4c78-a752-344987e8d073 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:26.389655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906399ba-87f9-4c78-a752-344987e8d073 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:26.390092 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906399ba-87f9-4c78-a752-344987e8d073 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:26.391451 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 662/1309] 10.222.0.94 () {54 vars in 965 bytes} [Thu Sep 1 17:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:18:26.399198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624ec3b-eb11-4156-891f-576e48a7e343 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:26.399517 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624ec3b-eb11-4156-891f-576e48a7e343 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:26.399894 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624ec3b-eb11-4156-891f-576e48a7e343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:26.484771 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7624ec3b-eb11-4156-891f-576e48a7e343 None None] MFA Rules not processed for user `92edc2953b8e4e42aa64569335acfc9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:18:26.486096 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7624ec3b-eb11-4156-891f-576e48a7e343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:26.510734 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:18:26.570625 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 648/1310] 10.222.0.94 () {58 vars in 1062 bytes} [Thu Sep 1 17:18:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:18:26.580700 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906399ba-87f9-4c78-a752-344987e8d073 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:18:26.582593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-906399ba-87f9-4c78-a752-344987e8d073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:26.698894 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906399ba-87f9-4c78-a752-344987e8d073 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:18:26.781559 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a8142-7145-4da5-93e1-a894f1bfde20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:18:26.782169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a8142-7145-4da5-93e1-a894f1bfde20 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:26.782446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a8142-7145-4da5-93e1-a894f1bfde20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:26.782740 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a8142-7145-4da5-93e1-a894f1bfde20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:26.784955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-941a8142-7145-4da5-93e1-a894f1bfde20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:26.842639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:18:26.901995 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a8142-7145-4da5-93e1-a894f1bfde20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:18:26.903438 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a8142-7145-4da5-93e1-a894f1bfde20 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:18:26.925813 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 663/1311] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:18:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:18:29.177121 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ca957-cf50-4df6-8eb4-69f11739de29 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:29.177701 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ca957-cf50-4df6-8eb4-69f11739de29 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:29.177701 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ca957-cf50-4df6-8eb4-69f11739de29 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:29.179078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 649/1312] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:18:29.184103 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdf4e9-79c3-479b-8bc1-99f55a67faff None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:29.184513 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdf4e9-79c3-479b-8bc1-99f55a67faff None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:29.184651 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdf4e9-79c3-479b-8bc1-99f55a67faff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:29.259144 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0dbdf4e9-79c3-479b-8bc1-99f55a67faff None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:18:29.260361 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0dbdf4e9-79c3-479b-8bc1-99f55a67faff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:29.356932 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 664/1313] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:18:29.643547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ca957-cf50-4df6-8eb4-69f11739de29 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:18:29.645114 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-160ca957-cf50-4df6-8eb4-69f11739de29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:29.746696 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ca957-cf50-4df6-8eb4-69f11739de29 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:18:29.816363 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:18:29.819012 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6bac6a-5f55-4a4f-8577-d1d85b4e2e6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:18:29.819696 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bac6a-5f55-4a4f-8577-d1d85b4e2e6c service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:29.820187 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bac6a-5f55-4a4f-8577-d1d85b4e2e6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:29.820520 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bac6a-5f55-4a4f-8577-d1d85b4e2e6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:29.822579 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ef6bac6a-5f55-4a4f-8577-d1d85b4e2e6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:29.931598 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6bac6a-5f55-4a4f-8577-d1d85b4e2e6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:18:29.933023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6bac6a-5f55-4a4f-8577-d1d85b4e2e6c service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:18:29.951299 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 650/1314] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:18:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:18:32.142461 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01fbde-f8db-4817-81c1-bf09b8d6037f None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:32.143002 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01fbde-f8db-4817-81c1-bf09b8d6037f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:32.143002 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01fbde-f8db-4817-81c1-bf09b8d6037f None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:32.144423 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 665/1315] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:18:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:18:32.149379 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d54f39-e983-493e-a0ca-d6c805a0b02d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:32.149796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d54f39-e983-493e-a0ca-d6c805a0b02d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:32.149959 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d54f39-e983-493e-a0ca-d6c805a0b02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:32.214510 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-68d54f39-e983-493e-a0ca-d6c805a0b02d None None] MFA Rules not processed for user `317a95cd3128411790c45fac9bb511fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:18:32.215702 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-68d54f39-e983-493e-a0ca-d6c805a0b02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:32.264840 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:18:32.307869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 651/1316] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:18:32 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:18:32.601374 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01fbde-f8db-4817-81c1-bf09b8d6037f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:18:32.602932 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5f01fbde-f8db-4817-81c1-bf09b8d6037f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:32.613105 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:18:32.706371 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01fbde-f8db-4817-81c1-bf09b8d6037f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:18:32.778311 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e5134-fe80-4e72-90f9-7c1d2ab747d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:18:32.778907 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e5134-fe80-4e72-90f9-7c1d2ab747d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:32.779183 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e5134-fe80-4e72-90f9-7c1d2ab747d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:32.779450 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e5134-fe80-4e72-90f9-7c1d2ab747d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:32.781025 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e16e5134-fe80-4e72-90f9-7c1d2ab747d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:32.842864 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:18:32.891887 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e5134-fe80-4e72-90f9-7c1d2ab747d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:18:32.893327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e5134-fe80-4e72-90f9-7c1d2ab747d5 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:18:32.911227 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 666/1317] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:18:32 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:18:35.357257 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64db6a-48fb-4562-894a-a454184c84fc None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:35.357814 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64db6a-48fb-4562-894a-a454184c84fc None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:35.357814 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64db6a-48fb-4562-894a-a454184c84fc None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:35.359177 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 652/1318] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:18:35.364999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bfa7b-e986-404a-9053-4cb08212f264 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:35.365477 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bfa7b-e986-404a-9053-4cb08212f264 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:35.365572 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bfa7b-e986-404a-9053-4cb08212f264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:35.430256 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-976bfa7b-e986-404a-9053-4cb08212f264 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:18:35.431491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-976bfa7b-e986-404a-9053-4cb08212f264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:35.525463 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 667/1319] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:18:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:18:35.810380 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64db6a-48fb-4562-894a-a454184c84fc None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:18:35.811945 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0c64db6a-48fb-4562-894a-a454184c84fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:35.914240 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64db6a-48fb-4562-894a-a454184c84fc None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:18:35.986908 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558efbc-c588-4859-b1c5-edb19cffb3a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:18:35.987512 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558efbc-c588-4859-b1c5-edb19cffb3a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:35.987791 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558efbc-c588-4859-b1c5-edb19cffb3a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:35.988070 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558efbc-c588-4859-b1c5-edb19cffb3a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:35.989695 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e558efbc-c588-4859-b1c5-edb19cffb3a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:35.996882 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:18:36.096545 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e558efbc-c588-4859-b1c5-edb19cffb3a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:18:36.097949 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e558efbc-c588-4859-b1c5-edb19cffb3a8 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:18:36.115971 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 653/1320] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:18:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:18:38.667546 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcebbd5-eb9e-4a3d-8fcc-1f31ee175000 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:38.668287 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcebbd5-eb9e-4a3d-8fcc-1f31ee175000 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:38.668287 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcebbd5-eb9e-4a3d-8fcc-1f31ee175000 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:38.669475 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 668/1321] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:18:38.675559 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9c837-0237-4569-8105-d369e1558d0d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:38.675992 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9c837-0237-4569-8105-d369e1558d0d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:38.676124 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9c837-0237-4569-8105-d369e1558d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:38.742700 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-54f9c837-0237-4569-8105-d369e1558d0d None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:18:38.743933 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-54f9c837-0237-4569-8105-d369e1558d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:38.802149 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:18:38.841578 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 654/1322] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:18:39.122154 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcebbd5-eb9e-4a3d-8fcc-1f31ee175000 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:18:39.123724 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cbcebbd5-eb9e-4a3d-8fcc-1f31ee175000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:39.144079 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:18:39.230479 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcebbd5-eb9e-4a3d-8fcc-1f31ee175000 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:18:39.312403 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262cefee-7e68-42aa-b0a6-e123433c4dae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:18:39.312905 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262cefee-7e68-42aa-b0a6-e123433c4dae service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:39.313223 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262cefee-7e68-42aa-b0a6-e123433c4dae service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:39.313524 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262cefee-7e68-42aa-b0a6-e123433c4dae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:39.315187 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-262cefee-7e68-42aa-b0a6-e123433c4dae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:39.389142 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:18:39.427221 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262cefee-7e68-42aa-b0a6-e123433c4dae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:18:39.428667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262cefee-7e68-42aa-b0a6-e123433c4dae service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:18:39.446287 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 669/1323] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:18:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:18:41.403661 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0050382-dd5c-41cd-a54b-f3ba83131253 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:41.404211 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0050382-dd5c-41cd-a54b-f3ba83131253 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:41.404311 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0050382-dd5c-41cd-a54b-f3ba83131253 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:41.405694 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 655/1324] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:18:41.411332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff02ee9-9a9b-42d7-a453-1b0a166b1359 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:41.411774 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff02ee9-9a9b-42d7-a453-1b0a166b1359 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:41.411878 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff02ee9-9a9b-42d7-a453-1b0a166b1359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:41.479806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8ff02ee9-9a9b-42d7-a453-1b0a166b1359 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:18:41.480994 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8ff02ee9-9a9b-42d7-a453-1b0a166b1359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:41.578731 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 670/1325] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:18:41.857118 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0050382-dd5c-41cd-a54b-f3ba83131253 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:18:41.858690 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c0050382-dd5c-41cd-a54b-f3ba83131253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:41.967805 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0050382-dd5c-41cd-a54b-f3ba83131253 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:18:42.043410 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b16b4-7acb-4570-858e-49b556d3628b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:18:42.044021 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b16b4-7acb-4570-858e-49b556d3628b service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:42.044294 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b16b4-7acb-4570-858e-49b556d3628b service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:42.044559 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b16b4-7acb-4570-858e-49b556d3628b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:42.046174 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5c1b16b4-7acb-4570-858e-49b556d3628b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:42.062976 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:18:42.155114 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b16b4-7acb-4570-858e-49b556d3628b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:18:42.156561 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b16b4-7acb-4570-858e-49b556d3628b service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:18:42.175381 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 656/1326] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:18:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:18:44.119987 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f524df-2082-4dfb-b0db-1293ff648778 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:44.120439 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f524df-2082-4dfb-b0db-1293ff648778 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:44.120535 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f524df-2082-4dfb-b0db-1293ff648778 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:44.121919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 671/1327] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:18:44.127179 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae31db-d044-4a08-b90c-5a61b796ffca None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:44.127621 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae31db-d044-4a08-b90c-5a61b796ffca None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:44.127719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae31db-d044-4a08-b90c-5a61b796ffca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:44.200607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-32ae31db-d044-4a08-b90c-5a61b796ffca None None] MFA Rules not processed for user `317a95cd3128411790c45fac9bb511fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:18:44.201860 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-32ae31db-d044-4a08-b90c-5a61b796ffca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:44.267019 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:18:44.299603 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 657/1328] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:18:44 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:18:44.602401 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d61343-c3a1-44b7-850f-8641471346cc None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:44.602714 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d61343-c3a1-44b7-850f-8641471346cc None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:44.602988 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d61343-c3a1-44b7-850f-8641471346cc None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:44.604341 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 672/1329] 10.222.0.94 () {54 vars in 965 bytes} [Thu Sep 1 17:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:18:44.610635 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047a9a9-73b5-4ce9-8536-70137998d787 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:44.610925 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047a9a9-73b5-4ce9-8536-70137998d787 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:44.611230 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047a9a9-73b5-4ce9-8536-70137998d787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:44.689859 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3047a9a9-73b5-4ce9-8536-70137998d787 None None] MFA Rules not processed for user `92edc2953b8e4e42aa64569335acfc9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:18:44.691086 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3047a9a9-73b5-4ce9-8536-70137998d787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:44.768943 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 658/1330] 10.222.0.94 () {58 vars in 1062 bytes} [Thu Sep 1 17:18:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:18:44.778153 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d61343-c3a1-44b7-850f-8641471346cc None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:18:44.779656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-78d61343-c3a1-44b7-850f-8641471346cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:44.811594 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:18:44.883757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d61343-c3a1-44b7-850f-8641471346cc None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:18:44.958635 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20c4c6-2d5d-433f-8693-b1fa27aea7c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:18:44.959247 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20c4c6-2d5d-433f-8693-b1fa27aea7c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:44.959529 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20c4c6-2d5d-433f-8693-b1fa27aea7c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:44.959801 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20c4c6-2d5d-433f-8693-b1fa27aea7c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:44.961432 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6b20c4c6-2d5d-433f-8693-b1fa27aea7c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:45.037100 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:18:45.069525 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20c4c6-2d5d-433f-8693-b1fa27aea7c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:18:45.070962 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20c4c6-2d5d-433f-8693-b1fa27aea7c7 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:18:45.090649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 673/1331] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:18:44 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:18:47.680887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b07b3-bdc0-4948-a26c-8da6bf5deb17 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:47.681456 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b07b3-bdc0-4948-a26c-8da6bf5deb17 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:47.681456 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b07b3-bdc0-4948-a26c-8da6bf5deb17 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:47.682798 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 659/1332] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:18:47.688025 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4d749-14d6-4e85-b00b-c193eb4537e6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:47.688433 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4d749-14d6-4e85-b00b-c193eb4537e6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:47.688561 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4d749-14d6-4e85-b00b-c193eb4537e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:47.753049 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6ec4d749-14d6-4e85-b00b-c193eb4537e6 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:18:47.754267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6ec4d749-14d6-4e85-b00b-c193eb4537e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:47.848503 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 674/1333] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:18:48.124101 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b07b3-bdc0-4948-a26c-8da6bf5deb17 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:18:48.126157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d85b07b3-bdc0-4948-a26c-8da6bf5deb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:48.194486 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:18:48.228685 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b07b3-bdc0-4948-a26c-8da6bf5deb17 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:18:48.299704 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770da209-dda2-4924-8961-e75b6380aedb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:18:48.300309 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770da209-dda2-4924-8961-e75b6380aedb service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:48.300590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770da209-dda2-4924-8961-e75b6380aedb service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:48.300863 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770da209-dda2-4924-8961-e75b6380aedb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:48.302484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-770da209-dda2-4924-8961-e75b6380aedb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:48.409215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770da209-dda2-4924-8961-e75b6380aedb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:18:48.410757 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770da209-dda2-4924-8961-e75b6380aedb service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:18:48.420606 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:18:48.431261 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 660/1334] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:18:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:18:50.400215 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966718a7-1157-4280-8252-f9d5dfc893d2 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:50.400781 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966718a7-1157-4280-8252-f9d5dfc893d2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:50.400781 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966718a7-1157-4280-8252-f9d5dfc893d2 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:50.402146 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 675/1335] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:18:50.407818 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95df9d4-be23-4aa1-9fa0-6fa3d9bd1e2f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:50.408198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95df9d4-be23-4aa1-9fa0-6fa3d9bd1e2f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:50.408362 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95df9d4-be23-4aa1-9fa0-6fa3d9bd1e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:50.472581 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d95df9d4-be23-4aa1-9fa0-6fa3d9bd1e2f None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:18:50.473802 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d95df9d4-be23-4aa1-9fa0-6fa3d9bd1e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:50.568144 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 661/1336] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:18:50.866848 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966718a7-1157-4280-8252-f9d5dfc893d2 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:18:50.868288 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-966718a7-1157-4280-8252-f9d5dfc893d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:50.908339 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:18:50.971724 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966718a7-1157-4280-8252-f9d5dfc893d2 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:18:51.043147 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45162b-28b7-4792-8ef0-5ea30ca82a9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:18:51.043744 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45162b-28b7-4792-8ef0-5ea30ca82a9b service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:51.044022 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45162b-28b7-4792-8ef0-5ea30ca82a9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:51.044294 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45162b-28b7-4792-8ef0-5ea30ca82a9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:51.045913 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7d45162b-28b7-4792-8ef0-5ea30ca82a9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:51.127267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:18:51.152316 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45162b-28b7-4792-8ef0-5ea30ca82a9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:18:51.153772 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45162b-28b7-4792-8ef0-5ea30ca82a9b service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:18:51.171427 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 676/1337] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:18:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:18:53.519483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d19c84-3ba2-4285-815d-b723e27cf4af None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:53.519998 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d19c84-3ba2-4285-815d-b723e27cf4af None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:53.519998 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d19c84-3ba2-4285-815d-b723e27cf4af None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:53.521316 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 662/1338] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:18:53.526513 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5ea38-c8fd-4069-b4be-75491eaee508 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:53.526924 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5ea38-c8fd-4069-b4be-75491eaee508 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:53.527065 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5ea38-c8fd-4069-b4be-75491eaee508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:53.595602 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-57e5ea38-c8fd-4069-b4be-75491eaee508 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:18:53.596791 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-57e5ea38-c8fd-4069-b4be-75491eaee508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:53.690480 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 677/1339] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:18:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:18:53.974073 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d19c84-3ba2-4285-815d-b723e27cf4af None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:18:53.975650 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-98d19c84-3ba2-4285-815d-b723e27cf4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:54.049871 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:18:54.079176 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d19c84-3ba2-4285-815d-b723e27cf4af None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:18:54.149662 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f7b11-2ab8-403e-ba65-a94468e00ffe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:18:54.150262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f7b11-2ab8-403e-ba65-a94468e00ffe service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:54.150541 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f7b11-2ab8-403e-ba65-a94468e00ffe service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:54.150812 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f7b11-2ab8-403e-ba65-a94468e00ffe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:54.152394 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-885f7b11-2ab8-403e-ba65-a94468e00ffe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:54.264775 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f7b11-2ab8-403e-ba65-a94468e00ffe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:18:54.266288 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f7b11-2ab8-403e-ba65-a94468e00ffe service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:18:54.284818 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 663/1340] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:18:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:18:58.224458 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf532b-1b03-46ae-a763-5c1bf119c3b4 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:58.225025 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf532b-1b03-46ae-a763-5c1bf119c3b4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:58.225025 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf532b-1b03-46ae-a763-5c1bf119c3b4 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:58.226533 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 678/1341] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:18:58.231623 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82fd1b-5d94-4dec-af79-6fc9f11b7348 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:58.232071 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82fd1b-5d94-4dec-af79-6fc9f11b7348 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:58.232169 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82fd1b-5d94-4dec-af79-6fc9f11b7348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:58.237670 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:18:58.309199 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9c82fd1b-5d94-4dec-af79-6fc9f11b7348 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:18:58.310461 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9c82fd1b-5d94-4dec-af79-6fc9f11b7348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:58.408593 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 664/1342] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:18:58.694321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf532b-1b03-46ae-a763-5c1bf119c3b4 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:18:58.695838 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-10cf532b-1b03-46ae-a763-5c1bf119c3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:58.744302 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:18:58.799790 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf532b-1b03-46ae-a763-5c1bf119c3b4 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:18:58.873437 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c3b86-ace3-4e99-ba1a-ad6db6479f17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:18:58.874072 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c3b86-ace3-4e99-ba1a-ad6db6479f17 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:18:58.874347 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c3b86-ace3-4e99-ba1a-ad6db6479f17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:18:58.874610 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c3b86-ace3-4e99-ba1a-ad6db6479f17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:18:58.876189 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-418c3b86-ace3-4e99-ba1a-ad6db6479f17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:18:58.969576 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:18:58.988698 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c3b86-ace3-4e99-ba1a-ad6db6479f17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:18:58.990195 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c3b86-ace3-4e99-ba1a-ad6db6479f17 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:18:59.008109 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 679/1343] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:18:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:19:01.546754 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa525894-b969-4c8f-bea5-c2f3bd6a5e08 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:01.547268 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa525894-b969-4c8f-bea5-c2f3bd6a5e08 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:01.547364 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa525894-b969-4c8f-bea5-c2f3bd6a5e08 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:01.548965 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 665/1344] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:19:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:19:01.554351 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90105bcb-3b54-47e0-9075-7389de6295ea None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:01.554774 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90105bcb-3b54-47e0-9075-7389de6295ea None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:01.554996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90105bcb-3b54-47e0-9075-7389de6295ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:01.622580 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-90105bcb-3b54-47e0-9075-7389de6295ea None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:19:01.623786 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-90105bcb-3b54-47e0-9075-7389de6295ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:01.724303 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 680/1345] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:19:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:19:02.010050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa525894-b969-4c8f-bea5-c2f3bd6a5e08 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:19:02.011600 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-aa525894-b969-4c8f-bea5-c2f3bd6a5e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:02.096518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:02.115760 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa525894-b969-4c8f-bea5-c2f3bd6a5e08 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:19:02.196512 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551c10d-b2c9-4928-bf6f-e9eb05fbeaf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:19:02.197365 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551c10d-b2c9-4928-bf6f-e9eb05fbeaf0 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:02.197365 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551c10d-b2c9-4928-bf6f-e9eb05fbeaf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:02.197688 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551c10d-b2c9-4928-bf6f-e9eb05fbeaf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:02.199547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5551c10d-b2c9-4928-bf6f-e9eb05fbeaf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:02.309981 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5551c10d-b2c9-4928-bf6f-e9eb05fbeaf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:19:02.311327 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5551c10d-b2c9-4928-bf6f-e9eb05fbeaf0 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:19:02.330522 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 666/1346] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:19:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:19:06.258520 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffca2bf-7f76-471c-9e36-655b305a9cbf None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:06.259067 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffca2bf-7f76-471c-9e36-655b305a9cbf None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:06.259227 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffca2bf-7f76-471c-9e36-655b305a9cbf None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:06.260732 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 681/1347] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:19:06.266372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d93ab2-69cd-4ab4-b9b5-4d0bb73b8633 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:06.266886 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d93ab2-69cd-4ab4-b9b5-4d0bb73b8633 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:06.267009 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d93ab2-69cd-4ab4-b9b5-4d0bb73b8633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:06.283597 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:06.340748 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-40d93ab2-69cd-4ab4-b9b5-4d0bb73b8633 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:19:06.342014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-40d93ab2-69cd-4ab4-b9b5-4d0bb73b8633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:06.444246 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 667/1348] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:19:06.726482 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffca2bf-7f76-471c-9e36-655b305a9cbf None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:19:06.728201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1ffca2bf-7f76-471c-9e36-655b305a9cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:06.785891 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:06.833735 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffca2bf-7f76-471c-9e36-655b305a9cbf None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:19:06.908898 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb383a1-4fad-470f-b974-4616ee53d6bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:19:06.909529 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb383a1-4fad-470f-b974-4616ee53d6bd service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:06.909802 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb383a1-4fad-470f-b974-4616ee53d6bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:06.910068 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb383a1-4fad-470f-b974-4616ee53d6bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:06.912234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fdb383a1-4fad-470f-b974-4616ee53d6bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:07.019429 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:07.023763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb383a1-4fad-470f-b974-4616ee53d6bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:19:07.025196 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb383a1-4fad-470f-b974-4616ee53d6bd service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:19:07.042623 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 682/1349] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:19:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:19:12.029759 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c3cab-fcf1-45b7-9341-747958b60ff2 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:12.030269 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c3cab-fcf1-45b7-9341-747958b60ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:12.030373 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c3cab-fcf1-45b7-9341-747958b60ff2 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:12.032127 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 668/1350] 10.222.0.94 () {54 vars in 921 bytes} [Thu Sep 1 17:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:19:12.038012 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97fa23-a575-45d1-82ca-f18e01cb0b8e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:12.038884 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97fa23-a575-45d1-82ca-f18e01cb0b8e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:12.039397 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97fa23-a575-45d1-82ca-f18e01cb0b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:12.179769 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-bf97fa23-a575-45d1-82ca-f18e01cb0b8e None None] MFA Rules not processed for user `e3622621761f4f18ae3e9dfb5ba99bef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:19:12.181341 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bf97fa23-a575-45d1-82ca-f18e01cb0b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:12.299283 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 683/1351] 10.222.0.94 () {58 vars in 1018 bytes} [Thu Sep 1 17:19:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:19:16.304511 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fa730-e1aa-4ec1-9dac-b13031913275 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:16.305003 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fa730-e1aa-4ec1-9dac-b13031913275 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:16.305003 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fa730-e1aa-4ec1-9dac-b13031913275 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:16.306543 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 669/1352] 10.222.0.94 () {54 vars in 921 bytes} [Thu Sep 1 17:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:19:16.311909 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebf276-3d7b-411c-988c-f78234bb9be3 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:16.312699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebf276-3d7b-411c-988c-f78234bb9be3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:16.313212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebf276-3d7b-411c-988c-f78234bb9be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:16.371754 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:16.397104 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8aebf276-3d7b-411c-988c-f78234bb9be3 None None] MFA Rules not processed for user `e3622621761f4f18ae3e9dfb5ba99bef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:19:16.398880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8aebf276-3d7b-411c-988c-f78234bb9be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:16.442199 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=59 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:16.515504 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 684/1353] 10.222.0.94 () {58 vars in 1018 bytes} [Thu Sep 1 17:19:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:19:18.054727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b871d9-73c7-42cb-afd1-5280775a8b6a None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:18.055258 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b871d9-73c7-42cb-afd1-5280775a8b6a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:18.055258 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b871d9-73c7-42cb-afd1-5280775a8b6a None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:18.056620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 670/1354] 10.222.0.94 () {54 vars in 921 bytes} [Thu Sep 1 17:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:19:18.062142 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83df618-9c39-461e-84d2-6b791b151218 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:18.062553 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83df618-9c39-461e-84d2-6b791b151218 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:18.062688 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83df618-9c39-461e-84d2-6b791b151218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:18.139700 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d83df618-9c39-461e-84d2-6b791b151218 None None] MFA Rules not processed for user `e3622621761f4f18ae3e9dfb5ba99bef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:19:18.140903 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d83df618-9c39-461e-84d2-6b791b151218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:18.184312 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:18.249905 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 685/1355] 10.222.0.94 () {58 vars in 1018 bytes} [Thu Sep 1 17:19:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:19:21.624089 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1909e-6cd5-46de-a34f-7f4f5dd9a42b None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:21.624670 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1909e-6cd5-46de-a34f-7f4f5dd9a42b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:21.624670 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1909e-6cd5-46de-a34f-7f4f5dd9a42b None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:21.626006 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 671/1356] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:19:21.631299 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40763944-fd66-4ad8-b9be-f5ca7b0046c5 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:21.631731 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40763944-fd66-4ad8-b9be-f5ca7b0046c5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:21.631846 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40763944-fd66-4ad8-b9be-f5ca7b0046c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:21.721793 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-40763944-fd66-4ad8-b9be-f5ca7b0046c5 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:19:21.723009 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-40763944-fd66-4ad8-b9be-f5ca7b0046c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:21.842490 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 686/1357] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:19:22.143127 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3a439-d2de-48fe-8e26-473e02f66311 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:22.143416 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3a439-d2de-48fe-8e26-473e02f66311 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:22.143695 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3a439-d2de-48fe-8e26-473e02f66311 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:22.145019 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 672/1358] 10.222.0.94 () {54 vars in 962 bytes} [Thu Sep 1 17:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:19:22.153955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474c832-16d6-45a8-be85-993399310cbf None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:22.154280 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474c832-16d6-45a8-be85-993399310cbf None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:22.154557 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474c832-16d6-45a8-be85-993399310cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:22.183219 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:22.245726 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d474c832-16d6-45a8-be85-993399310cbf None None] MFA Rules not processed for user `8b7fa3c4c5d94b3c9b7f17dde35d39a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:19:22.246927 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d474c832-16d6-45a8-be85-993399310cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:22.375576 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 687/1359] 10.222.0.94 () {58 vars in 1059 bytes} [Thu Sep 1 17:19:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:19:22.383250 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3a439-d2de-48fe-8e26-473e02f66311 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:19:22.384876 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f3d3a439-d2de-48fe-8e26-473e02f66311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:22.558369 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3a439-d2de-48fe-8e26-473e02f66311 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:19:22.640900 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:22.692073 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541a677-d653-4233-a787-b1a8d8eb15a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:19:22.692905 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541a677-d653-4233-a787-b1a8d8eb15a6 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:22.693186 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541a677-d653-4233-a787-b1a8d8eb15a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:22.693500 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541a677-d653-4233-a787-b1a8d8eb15a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:22.695355 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b541a677-d653-4233-a787-b1a8d8eb15a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:22.797951 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b541a677-d653-4233-a787-b1a8d8eb15a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:19:22.799683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b541a677-d653-4233-a787-b1a8d8eb15a6 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:19:22.818534 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 673/1360] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:19:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:19:24.964188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b89df-4900-474a-9f89-880d9e1f9fe3 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:24.965719 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b89df-4900-474a-9f89-880d9e1f9fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:24.966271 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b89df-4900-474a-9f89-880d9e1f9fe3 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:24.969137 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 688/1361] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:19:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:19:24.974184 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33961f-d225-4b13-9b5c-de50dc609242 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:24.975994 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33961f-d225-4b13-9b5c-de50dc609242 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:24.976618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33961f-d225-4b13-9b5c-de50dc609242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:25.062730 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-cd33961f-d225-4b13-9b5c-de50dc609242 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:19:25.064353 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cd33961f-d225-4b13-9b5c-de50dc609242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:25.113643 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:25.186447 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 674/1362] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:19:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:19:25.478439 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b89df-4900-474a-9f89-880d9e1f9fe3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:19:25.479947 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b46b89df-4900-474a-9f89-880d9e1f9fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:25.555946 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:25.644552 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b89df-4900-474a-9f89-880d9e1f9fe3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:19:25.770445 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a3b8b-724a-4dff-989a-89c63779eb2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:19:25.771183 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a3b8b-724a-4dff-989a-89c63779eb2b service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:25.771376 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a3b8b-724a-4dff-989a-89c63779eb2b service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:25.771619 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a3b8b-724a-4dff-989a-89c63779eb2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:25.773214 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-387a3b8b-724a-4dff-989a-89c63779eb2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:25.801910 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:25.883171 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a3b8b-724a-4dff-989a-89c63779eb2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:19:25.884781 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a3b8b-724a-4dff-989a-89c63779eb2b service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:19:25.903606 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 689/1363] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:19:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:19:28.178003 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676d365-b9b1-46ec-b74f-f58510259b2d None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:28.178613 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676d365-b9b1-46ec-b74f-f58510259b2d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:28.178613 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676d365-b9b1-46ec-b74f-f58510259b2d None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:28.180089 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 675/1364] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:19:28.185684 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd479a42-82b4-46c5-bebf-c501a103bba7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:28.186110 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd479a42-82b4-46c5-bebf-c501a103bba7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:28.186279 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd479a42-82b4-46c5-bebf-c501a103bba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:28.255046 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-fd479a42-82b4-46c5-bebf-c501a103bba7 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:19:28.256254 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fd479a42-82b4-46c5-bebf-c501a103bba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:28.356729 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:28.365602 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 690/1365] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:19:28.650916 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b1562-05c9-4958-8e7d-8fba1c8222ca None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:28.651420 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b1562-05c9-4958-8e7d-8fba1c8222ca None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:28.651786 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b1562-05c9-4958-8e7d-8fba1c8222ca None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:28.653317 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 676/1366] 10.222.0.94 () {54 vars in 962 bytes} [Thu Sep 1 17:19:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:19:28.660170 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0e531-8e9e-4159-85e1-16516e676a2a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:28.660524 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0e531-8e9e-4159-85e1-16516e676a2a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:28.660857 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0e531-8e9e-4159-85e1-16516e676a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:28.740312 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-62f0e531-8e9e-4159-85e1-16516e676a2a None None] MFA Rules not processed for user `8b7fa3c4c5d94b3c9b7f17dde35d39a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:19:28.741510 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-62f0e531-8e9e-4159-85e1-16516e676a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:28.873579 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 691/1367] 10.222.0.94 () {58 vars in 1059 bytes} [Thu Sep 1 17:19:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:19:28.883227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b1562-05c9-4958-8e7d-8fba1c8222ca None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:19:28.884804 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d64b1562-05c9-4958-8e7d-8fba1c8222ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:29.039449 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b1562-05c9-4958-8e7d-8fba1c8222ca None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:19:29.060719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:29.158264 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed81b3c-8f88-4f7f-87fd-e62101797d37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:19:29.159128 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed81b3c-8f88-4f7f-87fd-e62101797d37 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:29.159404 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed81b3c-8f88-4f7f-87fd-e62101797d37 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:29.159669 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed81b3c-8f88-4f7f-87fd-e62101797d37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:29.161237 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4ed81b3c-8f88-4f7f-87fd-e62101797d37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:29.256787 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed81b3c-8f88-4f7f-87fd-e62101797d37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:19:29.258463 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed81b3c-8f88-4f7f-87fd-e62101797d37 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:19:29.277188 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 677/1368] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:19:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:19:29.830687 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215676e6-69cb-4974-b962-875cc4ea5815 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:29.831224 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215676e6-69cb-4974-b962-875cc4ea5815 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:29.831224 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215676e6-69cb-4974-b962-875cc4ea5815 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:29.832724 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 692/1369] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:19:29.837915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0c7bd-5704-4410-9802-e278cf4b1d15 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:29.838203 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0c7bd-5704-4410-9802-e278cf4b1d15 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:29.838474 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0c7bd-5704-4410-9802-e278cf4b1d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:29.870702 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:29.907231 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a7a0c7bd-5704-4410-9802-e278cf4b1d15 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:19:29.908440 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a7a0c7bd-5704-4410-9802-e278cf4b1d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:30.015161 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 678/1370] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:19:30.570747 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ecce2-1d67-4e18-bd53-c140cb9bf2d5 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:30.571036 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ecce2-1d67-4e18-bd53-c140cb9bf2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:30.571310 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ecce2-1d67-4e18-bd53-c140cb9bf2d5 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:30.573142 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 693/1371] 10.222.0.94 () {54 vars in 964 bytes} [Thu Sep 1 17:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:19:30.578079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae437ffd-46d7-4081-b288-42769e2fbbef None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:30.578528 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae437ffd-46d7-4081-b288-42769e2fbbef None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:30.578625 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae437ffd-46d7-4081-b288-42769e2fbbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:30.656295 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ae437ffd-46d7-4081-b288-42769e2fbbef None None] MFA Rules not processed for user `eee371754d7d43b4987084db58f44957`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:19:30.657729 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ae437ffd-46d7-4081-b288-42769e2fbbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:30.709035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:30.743697 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 679/1372] 10.222.0.94 () {58 vars in 1061 bytes} [Thu Sep 1 17:19:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:19:30.751999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ecce2-1d67-4e18-bd53-c140cb9bf2d5 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:19:30.754011 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a59ecce2-1d67-4e18-bd53-c140cb9bf2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:30.809528 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:30.868625 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ecce2-1d67-4e18-bd53-c140cb9bf2d5 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:19:30.952219 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93e160-0035-4aa1-9f86-01b7d8d4b487 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:19:30.952833 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93e160-0035-4aa1-9f86-01b7d8d4b487 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:30.953118 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93e160-0035-4aa1-9f86-01b7d8d4b487 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:30.953622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93e160-0035-4aa1-9f86-01b7d8d4b487 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:30.955119 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0a93e160-0035-4aa1-9f86-01b7d8d4b487 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:31.058861 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:31.073824 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93e160-0035-4aa1-9f86-01b7d8d4b487 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:19:31.075357 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93e160-0035-4aa1-9f86-01b7d8d4b487 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:19:31.094859 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 694/1373] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:19:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:19:31.246265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8cb08-252c-4275-8980-0299fc5777e1 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:31.246574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8cb08-252c-4275-8980-0299fc5777e1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:31.246825 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8cb08-252c-4275-8980-0299fc5777e1 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:31.248559 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 680/1374] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:19:31.254640 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c2454-8bce-49b9-98b2-8cfc5b8c022b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:31.254929 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c2454-8bce-49b9-98b2-8cfc5b8c022b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:31.255202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c2454-8bce-49b9-98b2-8cfc5b8c022b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:31.354060 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4c0c2454-8bce-49b9-98b2-8cfc5b8c022b None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:19:31.356440 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4c0c2454-8bce-49b9-98b2-8cfc5b8c022b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:31.471169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 695/1375] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:19:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:19:31.767927 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8cb08-252c-4275-8980-0299fc5777e1 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:19:31.769486 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7ea8cb08-252c-4275-8980-0299fc5777e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:31.924559 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8cb08-252c-4275-8980-0299fc5777e1 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:19:31.985255 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:32.046872 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735453d8-20f0-4f66-a91c-4a7bb46583a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:19:32.047403 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735453d8-20f0-4f66-a91c-4a7bb46583a9 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:32.047684 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735453d8-20f0-4f66-a91c-4a7bb46583a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:32.047956 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735453d8-20f0-4f66-a91c-4a7bb46583a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:32.049588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-735453d8-20f0-4f66-a91c-4a7bb46583a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:32.140508 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735453d8-20f0-4f66-a91c-4a7bb46583a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:19:32.142149 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735453d8-20f0-4f66-a91c-4a7bb46583a9 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:19:32.159911 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 681/1376] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:19:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:19:34.107164 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dedec-5a55-4a84-a184-8d7d6487d1bf None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:34.107627 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dedec-5a55-4a84-a184-8d7d6487d1bf None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:34.107721 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dedec-5a55-4a84-a184-8d7d6487d1bf None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:34.109099 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 696/1377] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:19:34.114203 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d34f2-cf25-41dd-b5da-f268aeb5cd10 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:34.114596 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d34f2-cf25-41dd-b5da-f268aeb5cd10 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:34.114776 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d34f2-cf25-41dd-b5da-f268aeb5cd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:34.306731 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d17d34f2-cf25-41dd-b5da-f268aeb5cd10 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:19:34.307884 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d17d34f2-cf25-41dd-b5da-f268aeb5cd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:34.315619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:34.405982 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 682/1378] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:19:34.710145 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3dedec-5a55-4a84-a184-8d7d6487d1bf None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:19:34.711829 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ff3dedec-5a55-4a84-a184-8d7d6487d1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:34.794811 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:34.888216 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3dedec-5a55-4a84-a184-8d7d6487d1bf None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:19:35.013270 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea30049-0a96-491d-abdc-ef5dc0ec9da9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:19:35.013928 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea30049-0a96-491d-abdc-ef5dc0ec9da9 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:35.014284 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea30049-0a96-491d-abdc-ef5dc0ec9da9 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:35.014614 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea30049-0a96-491d-abdc-ef5dc0ec9da9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:35.016303 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5ea30049-0a96-491d-abdc-ef5dc0ec9da9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:35.035843 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:35.117804 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea30049-0a96-491d-abdc-ef5dc0ec9da9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:19:35.119562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea30049-0a96-491d-abdc-ef5dc0ec9da9 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:19:35.145463 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 697/1379] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:19:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:19:37.107498 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809e4c5-3a04-4b63-ad88-0b4c91b7f0b6 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:37.108058 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809e4c5-3a04-4b63-ad88-0b4c91b7f0b6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:37.108058 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809e4c5-3a04-4b63-ad88-0b4c91b7f0b6 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:37.109527 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 683/1380] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:19:37.114695 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8a78c-1962-4960-9804-034e7c2eb231 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:37.115163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8a78c-1962-4960-9804-034e7c2eb231 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:37.115264 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8a78c-1962-4960-9804-034e7c2eb231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:37.183532 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2ac8a78c-1962-4960-9804-034e7c2eb231 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:19:37.185344 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2ac8a78c-1962-4960-9804-034e7c2eb231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:37.281648 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:37.289905 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 698/1381] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:19:37.583979 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809e4c5-3a04-4b63-ad88-0b4c91b7f0b6 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:19:37.585730 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3809e4c5-3a04-4b63-ad88-0b4c91b7f0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:37.732243 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:37.745733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809e4c5-3a04-4b63-ad88-0b4c91b7f0b6 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:19:37.865907 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3b7fb-a429-4831-8e3d-66d064026c06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:19:37.866426 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3b7fb-a429-4831-8e3d-66d064026c06 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:37.866703 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3b7fb-a429-4831-8e3d-66d064026c06 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:37.866969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3b7fb-a429-4831-8e3d-66d064026c06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:37.868580 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9ef3b7fb-a429-4831-8e3d-66d064026c06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:37.963609 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3b7fb-a429-4831-8e3d-66d064026c06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:19:37.965239 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3b7fb-a429-4831-8e3d-66d064026c06 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:19:37.976456 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:37.986730 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 684/1382] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:19:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:19:39.931898 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e763b6-f2b8-4776-adc7-b71e3d0ca21e None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:39.932620 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e763b6-f2b8-4776-adc7-b71e3d0ca21e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:39.932620 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e763b6-f2b8-4776-adc7-b71e3d0ca21e None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:39.933955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 699/1383] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:19:39.939758 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be086f1b-46f8-4bc0-ac55-55e69ea9eec8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:39.940259 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be086f1b-46f8-4bc0-ac55-55e69ea9eec8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:39.940451 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be086f1b-46f8-4bc0-ac55-55e69ea9eec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:40.007985 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-be086f1b-46f8-4bc0-ac55-55e69ea9eec8 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:19:40.009204 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-be086f1b-46f8-4bc0-ac55-55e69ea9eec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:40.107933 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 685/1384] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:19:40.395488 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e763b6-f2b8-4776-adc7-b71e3d0ca21e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:19:40.397476 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-94e763b6-f2b8-4776-adc7-b71e3d0ca21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:40.561648 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e763b6-f2b8-4776-adc7-b71e3d0ca21e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:19:40.646106 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:40.700673 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ca41a-9b23-4650-b033-b33b873731ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:19:40.701304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ca41a-9b23-4650-b033-b33b873731ef service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:40.701624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ca41a-9b23-4650-b033-b33b873731ef service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:40.701901 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ca41a-9b23-4650-b033-b33b873731ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:40.703571 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7f2ca41a-9b23-4650-b033-b33b873731ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:40.796056 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ca41a-9b23-4650-b033-b33b873731ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:19:40.797699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ca41a-9b23-4650-b033-b33b873731ef service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:19:40.816482 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 700/1385] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:19:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:19:42.917417 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d5e35-5093-4162-bfe9-a739e7173a16 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:42.918096 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d5e35-5093-4162-bfe9-a739e7173a16 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:42.918096 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d5e35-5093-4162-bfe9-a739e7173a16 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:42.919363 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 686/1386] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:19:42.925008 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a46526-6ae0-4160-b8b5-941f1a06ac28 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:42.925712 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a46526-6ae0-4160-b8b5-941f1a06ac28 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:42.925712 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a46526-6ae0-4160-b8b5-941f1a06ac28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:42.995687 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-62a46526-6ae0-4160-b8b5-941f1a06ac28 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:19:42.997432 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-62a46526-6ae0-4160-b8b5-941f1a06ac28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:43.033596 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:43.098754 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 701/1387] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:19:43.388654 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d5e35-5093-4162-bfe9-a739e7173a16 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:19:43.390783 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4e7d5e35-5093-4162-bfe9-a739e7173a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:43.491320 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:43.568894 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d5e35-5093-4162-bfe9-a739e7173a16 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:19:43.689131 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcb646-fae1-4311-9f76-0d422d3ff0aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:19:43.689782 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcb646-fae1-4311-9f76-0d422d3ff0aa service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:43.690026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcb646-fae1-4311-9f76-0d422d3ff0aa service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:43.690337 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcb646-fae1-4311-9f76-0d422d3ff0aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:43.692018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-92fcb646-fae1-4311-9f76-0d422d3ff0aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:43.736075 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:43.790965 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fcb646-fae1-4311-9f76-0d422d3ff0aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:19:43.792605 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fcb646-fae1-4311-9f76-0d422d3ff0aa service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:19:43.812323 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 687/1388] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:19:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:19:45.814307 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90adba-59ba-4da2-ad20-e89d9aaede4e None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:45.814931 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90adba-59ba-4da2-ad20-e89d9aaede4e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:45.814931 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90adba-59ba-4da2-ad20-e89d9aaede4e None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:45.816377 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 702/1389] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:19:45.821354 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61436c-77fb-41b0-95a6-27097a8db2e8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:45.822106 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61436c-77fb-41b0-95a6-27097a8db2e8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:45.822216 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61436c-77fb-41b0-95a6-27097a8db2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:45.889597 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7b61436c-77fb-41b0-95a6-27097a8db2e8 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:19:45.890804 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7b61436c-77fb-41b0-95a6-27097a8db2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:45.986782 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 688/1390] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:19:46.274619 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90adba-59ba-4da2-ad20-e89d9aaede4e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:19:46.276129 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5f90adba-59ba-4da2-ad20-e89d9aaede4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:46.343989 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da556276-47e2-4168-9b95-c5267460cee2 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:46.344364 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da556276-47e2-4168-9b95-c5267460cee2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:46.344742 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da556276-47e2-4168-9b95-c5267460cee2 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:46.346802 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 689/1391] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:19:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:19:46.351684 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5359b-4398-4d4e-a801-dfba10c784d9 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:46.351960 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5359b-4398-4d4e-a801-dfba10c784d9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:46.352233 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5359b-4398-4d4e-a801-dfba10c784d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:46.368668 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:46.419234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-bab5359b-4398-4d4e-a801-dfba10c784d9 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:19:46.420446 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bab5359b-4398-4d4e-a801-dfba10c784d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:46.428195 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90adba-59ba-4da2-ad20-e89d9aaede4e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:19:46.445084 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:46.519422 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 690/1392] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:19:46.551302 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d64239-2ae4-4c76-a7d7-ab1fbbf3e297 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:19:46.551910 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d64239-2ae4-4c76-a7d7-ab1fbbf3e297 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:46.552315 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d64239-2ae4-4c76-a7d7-ab1fbbf3e297 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:46.552618 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d64239-2ae4-4c76-a7d7-ab1fbbf3e297 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:46.554240 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-48d64239-2ae4-4c76-a7d7-ab1fbbf3e297 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:46.648142 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d64239-2ae4-4c76-a7d7-ab1fbbf3e297 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:19:46.649766 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d64239-2ae4-4c76-a7d7-ab1fbbf3e297 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:19:46.667936 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 703/1393] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:19:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:19:46.822673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943d574-052b-49dd-8085-10b6c25bbd5c None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:46.823245 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943d574-052b-49dd-8085-10b6c25bbd5c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:46.823245 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943d574-052b-49dd-8085-10b6c25bbd5c None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:46.825304 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 691/1394] 10.222.0.94 () {54 vars in 967 bytes} [Thu Sep 1 17:19:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:19:46.831175 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e62ab-1508-4e15-ad39-2d9b2372333b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:46.831754 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e62ab-1508-4e15-ad39-2d9b2372333b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:46.831754 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e62ab-1508-4e15-ad39-2d9b2372333b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:46.859574 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:46.913646 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e21e62ab-1508-4e15-ad39-2d9b2372333b None None] MFA Rules not processed for user `74c6647f3aa54dc68e888b3adb8c28b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:19:46.914852 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e21e62ab-1508-4e15-ad39-2d9b2372333b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:46.998542 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 704/1395] 10.222.0.94 () {58 vars in 1064 bytes} [Thu Sep 1 17:19:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:19:47.006127 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943d574-052b-49dd-8085-10b6c25bbd5c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:19:47.007645 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a943d574-052b-49dd-8085-10b6c25bbd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:47.114067 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:47.122406 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943d574-052b-49dd-8085-10b6c25bbd5c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:19:47.202529 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216ddf2-f51d-4ea7-bc90-74371e9d14b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6647f3aa54dc68e888b3adb8c28b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:19:47.203135 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216ddf2-f51d-4ea7-bc90-74371e9d14b3 service glance] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:47.203409 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216ddf2-f51d-4ea7-bc90-74371e9d14b3 service glance] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:47.203677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216ddf2-f51d-4ea7-bc90-74371e9d14b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:47.205289 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9216ddf2-f51d-4ea7-bc90-74371e9d14b3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:47.323106 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216ddf2-f51d-4ea7-bc90-74371e9d14b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:19:47.324554 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216ddf2-f51d-4ea7-bc90-74371e9d14b3 service glance] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:19:47.343864 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 692/1396] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:19:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:19:48.092822 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270b110-7524-4512-b7b2-c1a7b9074026 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:48.093344 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270b110-7524-4512-b7b2-c1a7b9074026 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:48.093599 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270b110-7524-4512-b7b2-c1a7b9074026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:48.159876 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b270b110-7524-4512-b7b2-c1a7b9074026 None None] MFA Rules not processed for user `9e7444bc40314e73b282217bbb94798d`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:19:48.161072 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b270b110-7524-4512-b7b2-c1a7b9074026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:48.219986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:48.248944 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 705/1397] 10.222.0.94 () {58 vars in 1009 bytes} [Thu Sep 1 17:19:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:19:48.291441 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5eac7-83ec-4ee9-884d-be5cc0adab9b None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:48.291925 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5eac7-83ec-4ee9-884d-be5cc0adab9b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:48.292092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5eac7-83ec-4ee9-884d-be5cc0adab9b None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:48.293551 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 693/1398] 10.222.0.94 () {54 vars in 943 bytes} [Thu Sep 1 17:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:19:48.300076 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b1aa6-1833-4f8a-9253-f5a45577c81a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:48.300452 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b1aa6-1833-4f8a-9253-f5a45577c81a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:48.300792 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b1aa6-1833-4f8a-9253-f5a45577c81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:48.379465 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ef6b1aa6-1833-4f8a-9253-f5a45577c81a None None] MFA Rules not processed for user `af7ebf43f36c4862a3c527941e033666`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:19:48.380586 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ef6b1aa6-1833-4f8a-9253-f5a45577c81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:48.485793 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 706/1399] 10.222.0.94 () {58 vars in 1040 bytes} [Thu Sep 1 17:19:48 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:19:48.495650 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5eac7-83ec-4ee9-884d-be5cc0adab9b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:19:48.498040 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-46a5eac7-83ec-4ee9-884d-be5cc0adab9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:48.541707 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:48.672796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5eac7-83ec-4ee9-884d-be5cc0adab9b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:19:48.689666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57c1c0-9118-4fa6-a945-e48118b2251f None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:48.689881 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57c1c0-9118-4fa6-a945-e48118b2251f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:48.690156 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57c1c0-9118-4fa6-a945-e48118b2251f None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:48.691658 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 707/1400] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:19:48.697119 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c45f5-8a38-4ba9-be77-e900d3040dd9 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:48.697424 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c45f5-8a38-4ba9-be77-e900d3040dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:48.698321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c45f5-8a38-4ba9-be77-e900d3040dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:48.750520 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:48.774441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f67c45f5-8a38-4ba9-be77-e900d3040dd9 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:19:48.775682 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f67c45f5-8a38-4ba9-be77-e900d3040dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:48.796856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d950f63-7fb4-40ab-be21-8ad232c74536 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7ebf43f36c4862a3c527941e033666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:19:48.797618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d950f63-7fb4-40ab-be21-8ad232c74536 service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:48.797907 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d950f63-7fb4-40ab-be21-8ad232c74536 service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:48.798179 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d950f63-7fb4-40ab-be21-8ad232c74536 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:48.799842 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6d950f63-7fb4-40ab-be21-8ad232c74536 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:48.807374 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:48.873365 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 708/1401] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:19:48.886007 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d950f63-7fb4-40ab-be21-8ad232c74536 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:19:48.888174 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d950f63-7fb4-40ab-be21-8ad232c74536 service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:19:48.896250 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 694/1402] 10.222.0.94 () {60 vars in 1384 bytes} [Thu Sep 1 17:19:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 17:19:49.161536 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c45f5-8a38-4ba9-be77-e900d3040dd9 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:19:49.162857 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f67c45f5-8a38-4ba9-be77-e900d3040dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:49.288720 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c45f5-8a38-4ba9-be77-e900d3040dd9 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:19:49.293465 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:49.419776 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862bad3-7b07-4deb-8ddf-a61792d342d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:19:49.420387 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862bad3-7b07-4deb-8ddf-a61792d342d3 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:49.420664 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862bad3-7b07-4deb-8ddf-a61792d342d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:49.420933 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862bad3-7b07-4deb-8ddf-a61792d342d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:49.422735 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c862bad3-7b07-4deb-8ddf-a61792d342d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:49.522358 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862bad3-7b07-4deb-8ddf-a61792d342d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:19:49.523956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862bad3-7b07-4deb-8ddf-a61792d342d3 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:19:49.547350 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 709/1403] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:19:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:19:51.501599 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c3ac2-10bc-4a58-9fac-117f30ed2f71 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:51.502126 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c3ac2-10bc-4a58-9fac-117f30ed2f71 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:51.502126 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c3ac2-10bc-4a58-9fac-117f30ed2f71 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:51.503383 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 695/1404] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:19:51.508624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07ce5a-d8e9-41cd-9d0c-926919329b9d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:51.509088 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07ce5a-d8e9-41cd-9d0c-926919329b9d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:51.509189 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07ce5a-d8e9-41cd-9d0c-926919329b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:51.525609 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:51.599487 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2e07ce5a-d8e9-41cd-9d0c-926919329b9d None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:19:51.600780 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2e07ce5a-d8e9-41cd-9d0c-926919329b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:51.706744 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 710/1405] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:19:52.003534 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c3ac2-10bc-4a58-9fac-117f30ed2f71 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:19:52.005329 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-883c3ac2-10bc-4a58-9fac-117f30ed2f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:52.164902 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c3ac2-10bc-4a58-9fac-117f30ed2f71 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:19:52.168323 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:52.298480 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a928ce-575e-4ea0-b5eb-c309daf26387 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:19:52.299125 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a928ce-575e-4ea0-b5eb-c309daf26387 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:52.299398 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a928ce-575e-4ea0-b5eb-c309daf26387 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:52.299661 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a928ce-575e-4ea0-b5eb-c309daf26387 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:52.301245 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-17a928ce-575e-4ea0-b5eb-c309daf26387 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:52.394207 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a928ce-575e-4ea0-b5eb-c309daf26387 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:19:52.395790 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a928ce-575e-4ea0-b5eb-c309daf26387 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:19:52.417110 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 696/1406] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:19:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:19:54.398494 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a117f-5c2d-4cff-b821-1ec041eec216 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:54.399079 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a117f-5c2d-4cff-b821-1ec041eec216 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:54.399227 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a117f-5c2d-4cff-b821-1ec041eec216 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:54.400729 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 711/1407] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:19:54.406164 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f34fa5-b5da-497d-a75f-f7715fe03328 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:54.406629 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f34fa5-b5da-497d-a75f-f7715fe03328 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:54.406891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f34fa5-b5da-497d-a75f-f7715fe03328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:54.416891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:54.478711 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-08f34fa5-b5da-497d-a75f-f7715fe03328 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:19:54.480557 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-08f34fa5-b5da-497d-a75f-f7715fe03328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:54.596960 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 697/1408] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:19:54.882682 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a117f-5c2d-4cff-b821-1ec041eec216 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:19:54.884300 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4a7a117f-5c2d-4cff-b821-1ec041eec216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:54.988232 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:55.061610 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a117f-5c2d-4cff-b821-1ec041eec216 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:19:55.191486 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8e98c-eea7-4876-9fed-a54c57aaff45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:19:55.192097 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8e98c-eea7-4876-9fed-a54c57aaff45 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:19:55.192375 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8e98c-eea7-4876-9fed-a54c57aaff45 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:19:55.192647 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8e98c-eea7-4876-9fed-a54c57aaff45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:19:55.194281 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-83a8e98c-eea7-4876-9fed-a54c57aaff45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:19:55.253518 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:19:55.298376 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8e98c-eea7-4876-9fed-a54c57aaff45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:19:55.300331 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8e98c-eea7-4876-9fed-a54c57aaff45 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:19:55.320795 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 712/1409] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:19:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:20:04.594990 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=62 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:05.318426 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=23 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:10.971651 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c25f6-cf87-4426-9e1a-efd73fb97ffc None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:10.972264 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c25f6-cf87-4426-9e1a-efd73fb97ffc None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:10.972264 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c25f6-cf87-4426-9e1a-efd73fb97ffc None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:10.973639 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 698/1410] 10.222.0.94 () {54 vars in 918 bytes} [Thu Sep 1 17:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:20:10.978721 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234e083-d6ab-423e-8677-d534c2d046ba None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:10.979622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234e083-d6ab-423e-8677-d534c2d046ba None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:10.979805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234e083-d6ab-423e-8677-d534c2d046ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:11.053121 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c234e083-d6ab-423e-8677-d534c2d046ba None None] MFA Rules not processed for user `e3622621761f4f18ae3e9dfb5ba99bef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:20:11.054360 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c234e083-d6ab-423e-8677-d534c2d046ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:11.159623 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 713/1411] 10.222.0.94 () {58 vars in 1015 bytes} [Thu Sep 1 17:20:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:20:11.174299 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179985c-1679-43bd-8114-448e8664cefe None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:11.174588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179985c-1679-43bd-8114-448e8664cefe None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:11.174867 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179985c-1679-43bd-8114-448e8664cefe None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:11.176192 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 699/1412] 10.222.0.94 () {54 vars in 918 bytes} [Thu Sep 1 17:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:20:11.180601 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d11d4-2c2c-496d-a6c9-6f2de3644347 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:11.180891 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d11d4-2c2c-496d-a6c9-6f2de3644347 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:11.181192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d11d4-2c2c-496d-a6c9-6f2de3644347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:11.254339 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:11.257483 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0b2d11d4-2c2c-496d-a6c9-6f2de3644347 None None] MFA Rules not processed for user `8b7fa3c4c5d94b3c9b7f17dde35d39a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:20:11.259205 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0b2d11d4-2c2c-496d-a6c9-6f2de3644347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:11.379059 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 714/1413] 10.222.0.94 () {58 vars in 1015 bytes} [Thu Sep 1 17:20:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:20:13.782107 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef478b-a3aa-483b-8d17-402e54ea9c96 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:13.782661 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef478b-a3aa-483b-8d17-402e54ea9c96 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:13.782661 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef478b-a3aa-483b-8d17-402e54ea9c96 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:13.783989 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 700/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 17:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:20:13.789227 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57daa89-f64d-4b0c-a42b-8f1afa3bd9a7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:13.789689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57daa89-f64d-4b0c-a42b-8f1afa3bd9a7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:13.789794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57daa89-f64d-4b0c-a42b-8f1afa3bd9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:13.856229 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f57daa89-f64d-4b0c-a42b-8f1afa3bd9a7 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:20:13.857341 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f57daa89-f64d-4b0c-a42b-8f1afa3bd9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:13.910770 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:13.952499 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 715/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 17:20:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:20:14.238167 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef478b-a3aa-483b-8d17-402e54ea9c96 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:20:14.239891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e4ef478b-a3aa-483b-8d17-402e54ea9c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:14.383996 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef478b-a3aa-483b-8d17-402e54ea9c96 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:20:14.455067 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:14.495630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b89df1-7d06-4acb-85ba-064bb34d95e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:20:14.496158 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b89df1-7d06-4acb-85ba-064bb34d95e2 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:14.496437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b89df1-7d06-4acb-85ba-064bb34d95e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:14.496734 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b89df1-7d06-4acb-85ba-064bb34d95e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:14.498359 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-48b89df1-7d06-4acb-85ba-064bb34d95e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:14.586889 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b89df1-7d06-4acb-85ba-064bb34d95e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:20:14.588487 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b89df1-7d06-4acb-85ba-064bb34d95e2 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:20:14.606776 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 701/1416] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:20:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:20:15.488432 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e66d7-32c1-4735-bfde-a81e110b2e17 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:15.488994 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e66d7-32c1-4735-bfde-a81e110b2e17 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:15.488994 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e66d7-32c1-4735-bfde-a81e110b2e17 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:15.490330 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 716/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 17:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:20:15.495873 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b1b8d-36fe-4460-bb95-a26753c5ea36 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:15.496350 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b1b8d-36fe-4460-bb95-a26753c5ea36 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:15.496451 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b1b8d-36fe-4460-bb95-a26753c5ea36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:15.573051 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-bf4b1b8d-36fe-4460-bb95-a26753c5ea36 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:20:15.574210 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bf4b1b8d-36fe-4460-bb95-a26753c5ea36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:15.600192 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:15.674510 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 702/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 17:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:20:15.826295 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e66d7-32c1-4735-bfde-a81e110b2e17 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:20:15.827728 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-893e66d7-32c1-4735-bfde-a81e110b2e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:15.973080 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e66d7-32c1-4735-bfde-a81e110b2e17 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:20:16.012871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:16.085172 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d809bc0-e471-4f98-aeb5-ee530b410c64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:20:16.085838 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d809bc0-e471-4f98-aeb5-ee530b410c64 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:16.086116 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d809bc0-e471-4f98-aeb5-ee530b410c64 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:16.086387 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d809bc0-e471-4f98-aeb5-ee530b410c64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:16.087978 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9d809bc0-e471-4f98-aeb5-ee530b410c64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:16.175042 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d809bc0-e471-4f98-aeb5-ee530b410c64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:20:16.176609 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d809bc0-e471-4f98-aeb5-ee530b410c64 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:20:16.194471 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 717/1419] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:20:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:20:17.086194 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a576a-8ad8-419f-bfa6-895866c8d7c7 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:17.086777 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a576a-8ad8-419f-bfa6-895866c8d7c7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:17.086777 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a576a-8ad8-419f-bfa6-895866c8d7c7 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:17.088084 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 703/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 17:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:20:17.093652 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51947d8f-6db2-4c02-a4ad-6b0ad1601b3f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:17.094082 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51947d8f-6db2-4c02-a4ad-6b0ad1601b3f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:17.094192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51947d8f-6db2-4c02-a4ad-6b0ad1601b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:17.147754 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:17.171158 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-51947d8f-6db2-4c02-a4ad-6b0ad1601b3f None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:20:17.172367 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-51947d8f-6db2-4c02-a4ad-6b0ad1601b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:17.267488 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 718/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 17:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:20:17.415533 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a576a-8ad8-419f-bfa6-895866c8d7c7 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:20:17.417396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6d7a576a-8ad8-419f-bfa6-895866c8d7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:17.569825 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a576a-8ad8-419f-bfa6-895866c8d7c7 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:20:17.583505 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:17.688591 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06759e9-e8dd-44da-9984-7a7568b6aac1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:20:17.689111 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06759e9-e8dd-44da-9984-7a7568b6aac1 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:17.689385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06759e9-e8dd-44da-9984-7a7568b6aac1 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:17.689683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06759e9-e8dd-44da-9984-7a7568b6aac1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:17.691283 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f06759e9-e8dd-44da-9984-7a7568b6aac1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:17.781562 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06759e9-e8dd-44da-9984-7a7568b6aac1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:20:17.783192 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06759e9-e8dd-44da-9984-7a7568b6aac1 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:20:17.801387 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 704/1422] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:20:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:20:18.656168 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09950db4-63cc-4b70-846d-1ea931215446 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:18.656736 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09950db4-63cc-4b70-846d-1ea931215446 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:18.656736 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09950db4-63cc-4b70-846d-1ea931215446 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:18.658132 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 719/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 17:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:20:18.663055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a89c8-93b4-498d-aef2-6f3763ed82bd None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:18.663491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a89c8-93b4-498d-aef2-6f3763ed82bd None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:18.663600 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a89c8-93b4-498d-aef2-6f3763ed82bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:18.683316 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:18.740031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-195a89c8-93b4-498d-aef2-6f3763ed82bd None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:20:18.741246 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-195a89c8-93b4-498d-aef2-6f3763ed82bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:18.836152 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 705/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 17:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:20:18.991817 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09950db4-63cc-4b70-846d-1ea931215446 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:20:18.993326 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-09950db4-63cc-4b70-846d-1ea931215446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:19.101324 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:19.137184 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09950db4-63cc-4b70-846d-1ea931215446 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:20:19.247176 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2f051-d243-4fbd-855a-96297404fd32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:20:19.247774 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2f051-d243-4fbd-855a-96297404fd32 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:19.248048 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2f051-d243-4fbd-855a-96297404fd32 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:19.248317 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2f051-d243-4fbd-855a-96297404fd32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:19.249929 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d6a2f051-d243-4fbd-855a-96297404fd32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:19.326080 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:19.345144 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2f051-d243-4fbd-855a-96297404fd32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:20:19.346778 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2f051-d243-4fbd-855a-96297404fd32 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:20:19.367200 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 720/1425] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:20:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:20:20.220851 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d20fc3-3888-48e3-9076-dc505a1b4d00 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:20.221394 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d20fc3-3888-48e3-9076-dc505a1b4d00 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:20.221394 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d20fc3-3888-48e3-9076-dc505a1b4d00 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:20.222760 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 706/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 17:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:20:20.227624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb7ee1-d4ea-429c-a134-ad46bac6be6c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:20.228053 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb7ee1-d4ea-429c-a134-ad46bac6be6c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:20.228179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb7ee1-d4ea-429c-a134-ad46bac6be6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:20.303861 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-7fbb7ee1-d4ea-429c-a134-ad46bac6be6c None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:20:20.305057 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7fbb7ee1-d4ea-429c-a134-ad46bac6be6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:20.398822 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 721/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 17:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:20:20.549077 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d20fc3-3888-48e3-9076-dc505a1b4d00 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:20:20.550638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-29d20fc3-3888-48e3-9076-dc505a1b4d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:20.634019 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:20.696382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d20fc3-3888-48e3-9076-dc505a1b4d00 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:20:20.815655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4500c-204d-419f-a7e5-e40a0f7de272 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:20:20.816166 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4500c-204d-419f-a7e5-e40a0f7de272 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:20.816439 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4500c-204d-419f-a7e5-e40a0f7de272 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:20.816703 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4500c-204d-419f-a7e5-e40a0f7de272 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:20.818318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f5c4500c-204d-419f-a7e5-e40a0f7de272 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:20.864913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:20.906570 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4500c-204d-419f-a7e5-e40a0f7de272 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:20:20.908143 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4500c-204d-419f-a7e5-e40a0f7de272 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:20:20.926096 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 707/1428] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:20:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:20:21.725381 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30043902-ccde-4a15-8903-19a052eba65b None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:21.726111 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30043902-ccde-4a15-8903-19a052eba65b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:21.726111 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30043902-ccde-4a15-8903-19a052eba65b None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:21.727481 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 722/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 17:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:20:21.732961 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941953f8-4a10-44f0-99d6-a5c960a8f518 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:21.733387 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941953f8-4a10-44f0-99d6-a5c960a8f518 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:21.733560 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941953f8-4a10-44f0-99d6-a5c960a8f518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:21.813908 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-941953f8-4a10-44f0-99d6-a5c960a8f518 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:20:21.815098 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-941953f8-4a10-44f0-99d6-a5c960a8f518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:21.910338 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 708/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 17:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:20:22.059159 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30043902-ccde-4a15-8903-19a052eba65b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:20:22.060671 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-30043902-ccde-4a15-8903-19a052eba65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:22.108939 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:22.205010 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30043902-ccde-4a15-8903-19a052eba65b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:20:22.316020 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16e1ac-db00-47e5-b38c-528db28171d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:20:22.316624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16e1ac-db00-47e5-b38c-528db28171d4 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:22.316898 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16e1ac-db00-47e5-b38c-528db28171d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:22.317162 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16e1ac-db00-47e5-b38c-528db28171d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:22.319507 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fd16e1ac-db00-47e5-b38c-528db28171d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:22.326627 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:22.406881 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16e1ac-db00-47e5-b38c-528db28171d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:20:22.408474 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16e1ac-db00-47e5-b38c-528db28171d4 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:20:22.426415 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 723/1431] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:20:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:20:23.224335 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2865047-3ac9-4585-80ca-2be4d81185c2 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:23.224889 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2865047-3ac9-4585-80ca-2be4d81185c2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:23.224889 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2865047-3ac9-4585-80ca-2be4d81185c2 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:23.226307 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 709/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 17:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:20:23.231349 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d50950-c3d6-4eda-9e5b-0f9801f3b069 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:23.231776 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d50950-c3d6-4eda-9e5b-0f9801f3b069 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:23.231885 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d50950-c3d6-4eda-9e5b-0f9801f3b069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:23.306840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a3d50950-c3d6-4eda-9e5b-0f9801f3b069 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:20:23.308548 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a3d50950-c3d6-4eda-9e5b-0f9801f3b069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:23.377023 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:23.406005 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 724/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 17:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:20:23.556350 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2865047-3ac9-4585-80ca-2be4d81185c2 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:20:23.558392 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f2865047-3ac9-4585-80ca-2be4d81185c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:23.576249 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:23.707074 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2865047-3ac9-4585-80ca-2be4d81185c2 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:20:23.794429 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:23.819729 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc6130-cb2f-4150-86f8-c24d21dfa9f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:20:23.820339 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc6130-cb2f-4150-86f8-c24d21dfa9f0 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:23.820619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc6130-cb2f-4150-86f8-c24d21dfa9f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:23.820887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc6130-cb2f-4150-86f8-c24d21dfa9f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:23.823274 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-16fc6130-cb2f-4150-86f8-c24d21dfa9f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:23.914284 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc6130-cb2f-4150-86f8-c24d21dfa9f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:20:23.915866 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc6130-cb2f-4150-86f8-c24d21dfa9f0 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:20:23.934990 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 710/1434] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:20:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:20:24.734269 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e812c-4522-49f7-a3f7-b3e5250a9164 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:24.734838 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e812c-4522-49f7-a3f7-b3e5250a9164 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:24.734838 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e812c-4522-49f7-a3f7-b3e5250a9164 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:24.736152 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 725/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 17:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:20:24.741033 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba8880-7fed-49dc-b7da-58fba20ec5eb None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:24.741488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba8880-7fed-49dc-b7da-58fba20ec5eb None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:24.741621 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba8880-7fed-49dc-b7da-58fba20ec5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:24.816934 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-65ba8880-7fed-49dc-b7da-58fba20ec5eb None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:20:24.818192 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-65ba8880-7fed-49dc-b7da-58fba20ec5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:24.859625 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:24.917794 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 711/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 17:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:20:25.074017 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e812c-4522-49f7-a3f7-b3e5250a9164 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:20:25.075481 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ef4e812c-4522-49f7-a3f7-b3e5250a9164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:25.219161 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e812c-4522-49f7-a3f7-b3e5250a9164 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:20:25.272246 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:25.330706 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e2495-f9d7-43f5-85af-6d0ed7376c50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:20:25.331252 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e2495-f9d7-43f5-85af-6d0ed7376c50 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:25.331534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e2495-f9d7-43f5-85af-6d0ed7376c50 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:25.331805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e2495-f9d7-43f5-85af-6d0ed7376c50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:25.333617 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a66e2495-f9d7-43f5-85af-6d0ed7376c50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:25.420851 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e2495-f9d7-43f5-85af-6d0ed7376c50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:20:25.422596 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e2495-f9d7-43f5-85af-6d0ed7376c50 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:20:25.441683 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 726/1437] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:20:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:20:26.247046 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0c7a0-dade-494d-962f-28f04a672dfe None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:26.247602 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0c7a0-dade-494d-962f-28f04a672dfe None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:26.247602 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0c7a0-dade-494d-962f-28f04a672dfe None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:26.248923 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 712/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 17:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:20:26.253881 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb4d53-2f42-48d9-83af-2d439a21fb75 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:26.254336 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb4d53-2f42-48d9-83af-2d439a21fb75 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:26.254448 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb4d53-2f42-48d9-83af-2d439a21fb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:26.331583 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-37fb4d53-2f42-48d9-83af-2d439a21fb75 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:20:26.332710 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-37fb4d53-2f42-48d9-83af-2d439a21fb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:26.334742 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:26.429174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 727/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 17:20:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:20:26.580560 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0c7a0-dade-494d-962f-28f04a672dfe None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:20:26.582188 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ecc0c7a0-dade-494d-962f-28f04a672dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:26.727202 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0c7a0-dade-494d-962f-28f04a672dfe None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:20:26.752501 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:26.838806 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0d56d-06c3-44a1-b5e2-5253e3dfcee7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:20:26.839333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0d56d-06c3-44a1-b5e2-5253e3dfcee7 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:26.839607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0d56d-06c3-44a1-b5e2-5253e3dfcee7 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:26.839874 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0d56d-06c3-44a1-b5e2-5253e3dfcee7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:26.841478 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a4d0d56d-06c3-44a1-b5e2-5253e3dfcee7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:26.927959 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0d56d-06c3-44a1-b5e2-5253e3dfcee7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:20:26.929574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0d56d-06c3-44a1-b5e2-5253e3dfcee7 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:20:26.948145 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 713/1440] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:20:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:20:28.784016 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a2e27-dfea-43e5-8c6b-107a21b09a44 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:28.784585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a2e27-dfea-43e5-8c6b-107a21b09a44 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:28.784585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a2e27-dfea-43e5-8c6b-107a21b09a44 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:28.786026 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 728/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 17:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:20:28.791297 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689088a9-0612-4c8d-8e7d-c391555382f8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:28.791731 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689088a9-0612-4c8d-8e7d-c391555382f8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:28.791856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689088a9-0612-4c8d-8e7d-c391555382f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:28.833221 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:28.858424 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-689088a9-0612-4c8d-8e7d-c391555382f8 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:20:28.859620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-689088a9-0612-4c8d-8e7d-c391555382f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:28.954792 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 714/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 17:20:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:20:29.237249 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a2e27-dfea-43e5-8c6b-107a21b09a44 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:20:29.238818 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6e1a2e27-dfea-43e5-8c6b-107a21b09a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:29.343179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a2e27-dfea-43e5-8c6b-107a21b09a44 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:20:29.374816 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:29.415795 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea083ff-d8a3-4754-8a2e-5a028419bb87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:20:29.416960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea083ff-d8a3-4754-8a2e-5a028419bb87 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:29.417239 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea083ff-d8a3-4754-8a2e-5a028419bb87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:29.417669 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea083ff-d8a3-4754-8a2e-5a028419bb87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:29.419269 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-eea083ff-d8a3-4754-8a2e-5a028419bb87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:29.526060 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea083ff-d8a3-4754-8a2e-5a028419bb87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:20:29.529998 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea083ff-d8a3-4754-8a2e-5a028419bb87 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:20:29.545289 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 729/1443] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:20:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:20:31.613025 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e6e6f-39b5-45d9-afe7-b0a393b520ad None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:31.613600 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e6e6f-39b5-45d9-afe7-b0a393b520ad None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:31.613600 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e6e6f-39b5-45d9-afe7-b0a393b520ad None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:31.614863 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 715/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 17:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:20:31.620766 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062c404-b550-41e1-8b83-18f8ffcde383 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:31.621196 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062c404-b550-41e1-8b83-18f8ffcde383 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:31.621304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062c404-b550-41e1-8b83-18f8ffcde383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:31.687489 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c062c404-b550-41e1-8b83-18f8ffcde383 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:20:31.688691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c062c404-b550-41e1-8b83-18f8ffcde383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:31.702357 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:31.784552 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 730/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 17:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:20:32.080137 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e6e6f-39b5-45d9-afe7-b0a393b520ad None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:20:32.081705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c35e6e6f-39b5-45d9-afe7-b0a393b520ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:32.187332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e6e6f-39b5-45d9-afe7-b0a393b520ad None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:20:32.199718 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:32.264187 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353767b-4e21-414f-ad36-69cfdcc2e821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:20:32.264792 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353767b-4e21-414f-ad36-69cfdcc2e821 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:32.265071 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353767b-4e21-414f-ad36-69cfdcc2e821 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:32.265344 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353767b-4e21-414f-ad36-69cfdcc2e821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:32.266983 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c353767b-4e21-414f-ad36-69cfdcc2e821 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:32.375789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353767b-4e21-414f-ad36-69cfdcc2e821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:20:32.377160 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353767b-4e21-414f-ad36-69cfdcc2e821 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:20:32.395001 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 716/1446] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:20:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:20:34.581212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327ea65-872d-4d77-9c7c-9f160de21d55 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:34.581740 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327ea65-872d-4d77-9c7c-9f160de21d55 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:34.581837 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327ea65-872d-4d77-9c7c-9f160de21d55 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:34.583141 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 731/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 17:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:20:34.588789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38419f01-df87-45a5-9a5f-214612beee88 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:34.589228 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38419f01-df87-45a5-9a5f-214612beee88 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:34.589326 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38419f01-df87-45a5-9a5f-214612beee88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:34.642865 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:34.661706 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-38419f01-df87-45a5-9a5f-214612beee88 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:20:34.662993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-38419f01-df87-45a5-9a5f-214612beee88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:34.757364 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 717/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 17:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:20:35.047714 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327ea65-872d-4d77-9c7c-9f160de21d55 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:20:35.049266 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9327ea65-872d-4d77-9c7c-9f160de21d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:35.150194 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327ea65-872d-4d77-9c7c-9f160de21d55 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:20:35.190445 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:35.224610 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737a8ed-140c-4ee6-b8c6-10586cd5b979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:20:35.225209 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737a8ed-140c-4ee6-b8c6-10586cd5b979 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:35.225512 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737a8ed-140c-4ee6-b8c6-10586cd5b979 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:35.225785 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737a8ed-140c-4ee6-b8c6-10586cd5b979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:35.227370 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c737a8ed-140c-4ee6-b8c6-10586cd5b979 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:35.334977 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737a8ed-140c-4ee6-b8c6-10586cd5b979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:20:35.336427 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737a8ed-140c-4ee6-b8c6-10586cd5b979 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:20:35.354925 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 732/1449] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:20:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:20:37.404528 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04408e2-d101-4dd9-851d-c5e4d7eba0f5 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:37.405057 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04408e2-d101-4dd9-851d-c5e4d7eba0f5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:37.405057 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04408e2-d101-4dd9-851d-c5e4d7eba0f5 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:37.406483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 718/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 17:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:20:37.411805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e14d4-eac1-49c8-9fea-897354f2fc64 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:37.412217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e14d4-eac1-49c8-9fea-897354f2fc64 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:37.412434 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e14d4-eac1-49c8-9fea-897354f2fc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:37.478013 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-361e14d4-eac1-49c8-9fea-897354f2fc64 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:20:37.479754 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-361e14d4-eac1-49c8-9fea-897354f2fc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:37.500128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:37.578280 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 733/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 17:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:20:37.863142 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04408e2-d101-4dd9-851d-c5e4d7eba0f5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:20:37.864695 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a04408e2-d101-4dd9-851d-c5e4d7eba0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:37.970226 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04408e2-d101-4dd9-851d-c5e4d7eba0f5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:20:37.990389 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:38.044022 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbe140-642e-49f1-8e59-05dfc534d3ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:20:38.044621 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbe140-642e-49f1-8e59-05dfc534d3ac service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:38.044895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbe140-642e-49f1-8e59-05dfc534d3ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:38.045161 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbe140-642e-49f1-8e59-05dfc534d3ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:38.046766 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c8fbe140-642e-49f1-8e59-05dfc534d3ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:38.156794 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbe140-642e-49f1-8e59-05dfc534d3ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:20:38.158243 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbe140-642e-49f1-8e59-05dfc534d3ac service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:20:38.177147 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 719/1452] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:20:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:20:40.197884 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638037d2-fc93-4de4-b458-34858de7b762 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:40.198458 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638037d2-fc93-4de4-b458-34858de7b762 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:40.198458 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638037d2-fc93-4de4-b458-34858de7b762 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:40.199786 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 734/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 17:20:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:20:40.204973 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eab7e0-fe00-44f2-b0f9-17675c5f88d4 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:40.205388 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eab7e0-fe00-44f2-b0f9-17675c5f88d4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:40.205578 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eab7e0-fe00-44f2-b0f9-17675c5f88d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:40.267673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:40.270859 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e7eab7e0-fe00-44f2-b0f9-17675c5f88d4 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:20:40.272447 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e7eab7e0-fe00-44f2-b0f9-17675c5f88d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:40.367590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 720/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 17:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:20:40.657807 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638037d2-fc93-4de4-b458-34858de7b762 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:20:40.659347 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-638037d2-fc93-4de4-b458-34858de7b762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:40.767864 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638037d2-fc93-4de4-b458-34858de7b762 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:20:40.815929 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:40.840734 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40a8e5-c698-453f-8486-24ff78784d14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:20:40.841345 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40a8e5-c698-453f-8486-24ff78784d14 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:40.841664 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40a8e5-c698-453f-8486-24ff78784d14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:40.841937 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40a8e5-c698-453f-8486-24ff78784d14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:40.843530 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5e40a8e5-c698-453f-8486-24ff78784d14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:40.949132 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40a8e5-c698-453f-8486-24ff78784d14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:20:40.950594 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40a8e5-c698-453f-8486-24ff78784d14 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:20:40.968259 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 735/1455] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:20:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:20:42.944256 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9f9f1-6a17-4051-9374-8d30264fafb3 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:42.944791 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9f9f1-6a17-4051-9374-8d30264fafb3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:42.944791 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9f9f1-6a17-4051-9374-8d30264fafb3 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:42.946453 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 721/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 17:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:20:42.952134 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ee00b-3ca1-4247-b980-9a7557b767fe None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:42.952546 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ee00b-3ca1-4247-b980-9a7557b767fe None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:42.952681 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ee00b-3ca1-4247-b980-9a7557b767fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:43.017624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-fc2ee00b-3ca1-4247-b980-9a7557b767fe None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:20:43.018811 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fc2ee00b-3ca1-4247-b980-9a7557b767fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:43.046610 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:43.113257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 736/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 17:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:20:43.402719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9f9f1-6a17-4051-9374-8d30264fafb3 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:20:43.404253 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-13b9f9f1-6a17-4051-9374-8d30264fafb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:43.509532 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9f9f1-6a17-4051-9374-8d30264fafb3 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:20:43.538229 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:43.585676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5fba9c-2d72-4ce6-af74-50963a2fc764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:20:43.586201 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fba9c-2d72-4ce6-af74-50963a2fc764 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:43.586476 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fba9c-2d72-4ce6-af74-50963a2fc764 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:43.586744 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fba9c-2d72-4ce6-af74-50963a2fc764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:43.588327 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ea5fba9c-2d72-4ce6-af74-50963a2fc764 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:43.696790 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5fba9c-2d72-4ce6-af74-50963a2fc764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:20:43.698817 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5fba9c-2d72-4ce6-af74-50963a2fc764 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:20:43.723615 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 722/1458] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:20:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:20:45.680943 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13480254-98ee-4612-99e9-e4928331812c None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:45.682036 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13480254-98ee-4612-99e9-e4928331812c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:45.682161 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13480254-98ee-4612-99e9-e4928331812c None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:45.683455 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 737/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 17:20:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:20:45.688884 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383caddb-3e65-4f21-958b-e4723f445542 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:45.689269 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383caddb-3e65-4f21-958b-e4723f445542 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:45.689466 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383caddb-3e65-4f21-958b-e4723f445542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:45.754872 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-383caddb-3e65-4f21-958b-e4723f445542 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:20:45.756081 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-383caddb-3e65-4f21-958b-e4723f445542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:45.764325 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:45.851741 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 723/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 17:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:20:46.141803 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13480254-98ee-4612-99e9-e4928331812c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:20:46.144508 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-13480254-98ee-4612-99e9-e4928331812c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:46.249366 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13480254-98ee-4612-99e9-e4928331812c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:20:46.303828 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:46.322415 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463c212-395f-4ccb-9170-c8f53794776c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:20:46.323019 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463c212-395f-4ccb-9170-c8f53794776c service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:46.323299 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463c212-395f-4ccb-9170-c8f53794776c service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:46.323569 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463c212-395f-4ccb-9170-c8f53794776c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:46.325191 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6463c212-395f-4ccb-9170-c8f53794776c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:46.432801 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463c212-395f-4ccb-9170-c8f53794776c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:20:46.434277 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463c212-395f-4ccb-9170-c8f53794776c service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:20:46.452212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 738/1461] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:20:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:20:48.414496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb38e43-b670-407f-a806-931c54ab5f34 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:48.415077 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb38e43-b670-407f-a806-931c54ab5f34 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:48.415077 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb38e43-b670-407f-a806-931c54ab5f34 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:48.416890 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 724/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 17:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:20:48.422075 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df34c8-6ec9-4cec-b3ff-03a6d47446ed None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:48.422482 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df34c8-6ec9-4cec-b3ff-03a6d47446ed None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:48.422634 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df34c8-6ec9-4cec-b3ff-03a6d47446ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:48.487870 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-30df34c8-6ec9-4cec-b3ff-03a6d47446ed None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:20:48.489075 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-30df34c8-6ec9-4cec-b3ff-03a6d47446ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:48.526606 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:48.586219 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 739/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 17:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:20:48.891007 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb38e43-b670-407f-a806-931c54ab5f34 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:20:48.892581 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9bb38e43-b670-407f-a806-931c54ab5f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:48.997635 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb38e43-b670-407f-a806-931c54ab5f34 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:20:49.037795 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:49.075620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e756e-961e-41c0-8bc6-b12578234ff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:20:49.076235 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e756e-961e-41c0-8bc6-b12578234ff0 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:49.076513 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e756e-961e-41c0-8bc6-b12578234ff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:49.076786 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e756e-961e-41c0-8bc6-b12578234ff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:49.078444 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bf5e756e-961e-41c0-8bc6-b12578234ff0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:49.187080 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e756e-961e-41c0-8bc6-b12578234ff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:20:49.188651 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e756e-961e-41c0-8bc6-b12578234ff0 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:20:49.208196 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 725/1464] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:20:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:20:51.159871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa329f47-9262-4ace-b489-19e733ce0f01 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:51.160443 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa329f47-9262-4ace-b489-19e733ce0f01 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:51.160443 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa329f47-9262-4ace-b489-19e733ce0f01 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:51.161835 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 740/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 17:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:20:51.167426 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c045b5-4f8c-4e9a-853b-10ea4265648e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:51.167860 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c045b5-4f8c-4e9a-853b-10ea4265648e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:51.167963 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c045b5-4f8c-4e9a-853b-10ea4265648e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:51.232413 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-96c045b5-4f8c-4e9a-853b-10ea4265648e None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:20:51.233630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-96c045b5-4f8c-4e9a-853b-10ea4265648e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:51.250862 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:51.329670 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 726/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 17:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:20:51.611119 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa329f47-9262-4ace-b489-19e733ce0f01 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:20:51.612717 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-aa329f47-9262-4ace-b489-19e733ce0f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:51.714641 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa329f47-9262-4ace-b489-19e733ce0f01 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:20:51.779213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:51.785907 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15013b6-2e81-4f2e-8ea2-e50ade4d564c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:20:51.786473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15013b6-2e81-4f2e-8ea2-e50ade4d564c service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:51.786750 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15013b6-2e81-4f2e-8ea2-e50ade4d564c service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:51.787021 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15013b6-2e81-4f2e-8ea2-e50ade4d564c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:51.788612 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e15013b6-2e81-4f2e-8ea2-e50ade4d564c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:51.897074 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15013b6-2e81-4f2e-8ea2-e50ade4d564c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:20:51.898550 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15013b6-2e81-4f2e-8ea2-e50ade4d564c service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:20:51.915941 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 741/1467] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:20:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:20:53.827607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d6ef8-09fe-4bbb-985c-4d8a3a4b8b12 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:53.828180 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d6ef8-09fe-4bbb-985c-4d8a3a4b8b12 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:53.828180 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d6ef8-09fe-4bbb-985c-4d8a3a4b8b12 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:53.829522 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 727/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 17:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:20:53.834745 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779af064-0a3f-44b1-872b-ed0e29ec9ad5 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:53.835139 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779af064-0a3f-44b1-872b-ed0e29ec9ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:53.835288 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779af064-0a3f-44b1-872b-ed0e29ec9ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:53.900739 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-779af064-0a3f-44b1-872b-ed0e29ec9ad5 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:20:53.902001 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-779af064-0a3f-44b1-872b-ed0e29ec9ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:53.948741 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:53.997430 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 742/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 17:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:20:54.277411 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d6ef8-09fe-4bbb-985c-4d8a3a4b8b12 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:20:54.278987 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1c2d6ef8-09fe-4bbb-985c-4d8a3a4b8b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:54.382355 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d6ef8-09fe-4bbb-985c-4d8a3a4b8b12 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:20:54.428485 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:20:54.454940 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666870b5-a3a8-4472-99a3-70301920c5f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:20:54.455541 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666870b5-a3a8-4472-99a3-70301920c5f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:20:54.455821 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666870b5-a3a8-4472-99a3-70301920c5f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:20:54.456094 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666870b5-a3a8-4472-99a3-70301920c5f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:20:54.457725 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-666870b5-a3a8-4472-99a3-70301920c5f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:20:54.567287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666870b5-a3a8-4472-99a3-70301920c5f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:20:54.568733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666870b5-a3a8-4472-99a3-70301920c5f8 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:20:54.587289 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 728/1470] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:20:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:21:03.995633 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=22 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:21:04.584985 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=66 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:21:14.078752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e4342-648c-40e3-b401-20a0237bdd14 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:21:14.079320 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e4342-648c-40e3-b401-20a0237bdd14 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:21:14.079320 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e4342-648c-40e3-b401-20a0237bdd14 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:21:14.080737 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 743/1471] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:21:14.085979 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8023913-f138-4b8c-a917-f687594bafd5 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:21:14.086385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8023913-f138-4b8c-a917-f687594bafd5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:21:14.086531 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8023913-f138-4b8c-a917-f687594bafd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:21:14.156111 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b8023913-f138-4b8c-a917-f687594bafd5 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:21:14.157337 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b8023913-f138-4b8c-a917-f687594bafd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:21:14.253074 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 729/1472] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:21:14.563300 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2538ddd-7556-43b8-8c77-e9a859f4b649 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:21:14.563585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2538ddd-7556-43b8-8c77-e9a859f4b649 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:21:14.563859 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2538ddd-7556-43b8-8c77-e9a859f4b649 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:21:14.565212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 744/1473] 10.222.0.94 () {54 vars in 967 bytes} [Thu Sep 1 17:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:21:14.569969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b0713-a1b8-4868-a2ea-32451a22cd87 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:21:14.570282 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b0713-a1b8-4868-a2ea-32451a22cd87 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:21:14.570559 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b0713-a1b8-4868-a2ea-32451a22cd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:21:14.645904 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-0e2b0713-a1b8-4868-a2ea-32451a22cd87 None None] MFA Rules not processed for user `74c6647f3aa54dc68e888b3adb8c28b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:21:14.647111 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0e2b0713-a1b8-4868-a2ea-32451a22cd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:21:14.667577 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:21:14.722753 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 730/1474] 10.222.0.94 () {58 vars in 1064 bytes} [Thu Sep 1 17:21:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:21:14.730203 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2538ddd-7556-43b8-8c77-e9a859f4b649 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:21:14.731727 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e2538ddd-7556-43b8-8c77-e9a859f4b649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:21:14.832956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2538ddd-7556-43b8-8c77-e9a859f4b649 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:21:14.903287 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47e3a8-91db-4fba-8fc0-2d0ea2465100 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6647f3aa54dc68e888b3adb8c28b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:21:14.903883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47e3a8-91db-4fba-8fc0-2d0ea2465100 service glance] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:21:14.904154 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47e3a8-91db-4fba-8fc0-2d0ea2465100 service glance] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:21:14.904420 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47e3a8-91db-4fba-8fc0-2d0ea2465100 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:21:14.906016 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2c47e3a8-91db-4fba-8fc0-2d0ea2465100 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:21:14.958771 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:21:15.013996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c47e3a8-91db-4fba-8fc0-2d0ea2465100 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:21:15.015433 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c47e3a8-91db-4fba-8fc0-2d0ea2465100 service glance] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:21:15.036340 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 745/1475] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:21:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:21:17.003811 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14033c3b-f519-4731-ac54-d23c1de5e909 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:21:17.004390 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14033c3b-f519-4731-ac54-d23c1de5e909 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:21:17.004390 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14033c3b-f519-4731-ac54-d23c1de5e909 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:21:17.005736 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 731/1476] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:21:17.010894 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89491c-49d1-40a8-ae41-c6d594f5a317 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:21:17.011296 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89491c-49d1-40a8-ae41-c6d594f5a317 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:21:17.011480 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89491c-49d1-40a8-ae41-c6d594f5a317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:21:17.076304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2b89491c-49d1-40a8-ae41-c6d594f5a317 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:21:17.077538 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2b89491c-49d1-40a8-ae41-c6d594f5a317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:21:17.171604 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 746/1477] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:21:17.442684 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14033c3b-f519-4731-ac54-d23c1de5e909 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:21:17.444226 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-14033c3b-f519-4731-ac54-d23c1de5e909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:21:17.577500 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14033c3b-f519-4731-ac54-d23c1de5e909 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:21:17.630365 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:21:17.676147 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c87e22-6970-4148-a59c-f5d43a3707f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:21:17.676749 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c87e22-6970-4148-a59c-f5d43a3707f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:21:17.677021 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c87e22-6970-4148-a59c-f5d43a3707f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:21:17.677287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c87e22-6970-4148-a59c-f5d43a3707f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:21:17.677963 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c87e22-6970-4148-a59c-f5d43a3707f2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:21:17.679659 dv-cinder-852211-8-smb devstack@keystone.service[81459]: WARNING py.warnings [None req-34c87e22-6970-4148-a59c-f5d43a3707f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 17:21:17.679659 dv-cinder-852211-8-smb devstack@keystone.service[81459]: warnings.warn(msg) Sep 01 17:21:17.679659 dv-cinder-852211-8-smb devstack@keystone.service[81459]: Sep 01 17:21:17.681393 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c87e22-6970-4148-a59c-f5d43a3707f2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:21:17.700013 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 732/1478] 10.222.0.94 () {56 vars in 1108 bytes} [Thu Sep 1 17:21:17 2022] GET /identity/v3/projects => generated 2553 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:21:19.616024 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879f6c3-9ed3-4324-8a19-6ed51587bcdd None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:21:19.616583 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879f6c3-9ed3-4324-8a19-6ed51587bcdd None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:21:19.616583 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879f6c3-9ed3-4324-8a19-6ed51587bcdd None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:21:19.617866 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 747/1479] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:21:19.623120 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8521c-b112-4c8a-adc8-51e46245e400 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:21:19.623551 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8521c-b112-4c8a-adc8-51e46245e400 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:21:19.623673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8521c-b112-4c8a-adc8-51e46245e400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:21:19.689098 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-09b8521c-b112-4c8a-adc8-51e46245e400 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:21:19.690339 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-09b8521c-b112-4c8a-adc8-51e46245e400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:21:19.786666 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 733/1480] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:21:20.080020 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879f6c3-9ed3-4324-8a19-6ed51587bcdd None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:21:20.081579 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3879f6c3-9ed3-4324-8a19-6ed51587bcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:21:20.091427 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:21:20.225769 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879f6c3-9ed3-4324-8a19-6ed51587bcdd None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:21:20.303547 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:21:20.336918 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca6554-fbb3-401d-af99-e540f43ca3af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:21:20.337459 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca6554-fbb3-401d-af99-e540f43ca3af service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:21:20.337739 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca6554-fbb3-401d-af99-e540f43ca3af service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:21:20.338009 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca6554-fbb3-401d-af99-e540f43ca3af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:21:20.339600 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bbca6554-fbb3-401d-af99-e540f43ca3af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:21:20.426438 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca6554-fbb3-401d-af99-e540f43ca3af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:21:20.428016 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca6554-fbb3-401d-af99-e540f43ca3af service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:21:20.447913 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 748/1481] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:21:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:21:22.532990 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc93e8-a1ac-477f-882a-085dfdaff871 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:21:22.533561 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc93e8-a1ac-477f-882a-085dfdaff871 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:21:22.533561 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc93e8-a1ac-477f-882a-085dfdaff871 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:21:22.534906 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 734/1482] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:21:22.540539 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a0331-8d12-48a7-ad22-e20cbfeb758f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:21:22.540955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a0331-8d12-48a7-ad22-e20cbfeb758f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:21:22.541093 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a0331-8d12-48a7-ad22-e20cbfeb758f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:21:22.609021 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-152a0331-8d12-48a7-ad22-e20cbfeb758f None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:21:22.610270 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-152a0331-8d12-48a7-ad22-e20cbfeb758f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:21:22.656301 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:21:22.712575 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 749/1483] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:21:22.998914 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc93e8-a1ac-477f-882a-085dfdaff871 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:21:23.000440 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e0cc93e8-a1ac-477f-882a-085dfdaff871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:21:23.024543 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:21:23.106221 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc93e8-a1ac-477f-882a-085dfdaff871 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:21:23.179698 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8bbdc-517d-44d5-a835-ba83f4f50ca1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:21:23.180924 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8bbdc-517d-44d5-a835-ba83f4f50ca1 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:21:23.181210 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8bbdc-517d-44d5-a835-ba83f4f50ca1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:21:23.181510 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8bbdc-517d-44d5-a835-ba83f4f50ca1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:21:23.183115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1ff8bbdc-517d-44d5-a835-ba83f4f50ca1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:21:23.255637 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:21:23.290384 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8bbdc-517d-44d5-a835-ba83f4f50ca1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:21:23.291826 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8bbdc-517d-44d5-a835-ba83f4f50ca1 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:21:23.311897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 735/1484] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:21:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:21:25.284319 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3786d-4ff6-4b0e-95a7-5a7428b20899 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:21:25.284848 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3786d-4ff6-4b0e-95a7-5a7428b20899 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:21:25.284848 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3786d-4ff6-4b0e-95a7-5a7428b20899 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:21:25.286190 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 750/1485] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:21:25.291823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a9efb-2730-4e02-878f-013ac64381c1 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:21:25.292445 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a9efb-2730-4e02-878f-013ac64381c1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:21:25.292727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a9efb-2730-4e02-878f-013ac64381c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:21:25.357804 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-148a9efb-2730-4e02-878f-013ac64381c1 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:21:25.359015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-148a9efb-2730-4e02-878f-013ac64381c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:21:25.454211 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 736/1486] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:21:25.746325 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3786d-4ff6-4b0e-95a7-5a7428b20899 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:21:25.747853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c9f3786d-4ff6-4b0e-95a7-5a7428b20899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:21:25.849482 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3786d-4ff6-4b0e-95a7-5a7428b20899 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:21:25.921017 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:21:25.922794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5acaa8-c305-4e30-9b30-9c7de771f948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:21:25.923413 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5acaa8-c305-4e30-9b30-9c7de771f948 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:21:25.923877 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5acaa8-c305-4e30-9b30-9c7de771f948 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:21:25.924307 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5acaa8-c305-4e30-9b30-9c7de771f948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:21:25.926241 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ed5acaa8-c305-4e30-9b30-9c7de771f948 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:21:26.035619 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5acaa8-c305-4e30-9b30-9c7de771f948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:21:26.037061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5acaa8-c305-4e30-9b30-9c7de771f948 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:21:26.057641 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 751/1487] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:21:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:21:28.125721 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52de56-c385-46f4-8593-635fe27e9ce5 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:21:28.126294 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52de56-c385-46f4-8593-635fe27e9ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:21:28.126294 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52de56-c385-46f4-8593-635fe27e9ce5 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:21:28.127647 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 737/1488] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:21:28.133383 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2776b2-3136-46b4-994e-02b91122d5a3 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:21:28.133849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2776b2-3136-46b4-994e-02b91122d5a3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:21:28.133953 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2776b2-3136-46b4-994e-02b91122d5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:21:28.202161 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6a2776b2-3136-46b4-994e-02b91122d5a3 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:21:28.203363 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6a2776b2-3136-46b4-994e-02b91122d5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:21:28.253800 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:21:28.297793 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 752/1489] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:21:28.597489 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52de56-c385-46f4-8593-635fe27e9ce5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:21:28.599085 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ee52de56-c385-46f4-8593-635fe27e9ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:21:28.634638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:21:28.701055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52de56-c385-46f4-8593-635fe27e9ce5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:21:28.774058 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a971a-b312-4fda-89b1-8d251c93edae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:21:28.774660 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a971a-b312-4fda-89b1-8d251c93edae service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:21:28.774942 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a971a-b312-4fda-89b1-8d251c93edae service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:21:28.775215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a971a-b312-4fda-89b1-8d251c93edae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:21:28.776823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d27a971a-b312-4fda-89b1-8d251c93edae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:21:28.855744 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:21:28.884738 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a971a-b312-4fda-89b1-8d251c93edae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:21:28.886193 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a971a-b312-4fda-89b1-8d251c93edae service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:21:28.904623 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 738/1490] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:21:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:21:31.026837 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc441f21-0a90-4adf-85c7-faba56e3af08 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:21:31.027384 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc441f21-0a90-4adf-85c7-faba56e3af08 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:21:31.027384 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc441f21-0a90-4adf-85c7-faba56e3af08 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:21:31.028715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 753/1491] 10.222.0.94 () {54 vars in 927 bytes} [Thu Sep 1 17:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:21:31.033994 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39138f74-a4e9-468c-9607-f2895839103a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:21:31.034435 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39138f74-a4e9-468c-9607-f2895839103a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:21:31.034543 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39138f74-a4e9-468c-9607-f2895839103a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:21:31.101257 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-39138f74-a4e9-468c-9607-f2895839103a None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:21:31.103025 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-39138f74-a4e9-468c-9607-f2895839103a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:21:31.197090 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 739/1492] 10.222.0.94 () {58 vars in 1024 bytes} [Thu Sep 1 17:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:21:31.483560 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc441f21-0a90-4adf-85c7-faba56e3af08 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:21:31.485136 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fc441f21-0a90-4adf-85c7-faba56e3af08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:21:31.590254 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc441f21-0a90-4adf-85c7-faba56e3af08 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:21:31.663097 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fb7be-d039-4d2c-9e2b-ce2f556f5b44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:21:31.663705 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fb7be-d039-4d2c-9e2b-ce2f556f5b44 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:21:31.663984 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fb7be-d039-4d2c-9e2b-ce2f556f5b44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:21:31.664255 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fb7be-d039-4d2c-9e2b-ce2f556f5b44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:21:31.665908 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-972fb7be-d039-4d2c-9e2b-ce2f556f5b44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:21:31.674899 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:21:31.776350 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fb7be-d039-4d2c-9e2b-ce2f556f5b44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:21:31.777816 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fb7be-d039-4d2c-9e2b-ce2f556f5b44 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:21:31.795834 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 754/1493] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:21:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:21:41.194553 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=82 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:21:41.793704 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=50 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:22:51.104943 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1ef3f-4d4b-4cd3-8964-0ca89be52236 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:22:51.105772 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1ef3f-4d4b-4cd3-8964-0ca89be52236 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:22:51.105772 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1ef3f-4d4b-4cd3-8964-0ca89be52236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:22:51.180165 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2cd1ef3f-4d4b-4cd3-8964-0ca89be52236 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:22:51.181578 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2cd1ef3f-4d4b-4cd3-8964-0ca89be52236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:22:51.277350 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 740/1494] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:22:51.285302 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f399b8-218c-4f85-bc48-6f75103e0b4c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:22:51.285903 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f399b8-218c-4f85-bc48-6f75103e0b4c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:22:51.285903 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f399b8-218c-4f85-bc48-6f75103e0b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:22:51.363385 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b1f399b8-218c-4f85-bc48-6f75103e0b4c None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:22:51.365068 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b1f399b8-218c-4f85-bc48-6f75103e0b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:22:51.463696 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 755/1495] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:22:51.468252 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1ef3f-4d4b-4cd3-8964-0ca89be52236 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:22:51.469511 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2cd1ef3f-4d4b-4cd3-8964-0ca89be52236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:22:51.481686 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1ef3f-4d4b-4cd3-8964-0ca89be52236 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:22:51.547121 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:22:51.583916 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441adc76-2a5d-4008-aab5-c6f0afb7e643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:22:51.584519 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441adc76-2a5d-4008-aab5-c6f0afb7e643 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:22:51.584794 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441adc76-2a5d-4008-aab5-c6f0afb7e643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:22:51.585055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441adc76-2a5d-4008-aab5-c6f0afb7e643 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:22:51.585719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441adc76-2a5d-4008-aab5-c6f0afb7e643 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:22:51.586016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441adc76-2a5d-4008-aab5-c6f0afb7e643 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:22:51.587017 dv-cinder-852211-8-smb devstack@keystone.service[81459]: WARNING py.warnings [None req-441adc76-2a5d-4008-aab5-c6f0afb7e643 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 17:22:51.587017 dv-cinder-852211-8-smb devstack@keystone.service[81459]: warnings.warn(msg) Sep 01 17:22:51.587017 dv-cinder-852211-8-smb devstack@keystone.service[81459]: Sep 01 17:22:51.587904 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441adc76-2a5d-4008-aab5-c6f0afb7e643 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:22:51.599583 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 741/1496] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:22:51.608899 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f399b8-218c-4f85-bc48-6f75103e0b4c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:22:51.619103 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f399b8-218c-4f85-bc48-6f75103e0b4c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:22:51.680438 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:22:51.714432 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810b831-74c0-4a07-99a7-19cb31dfff5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:22:51.715060 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810b831-74c0-4a07-99a7-19cb31dfff5e admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:22:51.715335 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810b831-74c0-4a07-99a7-19cb31dfff5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:22:51.715602 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810b831-74c0-4a07-99a7-19cb31dfff5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:22:51.716264 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810b831-74c0-4a07-99a7-19cb31dfff5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:22:51.718083 dv-cinder-852211-8-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-b810b831-74c0-4a07-99a7-19cb31dfff5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 17:22:51.718083 dv-cinder-852211-8-smb devstack@keystone.service[81458]: warnings.warn(msg) Sep 01 17:22:51.718083 dv-cinder-852211-8-smb devstack@keystone.service[81458]: Sep 01 17:22:51.719284 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810b831-74c0-4a07-99a7-19cb31dfff5e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:22:51.774543 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 756/1497] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:22:51 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:22:51.778739 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441adc76-2a5d-4008-aab5-c6f0afb7e643 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:22:51.780290 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-441adc76-2a5d-4008-aab5-c6f0afb7e643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:22:51.813301 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441adc76-2a5d-4008-aab5-c6f0afb7e643 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:22:51.910008 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc63cd-9a4a-4ba9-a111-c0507baa5afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:22:51.910616 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc63cd-9a4a-4ba9-a111-c0507baa5afa admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:22:51.910924 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc63cd-9a4a-4ba9-a111-c0507baa5afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:22:51.911198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc63cd-9a4a-4ba9-a111-c0507baa5afa admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:22:51.911821 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc63cd-9a4a-4ba9-a111-c0507baa5afa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:22:51.912825 dv-cinder-852211-8-smb devstack@keystone.service[81459]: WARNING py.warnings [None req-67cc63cd-9a4a-4ba9-a111-c0507baa5afa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 17:22:51.912825 dv-cinder-852211-8-smb devstack@keystone.service[81459]: warnings.warn(msg) Sep 01 17:22:51.912825 dv-cinder-852211-8-smb devstack@keystone.service[81459]: Sep 01 17:22:51.914079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc63cd-9a4a-4ba9-a111-c0507baa5afa admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:22:51.957352 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 742/1498] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:22:51 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:22:51.961594 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810b831-74c0-4a07-99a7-19cb31dfff5e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:22:51.963173 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b810b831-74c0-4a07-99a7-19cb31dfff5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:22:52.023959 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810b831-74c0-4a07-99a7-19cb31dfff5e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:22:52.107068 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:22:52.119095 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8a0ce-5262-4e03-9586-7c15744c95f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:22:52.119709 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8a0ce-5262-4e03-9586-7c15744c95f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:22:52.119985 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8a0ce-5262-4e03-9586-7c15744c95f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:22:52.120254 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8a0ce-5262-4e03-9586-7c15744c95f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:22:52.120894 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8a0ce-5262-4e03-9586-7c15744c95f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:22:52.121943 dv-cinder-852211-8-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-40d8a0ce-5262-4e03-9586-7c15744c95f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 17:22:52.121943 dv-cinder-852211-8-smb devstack@keystone.service[81458]: warnings.warn(msg) Sep 01 17:22:52.121943 dv-cinder-852211-8-smb devstack@keystone.service[81458]: Sep 01 17:22:52.122832 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8a0ce-5262-4e03-9586-7c15744c95f3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:22:52.134941 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 757/1499] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:22:52.138972 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc63cd-9a4a-4ba9-a111-c0507baa5afa admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:22:52.140527 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-67cc63cd-9a4a-4ba9-a111-c0507baa5afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:22:52.152156 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc63cd-9a4a-4ba9-a111-c0507baa5afa admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:22:52.177623 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:22:52.245520 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e69f9-1203-4ce1-8186-05c3c08168b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:22:52.246121 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e69f9-1203-4ce1-8186-05c3c08168b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:22:52.246393 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e69f9-1203-4ce1-8186-05c3c08168b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:22:52.246659 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e69f9-1203-4ce1-8186-05c3c08168b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:22:52.247291 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e69f9-1203-4ce1-8186-05c3c08168b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:22:52.248299 dv-cinder-852211-8-smb devstack@keystone.service[81459]: WARNING py.warnings [None req-076e69f9-1203-4ce1-8186-05c3c08168b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 17:22:52.248299 dv-cinder-852211-8-smb devstack@keystone.service[81459]: warnings.warn(msg) Sep 01 17:22:52.248299 dv-cinder-852211-8-smb devstack@keystone.service[81459]: Sep 01 17:22:52.249178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e69f9-1203-4ce1-8186-05c3c08168b2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:22:52.261802 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 743/1500] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:22:52.266056 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8a0ce-5262-4e03-9586-7c15744c95f3 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:22:52.267583 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-40d8a0ce-5262-4e03-9586-7c15744c95f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:22:52.300968 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8a0ce-5262-4e03-9586-7c15744c95f3 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:22:52.394056 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064c11f-0f2b-4dfe-b95a-34d7028ee6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:22:52.394709 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064c11f-0f2b-4dfe-b95a-34d7028ee6d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:22:52.394984 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064c11f-0f2b-4dfe-b95a-34d7028ee6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:22:52.395290 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064c11f-0f2b-4dfe-b95a-34d7028ee6d3 admin admin] PATH_INFO: `/v3/projects/93bd8f26c7cb45d5a7a27074f20b469b/users/6c1eaeaa37b549319a22d3667bc9fa5d/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:22:52.417855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0064c11f-0f2b-4dfe-b95a-34d7028ee6d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93bd8f26c7cb45d5a7a27074f20b469b, user_id=6c1eaeaa37b549319a22d3667bc9fa5d, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:22:52.418893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-0064c11f-0f2b-4dfe-b95a-34d7028ee6d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 17:22:52.418893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: warnings.warn(msg) Sep 01 17:22:52.418893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: Sep 01 17:22:52.420833 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0064c11f-0f2b-4dfe-b95a-34d7028ee6d3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:22:52.565212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 758/1501] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:22:52 2022] PUT /identity/v3/projects/93bd8f26c7cb45d5a7a27074f20b469b/users/6c1eaeaa37b549319a22d3667bc9fa5d/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:22:52.578205 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95884eb4-f3a0-4219-aaa8-6f2710979472 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:22:52.578519 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95884eb4-f3a0-4219-aaa8-6f2710979472 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:22:52.578795 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95884eb4-f3a0-4219-aaa8-6f2710979472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:22:52.635412 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-95884eb4-f3a0-4219-aaa8-6f2710979472 None None] MFA Rules not processed for user `6c1eaeaa37b549319a22d3667bc9fa5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:22:52.636615 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-95884eb4-f3a0-4219-aaa8-6f2710979472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:22:52.711043 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 744/1502] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:22:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:22:52.723979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b7735-ff2d-4e7d-b39f-f88037b05560 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:22:52.724263 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b7735-ff2d-4e7d-b39f-f88037b05560 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:22:52.724531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b7735-ff2d-4e7d-b39f-f88037b05560 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:22:52.725880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 759/1503] 10.222.0.94 () {54 vars in 964 bytes} [Thu Sep 1 17:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:22:52.730857 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9140686-e101-4055-8fec-bf40a16fc6d3 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:22:52.731146 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9140686-e101-4055-8fec-bf40a16fc6d3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:22:52.731443 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9140686-e101-4055-8fec-bf40a16fc6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:22:52.762772 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:22:52.807441 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b9140686-e101-4055-8fec-bf40a16fc6d3 None None] MFA Rules not processed for user `eee371754d7d43b4987084db58f44957`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:22:52.808643 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b9140686-e101-4055-8fec-bf40a16fc6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:22:52.884160 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 745/1504] 10.222.0.94 () {58 vars in 1061 bytes} [Thu Sep 1 17:22:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:22:52.891874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b7735-ff2d-4e7d-b39f-f88037b05560 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:22:52.893363 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d89b7735-ff2d-4e7d-b39f-f88037b05560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:22:52.946763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:22:53.000074 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b7735-ff2d-4e7d-b39f-f88037b05560 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:22:53.072132 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407bd1e-ddf3-4dc4-b3df-fffb8f0dfcf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:22:53.072665 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407bd1e-ddf3-4dc4-b3df-fffb8f0dfcf5 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:22:53.072942 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407bd1e-ddf3-4dc4-b3df-fffb8f0dfcf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:22:53.073212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407bd1e-ddf3-4dc4-b3df-fffb8f0dfcf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:22:53.074831 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f407bd1e-ddf3-4dc4-b3df-fffb8f0dfcf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:22:53.170052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f407bd1e-ddf3-4dc4-b3df-fffb8f0dfcf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:22:53.171472 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f407bd1e-ddf3-4dc4-b3df-fffb8f0dfcf5 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:22:53.174834 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:22:53.189201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 760/1505] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:22:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:22:53.234074 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a388c-3fdf-4210-a271-e7a656206ef7 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:22:53.234508 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a388c-3fdf-4210-a271-e7a656206ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:22:53.234613 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a388c-3fdf-4210-a271-e7a656206ef7 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:22:53.235872 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 746/1506] 10.222.0.94 () {52 vars in 830 bytes} [Thu Sep 1 17:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:22:53.239901 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407bd1e-ddf3-4dc4-b3df-fffb8f0dfcf5 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:22:53.241090 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f407bd1e-ddf3-4dc4-b3df-fffb8f0dfcf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:22:53.337787 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407bd1e-ddf3-4dc4-b3df-fffb8f0dfcf5 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:22:53.429751 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9878c7-2ebb-47d4-b1b5-dbc2f270692d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:22:53.430375 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9878c7-2ebb-47d4-b1b5-dbc2f270692d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:22:53.430647 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9878c7-2ebb-47d4-b1b5-dbc2f270692d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:22:53.430912 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9878c7-2ebb-47d4-b1b5-dbc2f270692d admin admin] PATH_INFO: `/v3/users/6c1eaeaa37b549319a22d3667bc9fa5d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:22:53.443027 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9878c7-2ebb-47d4-b1b5-dbc2f270692d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c1eaeaa37b549319a22d3667bc9fa5d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:22:53.444048 dv-cinder-852211-8-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-ce9878c7-2ebb-47d4-b1b5-dbc2f270692d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 17:22:53.444048 dv-cinder-852211-8-smb devstack@keystone.service[81458]: warnings.warn(msg) Sep 01 17:22:53.444048 dv-cinder-852211-8-smb devstack@keystone.service[81458]: Sep 01 17:22:53.445532 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9878c7-2ebb-47d4-b1b5-dbc2f270692d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:22:53.454924 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:22:53.509780 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ce9878c7-2ebb-47d4-b1b5-dbc2f270692d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c1eaeaa37b549319a22d3667bc9fa5d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:22:53.510354 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ce9878c7-2ebb-47d4-b1b5-dbc2f270692d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c1eaeaa37b549319a22d3667bc9fa5d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:22:53.533813 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ce9878c7-2ebb-47d4-b1b5-dbc2f270692d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c1eaeaa37b549319a22d3667bc9fa5d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:22:53.548421 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ce9878c7-2ebb-47d4-b1b5-dbc2f270692d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c1eaeaa37b549319a22d3667bc9fa5d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:22:53.557476 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ce9878c7-2ebb-47d4-b1b5-dbc2f270692d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c1eaeaa37b549319a22d3667bc9fa5d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:22:53.563005 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 761/1507] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:22:53 2022] DELETE /identity/v3/users/6c1eaeaa37b549319a22d3667bc9fa5d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:22:53.567549 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e9305-f68d-449a-9cf5-ba50fdb26fd3 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:22:53.567840 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e9305-f68d-449a-9cf5-ba50fdb26fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:22:53.568128 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e9305-f68d-449a-9cf5-ba50fdb26fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:22:53.624696 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e01e9305-f68d-449a-9cf5-ba50fdb26fd3 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:22:53.625856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e01e9305-f68d-449a-9cf5-ba50fdb26fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:22:53.704364 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:22:53.718294 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 747/1508] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:22:53.727938 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9878c7-2ebb-47d4-b1b5-dbc2f270692d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:22:53.729191 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ce9878c7-2ebb-47d4-b1b5-dbc2f270692d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:22:53.826213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9878c7-2ebb-47d4-b1b5-dbc2f270692d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:22:53.878538 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:22:53.900090 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45c847-bb6d-4197-9282-e7d9b7ac8f25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:22:53.900704 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45c847-bb6d-4197-9282-e7d9b7ac8f25 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:22:53.900980 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45c847-bb6d-4197-9282-e7d9b7ac8f25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:22:53.901251 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45c847-bb6d-4197-9282-e7d9b7ac8f25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:22:53.902880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-be45c847-bb6d-4197-9282-e7d9b7ac8f25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:22:54.011962 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45c847-bb6d-4197-9282-e7d9b7ac8f25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:22:54.013378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45c847-bb6d-4197-9282-e7d9b7ac8f25 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:22:54.031170 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 762/1509] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:22:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:22:54.395247 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e9305-f68d-449a-9cf5-ba50fdb26fd3 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:22:54.396588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e01e9305-f68d-449a-9cf5-ba50fdb26fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:22:54.408132 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e9305-f68d-449a-9cf5-ba50fdb26fd3 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:22:54.505351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d7a59-6a40-4b11-86db-8dce18c85f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:22:54.506003 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d7a59-6a40-4b11-86db-8dce18c85f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:22:54.506275 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d7a59-6a40-4b11-86db-8dce18c85f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:22:54.506541 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d7a59-6a40-4b11-86db-8dce18c85f27 admin admin] PATH_INFO: `/v3/projects/93bd8f26c7cb45d5a7a27074f20b469b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:22:54.516172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d7a59-6a40-4b11-86db-8dce18c85f27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93bd8f26c7cb45d5a7a27074f20b469b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:22:54.517191 dv-cinder-852211-8-smb devstack@keystone.service[81459]: WARNING py.warnings [None req-786d7a59-6a40-4b11-86db-8dce18c85f27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 17:22:54.517191 dv-cinder-852211-8-smb devstack@keystone.service[81459]: warnings.warn(msg) Sep 01 17:22:54.517191 dv-cinder-852211-8-smb devstack@keystone.service[81459]: Sep 01 17:22:54.518437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d7a59-6a40-4b11-86db-8dce18c85f27 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:22:54.577970 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-786d7a59-6a40-4b11-86db-8dce18c85f27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93bd8f26c7cb45d5a7a27074f20b469b', 'request_id': 'req-786d7a59-6a40-4b11-86db-8dce18c85f27'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:22:54.583926 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-786d7a59-6a40-4b11-86db-8dce18c85f27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93bd8f26c7cb45d5a7a27074f20b469b', 'request_id': 'req-786d7a59-6a40-4b11-86db-8dce18c85f27'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:22:54.596631 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-786d7a59-6a40-4b11-86db-8dce18c85f27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93bd8f26c7cb45d5a7a27074f20b469b', 'request_id': 'req-786d7a59-6a40-4b11-86db-8dce18c85f27'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:22:54.622736 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-786d7a59-6a40-4b11-86db-8dce18c85f27 admin admin] The token cache is being invalidate because project 93bd8f26c7cb45d5a7a27074f20b469b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:22:54.623025 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-786d7a59-6a40-4b11-86db-8dce18c85f27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:22:54.623447 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-786d7a59-6a40-4b11-86db-8dce18c85f27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:22:54.624847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 748/1510] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:22:54 2022] DELETE /identity/v3/projects/93bd8f26c7cb45d5a7a27074f20b469b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:23:04.029007 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=62 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:23:04.620699 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:24:33.157624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e182211-eb36-4c29-955a-2f8850ab1bd0 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:24:33.158262 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e182211-eb36-4c29-955a-2f8850ab1bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:24:33.158262 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e182211-eb36-4c29-955a-2f8850ab1bd0 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:24:33.159751 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 763/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 17:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:24:33.164752 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0caa97-27e4-4f03-bfed-518bfeef4eda None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:24:33.165240 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0caa97-27e4-4f03-bfed-518bfeef4eda None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:24:33.165359 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0caa97-27e4-4f03-bfed-518bfeef4eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:24:33.247907 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3c0caa97-27e4-4f03-bfed-518bfeef4eda None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:24:33.249100 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3c0caa97-27e4-4f03-bfed-518bfeef4eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:24:33.351089 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 749/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 17:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:24:33.504453 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e182211-eb36-4c29-955a-2f8850ab1bd0 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:24:33.506580 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0e182211-eb36-4c29-955a-2f8850ab1bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:24:33.624156 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e182211-eb36-4c29-955a-2f8850ab1bd0 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:24:33.630211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7273d3-a05d-47f6-828c-8e39e8db6f1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:24:33.630811 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7273d3-a05d-47f6-828c-8e39e8db6f1b service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:24:33.631085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7273d3-a05d-47f6-828c-8e39e8db6f1b service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:24:33.631352 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7273d3-a05d-47f6-828c-8e39e8db6f1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:24:33.639210 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7273d3-a05d-47f6-828c-8e39e8db6f1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:24:33.641310 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7273d3-a05d-47f6-828c-8e39e8db6f1b service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:24:33.650399 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 764/1513] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:24:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:24:34.496428 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d74e87-4423-42be-8ee1-6f4938e9d61c None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:24:34.497000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d74e87-4423-42be-8ee1-6f4938e9d61c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:24:34.497000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d74e87-4423-42be-8ee1-6f4938e9d61c None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:24:34.498338 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 750/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 17:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:24:34.503172 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afacd6-0ac2-4e49-b679-f624390e334a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:24:34.503629 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afacd6-0ac2-4e49-b679-f624390e334a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:24:34.503744 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afacd6-0ac2-4e49-b679-f624390e334a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:24:34.523340 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a8afacd6-0ac2-4e49-b679-f624390e334a None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:24:34.524533 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a8afacd6-0ac2-4e49-b679-f624390e334a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:24:34.533806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 765/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 17:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:24:34.685572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d74e87-4423-42be-8ee1-6f4938e9d61c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:24:34.700161 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d74e87-4423-42be-8ee1-6f4938e9d61c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:24:34.706227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f0757-d7d5-4f9d-997b-11ab790eeb13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:24:34.706822 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f0757-d7d5-4f9d-997b-11ab790eeb13 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:24:34.707103 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f0757-d7d5-4f9d-997b-11ab790eeb13 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:24:34.707382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f0757-d7d5-4f9d-997b-11ab790eeb13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:24:34.715640 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f0757-d7d5-4f9d-997b-11ab790eeb13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:24:34.717238 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f0757-d7d5-4f9d-997b-11ab790eeb13 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:24:34.727079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 751/1516] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:24:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:24:35.688021 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034f6cc-a215-40b2-8657-6acf384c611e None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:24:35.688582 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034f6cc-a215-40b2-8657-6acf384c611e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:24:35.688582 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034f6cc-a215-40b2-8657-6acf384c611e None None] PATH_INFO: `/v3` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:24:35.689934 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 766/1517] 10.222.0.91 () {54 vars in 925 bytes} [Thu Sep 1 17:24:35 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:24:35.703752 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141adda-c9d5-4f30-9154-4cdce33b2f71 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:24:35.704159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141adda-c9d5-4f30-9154-4cdce33b2f71 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:24:35.704298 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141adda-c9d5-4f30-9154-4cdce33b2f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:24:35.761870 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f141adda-c9d5-4f30-9154-4cdce33b2f71 None None] MFA Rules not processed for user `e3622621761f4f18ae3e9dfb5ba99bef`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:24:35.763011 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f141adda-c9d5-4f30-9154-4cdce33b2f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:24:35.779807 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:24:35.834363 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 752/1518] 10.222.0.91 () {58 vars in 1015 bytes} [Thu Sep 1 17:24:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:24:39.658806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e30ace-ed99-4829-aaca-24ea827b6d85 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:24:39.659379 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e30ace-ed99-4829-aaca-24ea827b6d85 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:24:39.659379 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e30ace-ed99-4829-aaca-24ea827b6d85 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:24:39.660756 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 767/1519] 10.222.0.94 () {54 vars in 961 bytes} [Thu Sep 1 17:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:24:39.665738 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0dfa5b-8adc-4bb0-8d8a-0bb4bbd315a7 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:24:39.666148 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0dfa5b-8adc-4bb0-8d8a-0bb4bbd315a7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:24:39.666281 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0dfa5b-8adc-4bb0-8d8a-0bb4bbd315a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:24:39.685126 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-4f0dfa5b-8adc-4bb0-8d8a-0bb4bbd315a7 None None] MFA Rules not processed for user `e3622621761f4f18ae3e9dfb5ba99bef`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:24:39.686337 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4f0dfa5b-8adc-4bb0-8d8a-0bb4bbd315a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:24:39.695843 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 753/1520] 10.222.0.94 () {58 vars in 1058 bytes} [Thu Sep 1 17:24:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:24:39.703732 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e30ace-ed99-4829-aaca-24ea827b6d85 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:24:39.717081 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e30ace-ed99-4829-aaca-24ea827b6d85 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:24:39.721952 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e4405-3413-43f2-88e7-fb604e4ba1e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3622621761f4f18ae3e9dfb5ba99bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:24:39.722538 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e4405-3413-43f2-88e7-fb604e4ba1e9 service placement] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:24:39.722819 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e4405-3413-43f2-88e7-fb604e4ba1e9 service placement] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:24:39.723092 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e4405-3413-43f2-88e7-fb604e4ba1e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:24:39.731305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e4405-3413-43f2-88e7-fb604e4ba1e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:24:39.732882 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e4405-3413-43f2-88e7-fb604e4ba1e9 service placement] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:24:39.743097 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 768/1521] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:24:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:24:45.931512 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db826977-6fc9-4fc1-aeca-433b826d0295 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:24:45.932034 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db826977-6fc9-4fc1-aeca-433b826d0295 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:24:45.932125 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db826977-6fc9-4fc1-aeca-433b826d0295 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:24:45.933565 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 754/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 17:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:24:45.938382 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7aa74-be8d-480e-908c-0db39ab171c4 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:24:45.938813 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7aa74-be8d-480e-908c-0db39ab171c4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:24:45.938954 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7aa74-be8d-480e-908c-0db39ab171c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:24:45.958467 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-95c7aa74-be8d-480e-908c-0db39ab171c4 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:24:45.959639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-95c7aa74-be8d-480e-908c-0db39ab171c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:24:45.967349 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 769/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 17:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:24:46.121394 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db826977-6fc9-4fc1-aeca-433b826d0295 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:24:46.136905 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db826977-6fc9-4fc1-aeca-433b826d0295 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:24:46.143020 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84710a-a5db-4f1a-b777-d5df048aeade service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:24:46.143608 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84710a-a5db-4f1a-b777-d5df048aeade service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:24:46.143889 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84710a-a5db-4f1a-b777-d5df048aeade service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:24:46.144162 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84710a-a5db-4f1a-b777-d5df048aeade service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:24:46.152181 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84710a-a5db-4f1a-b777-d5df048aeade service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:24:46.153802 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84710a-a5db-4f1a-b777-d5df048aeade service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:24:46.163159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 755/1524] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:24:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:24:46.995728 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b867b4-9e7a-4d03-b627-1679408313ed None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:24:46.996311 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b867b4-9e7a-4d03-b627-1679408313ed None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:24:46.996311 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b867b4-9e7a-4d03-b627-1679408313ed None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:24:46.997720 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 770/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 17:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:24:47.002445 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538720ba-8f7d-4aaf-a6a0-3889640b3d5e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:24:47.002874 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538720ba-8f7d-4aaf-a6a0-3889640b3d5e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:24:47.003029 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538720ba-8f7d-4aaf-a6a0-3889640b3d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:24:47.022035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-538720ba-8f7d-4aaf-a6a0-3889640b3d5e None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:24:47.023215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-538720ba-8f7d-4aaf-a6a0-3889640b3d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:24:47.031481 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 756/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 17:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:24:47.190969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b867b4-9e7a-4d03-b627-1679408313ed None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:24:47.205972 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b867b4-9e7a-4d03-b627-1679408313ed None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:24:47.211366 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4113c-c08b-4a1e-88f7-975623104d6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:24:47.212140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4113c-c08b-4a1e-88f7-975623104d6a service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:24:47.212261 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4113c-c08b-4a1e-88f7-975623104d6a service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:24:47.212485 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4113c-c08b-4a1e-88f7-975623104d6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:24:47.221146 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4113c-c08b-4a1e-88f7-975623104d6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:24:47.222766 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4113c-c08b-4a1e-88f7-975623104d6a service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:24:47.232007 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 771/1527] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:24:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:24:51.262877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb385d74-ed51-43ee-b601-02b098bc8f26 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:24:51.263425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb385d74-ed51-43ee-b601-02b098bc8f26 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:24:51.263425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb385d74-ed51-43ee-b601-02b098bc8f26 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:24:51.264796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 757/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 17:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:24:51.270138 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3172ee9-9ddf-4065-b57d-9db81cec2099 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:24:51.270554 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3172ee9-9ddf-4065-b57d-9db81cec2099 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:24:51.270681 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3172ee9-9ddf-4065-b57d-9db81cec2099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:24:51.289700 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e3172ee9-9ddf-4065-b57d-9db81cec2099 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:24:51.290891 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e3172ee9-9ddf-4065-b57d-9db81cec2099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:24:51.299192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 772/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 17:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:24:51.587764 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb385d74-ed51-43ee-b601-02b098bc8f26 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:24:51.589493 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-eb385d74-ed51-43ee-b601-02b098bc8f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:24:51.667153 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb385d74-ed51-43ee-b601-02b098bc8f26 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:24:51.670747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354f229-b5bb-41b5-9235-fbe470dc7dc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:24:51.671343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354f229-b5bb-41b5-9235-fbe470dc7dc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:24:51.671615 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354f229-b5bb-41b5-9235-fbe470dc7dc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:24:51.671879 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354f229-b5bb-41b5-9235-fbe470dc7dc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:24:51.680461 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354f229-b5bb-41b5-9235-fbe470dc7dc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:24:51.681906 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354f229-b5bb-41b5-9235-fbe470dc7dc0 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:24:51.691480 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 758/1530] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:24:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:24:53.597166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28ff14-f67a-485f-b86e-d0904ce0ab04 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:24:53.597726 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28ff14-f67a-485f-b86e-d0904ce0ab04 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:24:53.597726 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28ff14-f67a-485f-b86e-d0904ce0ab04 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:24:53.599091 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 773/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 17:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:24:53.604167 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4a700-1c20-4839-a8e0-a90d313528ac None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:24:53.604572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4a700-1c20-4839-a8e0-a90d313528ac None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:24:53.604720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4a700-1c20-4839-a8e0-a90d313528ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:24:53.624609 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-99f4a700-1c20-4839-a8e0-a90d313528ac None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:24:53.625847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-99f4a700-1c20-4839-a8e0-a90d313528ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:24:53.635253 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 759/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 17:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:24:53.921944 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28ff14-f67a-485f-b86e-d0904ce0ab04 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:24:53.932635 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28ff14-f67a-485f-b86e-d0904ce0ab04 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:24:53.936667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb361b59-cf76-43a4-a948-719069ceabef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:24:53.937252 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb361b59-cf76-43a4-a948-719069ceabef service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:24:53.937562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb361b59-cf76-43a4-a948-719069ceabef service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:24:53.937835 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb361b59-cf76-43a4-a948-719069ceabef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:24:53.946782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb361b59-cf76-43a4-a948-719069ceabef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:24:53.948216 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb361b59-cf76-43a4-a948-719069ceabef service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:24:53.958434 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 774/1533] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:24:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:24:57.743500 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc7fdf-e5a7-4c84-9f24-aa1c21e1c054 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:24:57.744108 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc7fdf-e5a7-4c84-9f24-aa1c21e1c054 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:24:57.744108 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc7fdf-e5a7-4c84-9f24-aa1c21e1c054 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:24:57.745627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 760/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 17:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:24:57.751269 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe1f8f-23bc-4416-9f6d-c8d68eed23b9 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:24:57.751800 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe1f8f-23bc-4416-9f6d-c8d68eed23b9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:24:57.751800 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe1f8f-23bc-4416-9f6d-c8d68eed23b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:24:57.759694 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=81 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:24:57.772628 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f8fe1f8f-23bc-4416-9f6d-c8d68eed23b9 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:24:57.773843 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f8fe1f8f-23bc-4416-9f6d-c8d68eed23b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:24:57.782489 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 775/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 17:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:24:58.329458 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc7fdf-e5a7-4c84-9f24-aa1c21e1c054 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:24:58.331136 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7fbc7fdf-e5a7-4c84-9f24-aa1c21e1c054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:24:58.394875 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:24:58.408639 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc7fdf-e5a7-4c84-9f24-aa1c21e1c054 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:24:58.412206 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385b4fe-9bb8-4dd3-9d29-49fcc5730582 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:24:58.412806 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385b4fe-9bb8-4dd3-9d29-49fcc5730582 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:24:58.413086 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385b4fe-9bb8-4dd3-9d29-49fcc5730582 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:24:58.413353 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385b4fe-9bb8-4dd3-9d29-49fcc5730582 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:24:58.422727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385b4fe-9bb8-4dd3-9d29-49fcc5730582 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:24:58.424155 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385b4fe-9bb8-4dd3-9d29-49fcc5730582 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:24:58.433326 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 761/1536] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:24:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:25:00.343690 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240f9f1-b1c4-44f4-949c-ce16679bc142 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:25:00.344270 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240f9f1-b1c4-44f4-949c-ce16679bc142 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:25:00.344270 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240f9f1-b1c4-44f4-949c-ce16679bc142 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:25:00.345663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 776/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 17:25:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:25:00.350939 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4630a5-3776-494a-aa34-435a7b0be295 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:25:00.351342 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4630a5-3776-494a-aa34-435a7b0be295 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:25:00.351497 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4630a5-3776-494a-aa34-435a7b0be295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:25:00.372511 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5c4630a5-3776-494a-aa34-435a7b0be295 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:25:00.374258 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5c4630a5-3776-494a-aa34-435a7b0be295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:25:00.382214 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 762/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 17:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:25:00.947759 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240f9f1-b1c4-44f4-949c-ce16679bc142 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:25:00.949685 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1240f9f1-b1c4-44f4-949c-ce16679bc142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:25:00.962504 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240f9f1-b1c4-44f4-949c-ce16679bc142 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:25:00.965956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a4c69-243e-4bfe-98b1-b772faafb20c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:25:00.966536 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a4c69-243e-4bfe-98b1-b772faafb20c service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:25:00.966822 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a4c69-243e-4bfe-98b1-b772faafb20c service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:25:00.967076 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a4c69-243e-4bfe-98b1-b772faafb20c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:25:00.975851 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a4c69-243e-4bfe-98b1-b772faafb20c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:25:00.977255 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a4c69-243e-4bfe-98b1-b772faafb20c service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:25:00.986989 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 777/1539] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:25:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:25:10.367658 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=11 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:25:10.982935 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=8 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:29.429603 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd66699-13ba-4e99-95c0-6df89b4e6066 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:29.431403 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd66699-13ba-4e99-95c0-6df89b4e6066 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:29.432000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd66699-13ba-4e99-95c0-6df89b4e6066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:29.432156 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087920f-e2aa-4bd9-bb84-a4fe890883af None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:29.432594 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087920f-e2aa-4bd9-bb84-a4fe890883af None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:29.432699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087920f-e2aa-4bd9-bb84-a4fe890883af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:29.463253 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3fd66699-13ba-4e99-95c0-6df89b4e6066 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:29.464515 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3fd66699-13ba-4e99-95c0-6df89b4e6066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:29.471004 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8087920f-e2aa-4bd9-bb84-a4fe890883af None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:29.472257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8087920f-e2aa-4bd9-bb84-a4fe890883af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:29.488132 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 763/1540] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:29.488379 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 778/1541] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:26:29.498000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e2037-6e0d-4cae-b39c-ef46ef48de08 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:29.498351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e2037-6e0d-4cae-b39c-ef46ef48de08 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:29.498563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e2037-6e0d-4cae-b39c-ef46ef48de08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:29.498900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e1d4b-7a5a-45c1-bbf7-2da3752fc523 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:29.499189 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e1d4b-7a5a-45c1-bbf7-2da3752fc523 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:29.499457 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e1d4b-7a5a-45c1-bbf7-2da3752fc523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:29.524743 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1b4e1d4b-7a5a-45c1-bbf7-2da3752fc523 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:29.526013 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1b4e1d4b-7a5a-45c1-bbf7-2da3752fc523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:29.539070 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6b0e2037-6e0d-4cae-b39c-ef46ef48de08 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:29.542546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6b0e2037-6e0d-4cae-b39c-ef46ef48de08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:29.547252 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 779/1542] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:29.548536 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f60763-e437-4e1a-8423-68929ae88495 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:29.548823 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f60763-e437-4e1a-8423-68929ae88495 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:29.549112 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f60763-e437-4e1a-8423-68929ae88495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:29.569184 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 764/1543] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:29.570094 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e2037-6e0d-4cae-b39c-ef46ef48de08 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:29.600458 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e2037-6e0d-4cae-b39c-ef46ef48de08 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:29.609213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8485c69-5947-4597-a1f4-25e9a2c51965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:29.609856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8485c69-5947-4597-a1f4-25e9a2c51965 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:29.610133 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8485c69-5947-4597-a1f4-25e9a2c51965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:29.610397 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8485c69-5947-4597-a1f4-25e9a2c51965 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:29.611040 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8485c69-5947-4597-a1f4-25e9a2c51965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:26:29.611337 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8485c69-5947-4597-a1f4-25e9a2c51965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:29.612937 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8485c69-5947-4597-a1f4-25e9a2c51965 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:29.615440 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-51f60763-e437-4e1a-8423-68929ae88495 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:29.616641 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-51f60763-e437-4e1a-8423-68929ae88495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:29.639026 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 780/1544] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:29.641797 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f60763-e437-4e1a-8423-68929ae88495 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:29.650715 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 765/1545] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:26:29.651998 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3c7a8-0d24-44d4-b34b-e38d8ae8b3b9 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:29.652281 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3c7a8-0d24-44d4-b34b-e38d8ae8b3b9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:29.652553 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3c7a8-0d24-44d4-b34b-e38d8ae8b3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:29.665633 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f60763-e437-4e1a-8423-68929ae88495 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:29.677804 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b657e-37bf-4389-8e35-174d066517cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:29.678301 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b657e-37bf-4389-8e35-174d066517cc admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:29.678579 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b657e-37bf-4389-8e35-174d066517cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:29.678847 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b657e-37bf-4389-8e35-174d066517cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:29.679503 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b657e-37bf-4389-8e35-174d066517cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:26:29.679868 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b657e-37bf-4389-8e35-174d066517cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:29.686873 dv-cinder-852211-8-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-ca4b657e-37bf-4389-8e35-174d066517cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 17:26:29.686873 dv-cinder-852211-8-smb devstack@keystone.service[81458]: warnings.warn(msg) Sep 01 17:26:29.686873 dv-cinder-852211-8-smb devstack@keystone.service[81458]: Sep 01 17:26:29.687795 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b657e-37bf-4389-8e35-174d066517cc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:29.704877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5ed3c7a8-0d24-44d4-b34b-e38d8ae8b3b9 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:29.706133 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5ed3c7a8-0d24-44d4-b34b-e38d8ae8b3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:29.709766 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 781/1546] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:26:29.710780 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b657e-37bf-4389-8e35-174d066517cc admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:29.715260 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 766/1547] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:29.716469 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafe6c9-c028-438c-846e-3770502b44bc None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:29.716750 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafe6c9-c028-438c-846e-3770502b44bc None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:29.717786 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafe6c9-c028-438c-846e-3770502b44bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:29.739062 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b657e-37bf-4389-8e35-174d066517cc admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:29.754593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9450b-8c41-493c-ba8b-5a3505bce8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:29.755216 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9450b-8c41-493c-ba8b-5a3505bce8bd admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:29.755499 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9450b-8c41-493c-ba8b-5a3505bce8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:29.755776 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9450b-8c41-493c-ba8b-5a3505bce8bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:29.756418 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d9450b-8c41-493c-ba8b-5a3505bce8bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:29.759304 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9aafe6c9-c028-438c-846e-3770502b44bc None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:29.760523 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9aafe6c9-c028-438c-846e-3770502b44bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:29.761811 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d9450b-8c41-493c-ba8b-5a3505bce8bd admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:29.784553 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 767/1548] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:29.788998 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aafe6c9-c028-438c-846e-3770502b44bc None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:29.812862 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aafe6c9-c028-438c-846e-3770502b44bc None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:29.824159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9317b77-96f0-4485-846b-9e1448fe5a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:29.824798 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9317b77-96f0-4485-846b-9e1448fe5a1c admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:29.825079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9317b77-96f0-4485-846b-9e1448fe5a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:29.825356 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9317b77-96f0-4485-846b-9e1448fe5a1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:29.826331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9317b77-96f0-4485-846b-9e1448fe5a1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:26:29.826639 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9317b77-96f0-4485-846b-9e1448fe5a1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:29.828255 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9317b77-96f0-4485-846b-9e1448fe5a1c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:29.841337 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 782/1549] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:26:29 2022] POST /identity/v3/projects => generated 393 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:29.842352 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9450b-8c41-493c-ba8b-5a3505bce8bd admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:29.846371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 768/1550] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:26:29.847692 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b464a-4b5c-4a7a-8cbc-1300e7fdca44 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:29.847997 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b464a-4b5c-4a7a-8cbc-1300e7fdca44 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:29.848275 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b464a-4b5c-4a7a-8cbc-1300e7fdca44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:29.870412 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d01b464a-4b5c-4a7a-8cbc-1300e7fdca44 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:29.871643 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d01b464a-4b5c-4a7a-8cbc-1300e7fdca44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:29.918590 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9450b-8c41-493c-ba8b-5a3505bce8bd admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:29.923333 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd0d08-569d-47d3-9a8f-55ad3bd0fbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:29.923934 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd0d08-569d-47d3-9a8f-55ad3bd0fbaf admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:29.924203 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd0d08-569d-47d3-9a8f-55ad3bd0fbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:29.924469 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd0d08-569d-47d3-9a8f-55ad3bd0fbaf admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:29.925090 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd0d08-569d-47d3-9a8f-55ad3bd0fbaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:29.927020 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd0d08-569d-47d3-9a8f-55ad3bd0fbaf admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:29.932625 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 769/1551] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:29.933830 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49318161-0ecc-4f1c-b210-7cf02bb7f6ec None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:29.934118 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49318161-0ecc-4f1c-b210-7cf02bb7f6ec None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:29.934389 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49318161-0ecc-4f1c-b210-7cf02bb7f6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:29.954105 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-49318161-0ecc-4f1c-b210-7cf02bb7f6ec None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:29.954815 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 783/1552] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:26:29 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:29.955296 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-49318161-0ecc-4f1c-b210-7cf02bb7f6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:29.956534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79213eaa-abda-4462-b941-b1d50290b6e9 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:29.956824 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79213eaa-abda-4462-b941-b1d50290b6e9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:29.957106 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79213eaa-abda-4462-b941-b1d50290b6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:29.983156 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-79213eaa-abda-4462-b941-b1d50290b6e9 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:29.984363 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-79213eaa-abda-4462-b941-b1d50290b6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:30.018973 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 770/1553] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:30.020244 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5254d6-c09c-47b2-8617-20295de4fac5 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:30.021460 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5254d6-c09c-47b2-8617-20295de4fac5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:30.021460 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5254d6-c09c-47b2-8617-20295de4fac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:30.040497 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2a5254d6-c09c-47b2-8617-20295de4fac5 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:30.041811 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2a5254d6-c09c-47b2-8617-20295de4fac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:30.047914 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 784/1554] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:30.048744 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79213eaa-abda-4462-b941-b1d50290b6e9 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:30.056869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 771/1555] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:30.057996 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5254d6-c09c-47b2-8617-20295de4fac5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:30.058156 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79213eaa-abda-4462-b941-b1d50290b6e9 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:30.067855 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5254d6-c09c-47b2-8617-20295de4fac5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:30.068463 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d01b7-70bd-44a3-81ca-9cb92cb2e770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:30.069079 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d01b7-70bd-44a3-81ca-9cb92cb2e770 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:30.069355 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d01b7-70bd-44a3-81ca-9cb92cb2e770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:30.069672 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d01b7-70bd-44a3-81ca-9cb92cb2e770 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:30.070304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057d01b7-70bd-44a3-81ca-9cb92cb2e770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:30.071847 dv-cinder-852211-8-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-057d01b7-70bd-44a3-81ca-9cb92cb2e770 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 17:26:30.071847 dv-cinder-852211-8-smb devstack@keystone.service[81458]: warnings.warn(msg) Sep 01 17:26:30.071847 dv-cinder-852211-8-smb devstack@keystone.service[81458]: Sep 01 17:26:30.073068 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057d01b7-70bd-44a3-81ca-9cb92cb2e770 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:30.073230 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036834c-17d9-43d4-99f7-f09740cd8cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:30.073879 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036834c-17d9-43d4-99f7-f09740cd8cae admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:30.074275 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036834c-17d9-43d4-99f7-f09740cd8cae admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:30.074558 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036834c-17d9-43d4-99f7-f09740cd8cae admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:30.075184 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036834c-17d9-43d4-99f7-f09740cd8cae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:30.076191 dv-cinder-852211-8-smb devstack@keystone.service[81459]: WARNING py.warnings [None req-9036834c-17d9-43d4-99f7-f09740cd8cae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 17:26:30.076191 dv-cinder-852211-8-smb devstack@keystone.service[81459]: warnings.warn(msg) Sep 01 17:26:30.076191 dv-cinder-852211-8-smb devstack@keystone.service[81459]: Sep 01 17:26:30.077375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036834c-17d9-43d4-99f7-f09740cd8cae admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:30.095670 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 785/1556] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:26:30 2022] POST /identity/v3/users => generated 297 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:30.097049 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fc0b6-220c-445f-8eae-4b2b0b4d241f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:30.097343 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fc0b6-220c-445f-8eae-4b2b0b4d241f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:30.097642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fc0b6-220c-445f-8eae-4b2b0b4d241f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:30.107354 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:30.112226 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 772/1557] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:26:30 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:30.112226 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036834c-17d9-43d4-99f7-f09740cd8cae admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:30.118847 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-547fc0b6-220c-445f-8eae-4b2b0b4d241f None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:30.120062 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-547fc0b6-220c-445f-8eae-4b2b0b4d241f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:30.132197 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:30.175793 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036834c-17d9-43d4-99f7-f09740cd8cae admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:30.180426 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894292ec-0164-4182-bf68-d2ab311c23fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:30.181061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894292ec-0164-4182-bf68-d2ab311c23fc admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:30.181342 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894292ec-0164-4182-bf68-d2ab311c23fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:30.181643 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894292ec-0164-4182-bf68-d2ab311c23fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:30.182287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894292ec-0164-4182-bf68-d2ab311c23fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:26:30.182590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894292ec-0164-4182-bf68-d2ab311c23fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:30.185621 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 786/1558] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:30.185621 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fc0b6-220c-445f-8eae-4b2b0b4d241f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:30.185897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894292ec-0164-4182-bf68-d2ab311c23fc admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:30.194096 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fc0b6-220c-445f-8eae-4b2b0b4d241f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:30.199329 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2392d76-2c24-4910-82b2-e4dddd4c6c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:30.199946 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2392d76-2c24-4910-82b2-e4dddd4c6c00 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:30.200232 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2392d76-2c24-4910-82b2-e4dddd4c6c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:30.200505 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2392d76-2c24-4910-82b2-e4dddd4c6c00 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:30.205118 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 773/1559] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:26:30.205290 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2392d76-2c24-4910-82b2-e4dddd4c6c00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:30.205436 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65d7be-47f8-438c-949e-186439fac559 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:30.205436 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65d7be-47f8-438c-949e-186439fac559 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:30.205436 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65d7be-47f8-438c-949e-186439fac559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:30.205692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2392d76-2c24-4910-82b2-e4dddd4c6c00 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:30.224577 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-1a65d7be-47f8-438c-949e-186439fac559 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:30.225781 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 787/1560] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:26:30 2022] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:30.226128 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1a65d7be-47f8-438c-949e-186439fac559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:30.226894 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46004af8-a959-4b55-bce4-ea36abf66e19 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:30.227207 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46004af8-a959-4b55-bce4-ea36abf66e19 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:30.228007 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46004af8-a959-4b55-bce4-ea36abf66e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:30.236085 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 774/1561] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:30.237354 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73608893-269d-4879-b876-c7d944db76fb None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:30.237669 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73608893-269d-4879-b876-c7d944db76fb None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:30.237944 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73608893-269d-4879-b876-c7d944db76fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:30.248866 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-46004af8-a959-4b55-bce4-ea36abf66e19 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:30.250106 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-46004af8-a959-4b55-bce4-ea36abf66e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:30.257774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-73608893-269d-4879-b876-c7d944db76fb None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:30.257958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 788/1562] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:30.258806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46004af8-a959-4b55-bce4-ea36abf66e19 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:30.259011 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-73608893-269d-4879-b876-c7d944db76fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:30.266789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 775/1563] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:30.267537 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73608893-269d-4879-b876-c7d944db76fb None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:30.267900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46004af8-a959-4b55-bce4-ea36abf66e19 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:30.272524 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08eb0d-d152-42d2-af41-93ca17505d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:30.273107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08eb0d-d152-42d2-af41-93ca17505d91 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:30.273383 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08eb0d-d152-42d2-af41-93ca17505d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:30.273681 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08eb0d-d152-42d2-af41-93ca17505d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:30.274345 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08eb0d-d152-42d2-af41-93ca17505d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:30.275936 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08eb0d-d152-42d2-af41-93ca17505d91 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:30.280826 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73608893-269d-4879-b876-c7d944db76fb None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:30.285813 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbc55d-e368-4228-b1cf-b766b24929dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:30.285966 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 789/1564] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:30.286409 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbc55d-e368-4228-b1cf-b766b24929dd admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:30.286754 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbc55d-e368-4228-b1cf-b766b24929dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:30.286974 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134e5b6-c2b3-46e3-ac1d-f8dca39277fe None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:30.287093 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbc55d-e368-4228-b1cf-b766b24929dd admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:30.287259 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134e5b6-c2b3-46e3-ac1d-f8dca39277fe None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:30.287522 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134e5b6-c2b3-46e3-ac1d-f8dca39277fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:30.287702 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfbc55d-e368-4228-b1cf-b766b24929dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:30.290612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfbc55d-e368-4228-b1cf-b766b24929dd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:30.307302 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3134e5b6-c2b3-46e3-ac1d-f8dca39277fe None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:30.308499 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3134e5b6-c2b3-46e3-ac1d-f8dca39277fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:30.314594 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 776/1565] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:26:30 2022] POST /identity/v3/users => generated 288 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:30.314594 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbc55d-e368-4228-b1cf-b766b24929dd admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:30.319567 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 790/1566] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:30.320410 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134e5b6-c2b3-46e3-ac1d-f8dca39277fe None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:30.328419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbc55d-e368-4228-b1cf-b766b24929dd admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:30.329547 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134e5b6-c2b3-46e3-ac1d-f8dca39277fe None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:30.333102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f9e3f-eb0b-4f2e-8b3b-964f1bbec76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:30.333720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f9e3f-eb0b-4f2e-8b3b-964f1bbec76a admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:30.333999 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f9e3f-eb0b-4f2e-8b3b-964f1bbec76a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:30.334098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168bf4c-65fb-44ea-8727-15071c61d4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:30.334269 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f9e3f-eb0b-4f2e-8b3b-964f1bbec76a admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:30.334649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168bf4c-65fb-44ea-8727-15071c61d4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:30.334891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f9e3f-eb0b-4f2e-8b3b-964f1bbec76a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:30.335002 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168bf4c-65fb-44ea-8727-15071c61d4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:30.335181 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168bf4c-65fb-44ea-8727-15071c61d4c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:30.335816 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168bf4c-65fb-44ea-8727-15071c61d4c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:30.337308 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f9e3f-eb0b-4f2e-8b3b-964f1bbec76a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:30.337967 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168bf4c-65fb-44ea-8727-15071c61d4c3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:30.347914 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 791/1567] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:30.348545 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168bf4c-65fb-44ea-8727-15071c61d4c3 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:30.358605 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168bf4c-65fb-44ea-8727-15071c61d4c3 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:30.363752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39ae01-8667-40c0-9052-b5bb5938944d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:30.364439 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39ae01-8667-40c0-9052-b5bb5938944d admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:30.364781 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39ae01-8667-40c0-9052-b5bb5938944d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:30.365056 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39ae01-8667-40c0-9052-b5bb5938944d admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:30.365721 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb39ae01-8667-40c0-9052-b5bb5938944d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:26:30.366020 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb39ae01-8667-40c0-9052-b5bb5938944d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:30.369423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 777/1568] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:26:30 2022] POST /identity/v3/projects => generated 403 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:30.369423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f9e3f-eb0b-4f2e-8b3b-964f1bbec76a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:30.369701 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb39ae01-8667-40c0-9052-b5bb5938944d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:30.387097 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 792/1569] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:26:30.387097 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39ae01-8667-40c0-9052-b5bb5938944d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:30.389981 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39ae01-8667-40c0-9052-b5bb5938944d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:30.430901 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f9e3f-eb0b-4f2e-8b3b-964f1bbec76a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:30.435583 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c746d4c-bbc9-4c76-91ae-258bb78c498b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:30.436243 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c746d4c-bbc9-4c76-91ae-258bb78c498b admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:30.436463 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c746d4c-bbc9-4c76-91ae-258bb78c498b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:30.436735 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c746d4c-bbc9-4c76-91ae-258bb78c498b admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:30.437376 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c746d4c-bbc9-4c76-91ae-258bb78c498b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:26:30.437711 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c746d4c-bbc9-4c76-91ae-258bb78c498b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:30.439303 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c746d4c-bbc9-4c76-91ae-258bb78c498b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:30.446781 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca9441-3b0f-4b21-859d-9c4fd4d07958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:30.447382 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca9441-3b0f-4b21-859d-9c4fd4d07958 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:30.447659 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca9441-3b0f-4b21-859d-9c4fd4d07958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:30.447931 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca9441-3b0f-4b21-859d-9c4fd4d07958 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:30.448563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca9441-3b0f-4b21-859d-9c4fd4d07958 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:26:30.448862 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca9441-3b0f-4b21-859d-9c4fd4d07958 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:30.450482 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca9441-3b0f-4b21-859d-9c4fd4d07958 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:30.454590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 778/1570] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:26:30.455626 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c746d4c-bbc9-4c76-91ae-258bb78c498b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:30.466168 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c746d4c-bbc9-4c76-91ae-258bb78c498b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:30.476211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 793/1571] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:26:30.476211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca9441-3b0f-4b21-859d-9c4fd4d07958 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:30.476525 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49da59-9e1c-4fda-8a6a-b58f7dae41ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:30.476525 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49da59-9e1c-4fda-8a6a-b58f7dae41ac admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:30.476525 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49da59-9e1c-4fda-8a6a-b58f7dae41ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:30.476525 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49da59-9e1c-4fda-8a6a-b58f7dae41ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:30.476856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c49da59-9e1c-4fda-8a6a-b58f7dae41ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:30.476943 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c49da59-9e1c-4fda-8a6a-b58f7dae41ac admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:30.481861 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca9441-3b0f-4b21-859d-9c4fd4d07958 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:30.488488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 779/1572] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:30.489390 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49da59-9e1c-4fda-8a6a-b58f7dae41ac admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:30.491640 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27e889-ca8a-406d-b3c8-9a5143f91c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:30.492267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27e889-ca8a-406d-b3c8-9a5143f91c34 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:30.492544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27e889-ca8a-406d-b3c8-9a5143f91c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:30.492811 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27e889-ca8a-406d-b3c8-9a5143f91c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:30.493658 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27e889-ca8a-406d-b3c8-9a5143f91c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:30.495385 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27e889-ca8a-406d-b3c8-9a5143f91c34 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:30.501367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49da59-9e1c-4fda-8a6a-b58f7dae41ac admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:30.506499 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 794/1573] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:30.507313 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27e889-ca8a-406d-b3c8-9a5143f91c34 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:30.507442 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753ab26-c2da-477b-9083-3cbdee6c2ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:30.508210 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753ab26-c2da-477b-9083-3cbdee6c2ebf admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:30.508563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753ab26-c2da-477b-9083-3cbdee6c2ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:30.508950 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753ab26-c2da-477b-9083-3cbdee6c2ebf admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:30.509725 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753ab26-c2da-477b-9083-3cbdee6c2ebf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:26:30.510026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753ab26-c2da-477b-9083-3cbdee6c2ebf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:30.511623 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753ab26-c2da-477b-9083-3cbdee6c2ebf admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:30.517000 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27e889-ca8a-406d-b3c8-9a5143f91c34 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:30.521620 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3a3d0-791e-40d7-81e6-5ea068735983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:30.522201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3a3d0-791e-40d7-81e6-5ea068735983 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:30.522477 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3a3d0-791e-40d7-81e6-5ea068735983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:30.522742 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3a3d0-791e-40d7-81e6-5ea068735983 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:30.523356 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3a3d0-791e-40d7-81e6-5ea068735983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:30.532154 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 780/1574] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:26:30.532154 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753ab26-c2da-477b-9083-3cbdee6c2ebf admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:30.532405 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3a3d0-791e-40d7-81e6-5ea068735983 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:30.536323 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753ab26-c2da-477b-9083-3cbdee6c2ebf admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:30.541622 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c57df-e052-485a-83c1-d77c7540ea9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:30.542256 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c57df-e052-485a-83c1-d77c7540ea9f admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:30.542536 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c57df-e052-485a-83c1-d77c7540ea9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:30.542834 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c57df-e052-485a-83c1-d77c7540ea9f admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:30.543461 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c57df-e052-485a-83c1-d77c7540ea9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:30.545376 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c57df-e052-485a-83c1-d77c7540ea9f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:30.545576 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 795/1575] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:30.546447 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3a3d0-791e-40d7-81e6-5ea068735983 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:30.557026 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3a3d0-791e-40d7-81e6-5ea068735983 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:30.562396 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193366a3-eed3-4000-a328-6f02f2acc860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:30.562999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193366a3-eed3-4000-a328-6f02f2acc860 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:30.563276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193366a3-eed3-4000-a328-6f02f2acc860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:30.563535 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193366a3-eed3-4000-a328-6f02f2acc860 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:30.564150 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193366a3-eed3-4000-a328-6f02f2acc860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:30.569372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 781/1576] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:26:30 2022] POST /identity/v3/users => generated 302 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:30.569538 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193366a3-eed3-4000-a328-6f02f2acc860 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:30.569624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c57df-e052-485a-83c1-d77c7540ea9f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:30.576432 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:30.576662 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c57df-e052-485a-83c1-d77c7540ea9f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:30.582321 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cef90-5c48-41a0-b8fe-202d77bab43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:30.583061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cef90-5c48-41a0-b8fe-202d77bab43c admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:30.583341 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cef90-5c48-41a0-b8fe-202d77bab43c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:30.583610 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cef90-5c48-41a0-b8fe-202d77bab43c admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:30.584292 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cef90-5c48-41a0-b8fe-202d77bab43c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:30.586448 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cef90-5c48-41a0-b8fe-202d77bab43c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:30.600195 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 796/1577] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:26:30 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:30.600195 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193366a3-eed3-4000-a328-6f02f2acc860 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:30.602557 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:30.625103 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 782/1578] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:26:30 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:30.625103 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cef90-5c48-41a0-b8fe-202d77bab43c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:30.661375 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193366a3-eed3-4000-a328-6f02f2acc860 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:30.686776 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cef90-5c48-41a0-b8fe-202d77bab43c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:30.691645 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de208b-5608-4a82-b0e9-2bbc2355c48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:30.692306 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de208b-5608-4a82-b0e9-2bbc2355c48f admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:30.692586 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de208b-5608-4a82-b0e9-2bbc2355c48f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:30.692861 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de208b-5608-4a82-b0e9-2bbc2355c48f admin admin] PATH_INFO: `/v3/projects/09e77070c070487e8ff45aa73ed11e53/users/eb6bfd9c259748d0a705cf2780b5c194/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:30.707700 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de208b-5608-4a82-b0e9-2bbc2355c48f admin admin] RBAC: Authorizing `identity:create_grant(project_id=09e77070c070487e8ff45aa73ed11e53, user_id=eb6bfd9c259748d0a705cf2780b5c194, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:30.708725 dv-cinder-852211-8-smb devstack@keystone.service[81459]: WARNING py.warnings [None req-15de208b-5608-4a82-b0e9-2bbc2355c48f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 17:26:30.708725 dv-cinder-852211-8-smb devstack@keystone.service[81459]: warnings.warn(msg) Sep 01 17:26:30.708725 dv-cinder-852211-8-smb devstack@keystone.service[81459]: Sep 01 17:26:30.710695 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de208b-5608-4a82-b0e9-2bbc2355c48f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:30.721163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3510b74-e48d-4610-a30f-88ae853c13c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:30.721941 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3510b74-e48d-4610-a30f-88ae853c13c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:30.722322 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3510b74-e48d-4610-a30f-88ae853c13c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:30.722695 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3510b74-e48d-4610-a30f-88ae853c13c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:30.723438 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3510b74-e48d-4610-a30f-88ae853c13c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:30.724128 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 783/1579] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:26:30 2022] PUT /identity/v3/projects/09e77070c070487e8ff45aa73ed11e53/users/eb6bfd9c259748d0a705cf2780b5c194/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:30.724934 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de208b-5608-4a82-b0e9-2bbc2355c48f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:30.725835 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3510b74-e48d-4610-a30f-88ae853c13c8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:30.756622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 797/1580] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:26:30 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:30.756622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3510b74-e48d-4610-a30f-88ae853c13c8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:30.795067 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de208b-5608-4a82-b0e9-2bbc2355c48f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:30.816597 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3510b74-e48d-4610-a30f-88ae853c13c8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:30.822068 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80ac08-b837-4833-b8d9-c5a07582f05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:30.822671 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80ac08-b837-4833-b8d9-c5a07582f05a admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:30.822948 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80ac08-b837-4833-b8d9-c5a07582f05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:30.823215 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80ac08-b837-4833-b8d9-c5a07582f05a admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:30.823843 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80ac08-b837-4833-b8d9-c5a07582f05a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:30.825771 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80ac08-b837-4833-b8d9-c5a07582f05a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:30.851474 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8592b-a459-44ea-9d4c-d840a501902f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:30.852079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8592b-a459-44ea-9d4c-d840a501902f admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:30.852378 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8592b-a459-44ea-9d4c-d840a501902f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:30.852629 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8592b-a459-44ea-9d4c-d840a501902f admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:30.853148 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 798/1581] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:26:30 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:30.853263 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e8592b-a459-44ea-9d4c-d840a501902f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:30.853975 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80ac08-b837-4833-b8d9-c5a07582f05a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:30.854985 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e8592b-a459-44ea-9d4c-d840a501902f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:30.862633 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:30.868600 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 784/1582] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:30.868600 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8592b-a459-44ea-9d4c-d840a501902f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:30.876139 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8592b-a459-44ea-9d4c-d840a501902f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:30.888553 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:30.920041 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80ac08-b837-4833-b8d9-c5a07582f05a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:30.924623 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64807f7d-8b25-43c2-b765-a0783f91ceed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:30.925277 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64807f7d-8b25-43c2-b765-a0783f91ceed admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:30.925582 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64807f7d-8b25-43c2-b765-a0783f91ceed admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:30.925851 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64807f7d-8b25-43c2-b765-a0783f91ceed admin admin] PATH_INFO: `/v3/projects/267c66820db44f0cb14f8e17e00505c3/users/9488a385bb174e46ace86da0cb3920ee/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:30.933150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e084e82-c23e-4501-af1a-551a179ce601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:30.933779 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e084e82-c23e-4501-af1a-551a179ce601 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:30.934057 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e084e82-c23e-4501-af1a-551a179ce601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:30.934326 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e084e82-c23e-4501-af1a-551a179ce601 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:30.934960 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e084e82-c23e-4501-af1a-551a179ce601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:30.936555 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e084e82-c23e-4501-af1a-551a179ce601 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:30.940326 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64807f7d-8b25-43c2-b765-a0783f91ceed admin admin] RBAC: Authorizing `identity:create_grant(project_id=267c66820db44f0cb14f8e17e00505c3, user_id=9488a385bb174e46ace86da0cb3920ee, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:30.943290 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64807f7d-8b25-43c2-b765-a0783f91ceed admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:30.947670 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 785/1583] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:30.949019 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e084e82-c23e-4501-af1a-551a179ce601 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:30.956978 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 799/1584] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:26:30 2022] PUT /identity/v3/projects/267c66820db44f0cb14f8e17e00505c3/users/9488a385bb174e46ace86da0cb3920ee/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:30.969050 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64807f7d-8b25-43c2-b765-a0783f91ceed admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:30.969187 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e084e82-c23e-4501-af1a-551a179ce601 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:31.016334 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfcbb5-1cf9-47af-a2f4-98f2380708f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:31.017466 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfcbb5-1cf9-47af-a2f4-98f2380708f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:31.017878 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfcbb5-1cf9-47af-a2f4-98f2380708f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:31.018297 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfcbb5-1cf9-47af-a2f4-98f2380708f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:31.018958 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfcbb5-1cf9-47af-a2f4-98f2380708f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:31.020161 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64807f7d-8b25-43c2-b765-a0783f91ceed admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:31.020944 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfcbb5-1cf9-47af-a2f4-98f2380708f6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:31.025388 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25255c07-7dce-426f-baa7-8b7a7ce5f588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:31.026013 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25255c07-7dce-426f-baa7-8b7a7ce5f588 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:31.026295 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25255c07-7dce-426f-baa7-8b7a7ce5f588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:31.026565 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25255c07-7dce-426f-baa7-8b7a7ce5f588 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:31.027188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25255c07-7dce-426f-baa7-8b7a7ce5f588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:31.029099 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25255c07-7dce-426f-baa7-8b7a7ce5f588 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:31.043852 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 786/1585] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:26:30 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:31.045752 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f5172-d410-4134-bd3c-227df0e1da6f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:31.046038 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f5172-d410-4134-bd3c-227df0e1da6f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:31.046310 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f5172-d410-4134-bd3c-227df0e1da6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:31.055435 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 800/1586] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:26:30 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:31.055435 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25255c07-7dce-426f-baa7-8b7a7ce5f588 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:31.065218 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25255c07-7dce-426f-baa7-8b7a7ce5f588 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:31.065367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-830f5172-d410-4134-bd3c-227df0e1da6f None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:31.066727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-830f5172-d410-4134-bd3c-227df0e1da6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:31.070141 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480fdc9-1c3b-40bc-98d0-8643965dac5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:31.070726 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480fdc9-1c3b-40bc-98d0-8643965dac5b admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:31.071003 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480fdc9-1c3b-40bc-98d0-8643965dac5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:31.071806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480fdc9-1c3b-40bc-98d0-8643965dac5b admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:31.072432 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480fdc9-1c3b-40bc-98d0-8643965dac5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:31.074378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480fdc9-1c3b-40bc-98d0-8643965dac5b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:31.075019 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 787/1587] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:31.075810 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f5172-d410-4134-bd3c-227df0e1da6f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:31.087974 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f5172-d410-4134-bd3c-227df0e1da6f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:31.093176 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b48174-a3c2-46b2-8ff2-148088ab4afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:31.093798 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b48174-a3c2-46b2-8ff2-148088ab4afb admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:31.094075 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b48174-a3c2-46b2-8ff2-148088ab4afb admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:31.094452 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b48174-a3c2-46b2-8ff2-148088ab4afb admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:31.095076 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b48174-a3c2-46b2-8ff2-148088ab4afb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:31.096990 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b48174-a3c2-46b2-8ff2-148088ab4afb admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:31.100386 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 801/1588] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:26:31 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:31.100386 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480fdc9-1c3b-40bc-98d0-8643965dac5b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:31.109788 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480fdc9-1c3b-40bc-98d0-8643965dac5b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:31.115139 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69645576-01bd-4f80-87d2-386b7c95fef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:31.115941 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69645576-01bd-4f80-87d2-386b7c95fef9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:31.116323 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69645576-01bd-4f80-87d2-386b7c95fef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:31.116709 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69645576-01bd-4f80-87d2-386b7c95fef9 admin admin] PATH_INFO: `/v3/projects/a4efb55c7ae044ebacd068c9fe47c307/users/9492a32538da4b0a8dc781e3485ac892/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:31.119764 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 788/1589] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:26:31 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:31.123680 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b48174-a3c2-46b2-8ff2-148088ab4afb admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:31.132150 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69645576-01bd-4f80-87d2-386b7c95fef9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4efb55c7ae044ebacd068c9fe47c307, user_id=9492a32538da4b0a8dc781e3485ac892, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:31.132898 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b48174-a3c2-46b2-8ff2-148088ab4afb admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:31.135514 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69645576-01bd-4f80-87d2-386b7c95fef9 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:31.138310 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c085219-8d83-42e4-902c-6b7850c542ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:31.138889 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c085219-8d83-42e4-902c-6b7850c542ed admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:31.139161 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c085219-8d83-42e4-902c-6b7850c542ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:31.139430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c085219-8d83-42e4-902c-6b7850c542ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:31.140330 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c085219-8d83-42e4-902c-6b7850c542ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:31.142359 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c085219-8d83-42e4-902c-6b7850c542ed admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:31.149305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 802/1590] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:26:31 2022] PUT /identity/v3/projects/a4efb55c7ae044ebacd068c9fe47c307/users/9492a32538da4b0a8dc781e3485ac892/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:31.150552 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba578365-b152-415b-a0ef-5fc5b7cc4887 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:31.150837 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba578365-b152-415b-a0ef-5fc5b7cc4887 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:31.151105 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba578365-b152-415b-a0ef-5fc5b7cc4887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:31.156647 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 789/1591] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:31.157537 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c085219-8d83-42e4-902c-6b7850c542ed admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:31.167078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c085219-8d83-42e4-902c-6b7850c542ed admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:31.178351 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ba578365-b152-415b-a0ef-5fc5b7cc4887 None None] MFA Rules not processed for user `9488a385bb174e46ace86da0cb3920ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:31.179559 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ba578365-b152-415b-a0ef-5fc5b7cc4887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:31.205653 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:31.224684 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81ba39-9a59-4c0c-96a3-4d03d72a589f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:31.225572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81ba39-9a59-4c0c-96a3-4d03d72a589f admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:31.225848 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81ba39-9a59-4c0c-96a3-4d03d72a589f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:31.226120 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81ba39-9a59-4c0c-96a3-4d03d72a589f admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:31.226756 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81ba39-9a59-4c0c-96a3-4d03d72a589f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:31.228422 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81ba39-9a59-4c0c-96a3-4d03d72a589f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:31.238110 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 790/1592] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:31.238899 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81ba39-9a59-4c0c-96a3-4d03d72a589f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:31.245182 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:31.248930 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 803/1593] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:31.249242 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81ba39-9a59-4c0c-96a3-4d03d72a589f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:31.250187 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba578365-b152-415b-a0ef-5fc5b7cc4887 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:31.259308 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00e5d9-d076-4320-8f29-68649815f97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:31.259929 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00e5d9-d076-4320-8f29-68649815f97c admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:31.260209 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00e5d9-d076-4320-8f29-68649815f97c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:31.260476 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00e5d9-d076-4320-8f29-68649815f97c admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:31.261114 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00e5d9-d076-4320-8f29-68649815f97c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:31.262750 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00e5d9-d076-4320-8f29-68649815f97c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:31.273433 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 791/1594] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:31.274187 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00e5d9-d076-4320-8f29-68649815f97c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:31.284755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00e5d9-d076-4320-8f29-68649815f97c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:31.291163 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e3359-3d69-49c6-bde4-3188adda360f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:31.291825 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e3359-3d69-49c6-bde4-3188adda360f admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:31.292100 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e3359-3d69-49c6-bde4-3188adda360f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:31.292375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e3359-3d69-49c6-bde4-3188adda360f admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:31.293152 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e3359-3d69-49c6-bde4-3188adda360f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:31.295045 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e3359-3d69-49c6-bde4-3188adda360f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:31.306481 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 792/1595] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:31.307297 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e3359-3d69-49c6-bde4-3188adda360f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:31.312844 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba578365-b152-415b-a0ef-5fc5b7cc4887 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:31.316872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74183125-b619-4d62-b751-ac2846e9237f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:31.317296 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e3359-3d69-49c6-bde4-3188adda360f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:31.317521 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74183125-b619-4d62-b751-ac2846e9237f service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:31.317793 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74183125-b619-4d62-b751-ac2846e9237f service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:31.318066 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74183125-b619-4d62-b751-ac2846e9237f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:31.322436 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a233041-e701-4d62-b0f4-0167afea632b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:31.323093 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a233041-e701-4d62-b0f4-0167afea632b admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:31.323369 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a233041-e701-4d62-b0f4-0167afea632b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:31.323639 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a233041-e701-4d62-b0f4-0167afea632b admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:31.324407 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a233041-e701-4d62-b0f4-0167afea632b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:31.325882 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a233041-e701-4d62-b0f4-0167afea632b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:31.327983 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74183125-b619-4d62-b751-ac2846e9237f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:31.329527 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74183125-b619-4d62-b751-ac2846e9237f service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:31.335826 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 793/1596] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:31.337209 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e72bb-5a69-4f1f-a879-bd77859dea62 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:31.337522 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e72bb-5a69-4f1f-a879-bd77859dea62 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:31.337915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e72bb-5a69-4f1f-a879-bd77859dea62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:31.339173 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 804/1597] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:26:31.339783 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74183125-b619-4d62-b751-ac2846e9237f service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:31.350711 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74183125-b619-4d62-b751-ac2846e9237f service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:31.356205 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472aac2-8ef4-43c3-82af-e384b30bd6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:31.356558 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-be4e72bb-5a69-4f1f-a879-bd77859dea62 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:31.356684 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472aac2-8ef4-43c3-82af-e384b30bd6d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:31.356920 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472aac2-8ef4-43c3-82af-e384b30bd6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:31.357338 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472aac2-8ef4-43c3-82af-e384b30bd6d7 admin admin] PATH_INFO: `/v3/projects/9e05ba77bff64527aaa60a522b4cad50/users/e75a67f37877499ab6545ecac5b1acf0/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:31.357926 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-be4e72bb-5a69-4f1f-a879-bd77859dea62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:31.366552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 794/1598] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:31.367265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e72bb-5a69-4f1f-a879-bd77859dea62 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:31.377341 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e72bb-5a69-4f1f-a879-bd77859dea62 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:31.379228 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472aac2-8ef4-43c3-82af-e384b30bd6d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e05ba77bff64527aaa60a522b4cad50, user_id=e75a67f37877499ab6545ecac5b1acf0, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:31.382113 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a3d7d-94d6-43c7-8318-b24659e59832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:31.382550 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472aac2-8ef4-43c3-82af-e384b30bd6d7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:31.382726 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a3d7d-94d6-43c7-8318-b24659e59832 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:31.382993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a3d7d-94d6-43c7-8318-b24659e59832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:31.383265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a3d7d-94d6-43c7-8318-b24659e59832 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:31.384485 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a3d7d-94d6-43c7-8318-b24659e59832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:31.386113 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a3d7d-94d6-43c7-8318-b24659e59832 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:31.400491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 795/1599] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:31.400491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a3d7d-94d6-43c7-8318-b24659e59832 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:31.400794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 805/1600] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:26:31 2022] PUT /identity/v3/projects/9e05ba77bff64527aaa60a522b4cad50/users/e75a67f37877499ab6545ecac5b1acf0/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:31.400794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa502bb-38da-4a7b-9b75-17ec058da834 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:31.400794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa502bb-38da-4a7b-9b75-17ec058da834 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:31.400794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa502bb-38da-4a7b-9b75-17ec058da834 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:31.405765 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 806/1601] 10.222.0.94 () {54 vars in 962 bytes} [Thu Sep 1 17:26:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:26:31.407487 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa502bb-38da-4a7b-9b75-17ec058da834 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:31.412217 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a3d7d-94d6-43c7-8318-b24659e59832 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:31.480616 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739b18c-7b20-4ace-9bbb-642da296ae13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:31.481332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739b18c-7b20-4ace-9bbb-642da296ae13 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:31.481563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa502bb-38da-4a7b-9b75-17ec058da834 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:31.481990 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739b18c-7b20-4ace-9bbb-642da296ae13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:31.481990 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739b18c-7b20-4ace-9bbb-642da296ae13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:31.482801 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739b18c-7b20-4ace-9bbb-642da296ae13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:31.484707 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739b18c-7b20-4ace-9bbb-642da296ae13 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:31.486975 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdba287-365d-44d0-b667-3bf8b12fb348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:31.487589 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdba287-365d-44d0-b667-3bf8b12fb348 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:31.487860 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdba287-365d-44d0-b667-3bf8b12fb348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:31.488131 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdba287-365d-44d0-b667-3bf8b12fb348 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:31.488805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdba287-365d-44d0-b667-3bf8b12fb348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:31.490435 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdba287-365d-44d0-b667-3bf8b12fb348 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:31.500923 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 796/1602] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:31.500923 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739b18c-7b20-4ace-9bbb-642da296ae13 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:31.507746 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 807/1603] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:31.507746 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdba287-365d-44d0-b667-3bf8b12fb348 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:31.513561 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1fdba287-365d-44d0-b667-3bf8b12fb348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:31.514446 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739b18c-7b20-4ace-9bbb-642da296ae13 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:31.536338 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ecb50a-e183-440c-a17d-037d3d1170bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:31.537224 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecb50a-e183-440c-a17d-037d3d1170bf admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:31.538880 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecb50a-e183-440c-a17d-037d3d1170bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:31.539818 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecb50a-e183-440c-a17d-037d3d1170bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:31.541344 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ecb50a-e183-440c-a17d-037d3d1170bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:31.544098 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ecb50a-e183-440c-a17d-037d3d1170bf admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:31.558196 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 797/1604] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:31.560368 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f7b2f-0be4-408a-8d8b-0303d0fc73d6 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:31.560868 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f7b2f-0be4-408a-8d8b-0303d0fc73d6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:31.561325 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f7b2f-0be4-408a-8d8b-0303d0fc73d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:31.578032 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:31.588351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-da1f7b2f-0be4-408a-8d8b-0303d0fc73d6 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:31.590225 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-da1f7b2f-0be4-408a-8d8b-0303d0fc73d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:31.592084 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdba287-365d-44d0-b667-3bf8b12fb348 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:31.598211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445915a2-cc01-4c04-8c0d-02b7d7c31faa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:31.599241 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445915a2-cc01-4c04-8c0d-02b7d7c31faa service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:31.599701 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445915a2-cc01-4c04-8c0d-02b7d7c31faa service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:31.600057 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445915a2-cc01-4c04-8c0d-02b7d7c31faa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:31.600877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 798/1605] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:31.606099 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f7b2f-0be4-408a-8d8b-0303d0fc73d6 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:31.615537 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445915a2-cc01-4c04-8c0d-02b7d7c31faa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:31.617304 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f7b2f-0be4-408a-8d8b-0303d0fc73d6 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:31.617486 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445915a2-cc01-4c04-8c0d-02b7d7c31faa service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:31.625952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc097b5c-74fd-4299-8130-08899e79554e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:31.626622 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc097b5c-74fd-4299-8130-08899e79554e admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:31.627077 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc097b5c-74fd-4299-8130-08899e79554e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:31.627356 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc097b5c-74fd-4299-8130-08899e79554e admin admin] PATH_INFO: `/v3/projects/20dfd9c2e82c4626b9c36834edcebbe1/users/9840901248ac4678ac746b3ff57716d4/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:31.631236 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 808/1606] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:26:31.634974 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458965b9-a380-4f1c-a499-c4dfd8c5a831 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:31.635573 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458965b9-a380-4f1c-a499-c4dfd8c5a831 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:31.636056 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458965b9-a380-4f1c-a499-c4dfd8c5a831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:31.645623 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc097b5c-74fd-4299-8130-08899e79554e admin admin] RBAC: Authorizing `identity:create_grant(project_id=20dfd9c2e82c4626b9c36834edcebbe1, user_id=9840901248ac4678ac746b3ff57716d4, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:31.648367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc097b5c-74fd-4299-8130-08899e79554e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:31.663467 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 799/1607] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:26:31 2022] PUT /identity/v3/projects/20dfd9c2e82c4626b9c36834edcebbe1/users/9840901248ac4678ac746b3ff57716d4/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:31.664357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc097b5c-74fd-4299-8130-08899e79554e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:31.703342 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-458965b9-a380-4f1c-a499-c4dfd8c5a831 None None] MFA Rules not processed for user `8b7fa3c4c5d94b3c9b7f17dde35d39a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:31.704790 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-458965b9-a380-4f1c-a499-c4dfd8c5a831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:31.770643 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc097b5c-74fd-4299-8130-08899e79554e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:31.776511 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b2bd1-9168-4d42-91c9-05de782636ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:31.777497 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b2bd1-9168-4d42-91c9-05de782636ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:31.777497 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b2bd1-9168-4d42-91c9-05de782636ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:31.777742 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b2bd1-9168-4d42-91c9-05de782636ee admin admin] PATH_INFO: `/v3/projects/291913f110aa4bb1a67e7210619b4e2f/users/b116b852bd5b4e5688d65b5bf7a037e0/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:31.791550 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:31.794827 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b2bd1-9168-4d42-91c9-05de782636ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=291913f110aa4bb1a67e7210619b4e2f, user_id=b116b852bd5b4e5688d65b5bf7a037e0, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:31.797679 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b2bd1-9168-4d42-91c9-05de782636ee admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:31.821015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 800/1608] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:26:31 2022] PUT /identity/v3/projects/291913f110aa4bb1a67e7210619b4e2f/users/b116b852bd5b4e5688d65b5bf7a037e0/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:31.825616 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b2bd1-9168-4d42-91c9-05de782636ee admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:31.850184 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 809/1609] 10.222.0.94 () {58 vars in 1059 bytes} [Thu Sep 1 17:26:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:31.850538 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458965b9-a380-4f1c-a499-c4dfd8c5a831 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:31.865225 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458965b9-a380-4f1c-a499-c4dfd8c5a831 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:31.929166 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b2bd1-9168-4d42-91c9-05de782636ee admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:31.936526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7397fd-9611-46a1-a436-542121118dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:31.937609 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7397fd-9611-46a1-a436-542121118dd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:31.937964 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7397fd-9611-46a1-a436-542121118dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:31.938331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7397fd-9611-46a1-a436-542121118dd6 admin admin] PATH_INFO: `/v3/projects/0fecac33adfb42c8b8bd850e9ba07f63/users/754c17cea670481bb43938aaf2e8d7d2/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:31.957665 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7397fd-9611-46a1-a436-542121118dd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fecac33adfb42c8b8bd850e9ba07f63, user_id=754c17cea670481bb43938aaf2e8d7d2, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:31.962697 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7397fd-9611-46a1-a436-542121118dd6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:31.964545 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ed6df-6d6c-4f36-9ce9-d10c6d3a9e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:31.965291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ed6df-6d6c-4f36-9ce9-d10c6d3a9e6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:31.965960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ed6df-6d6c-4f36-9ce9-d10c6d3a9e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:31.966333 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ed6df-6d6c-4f36-9ce9-d10c6d3a9e6c admin admin] PATH_INFO: `/v3/projects/b24a45fe16a64191a07dc27b67e336a8/users/933d1ebb00cd407ba39ed91d887a5254/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:31.984897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 801/1610] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:26:31 2022] PUT /identity/v3/projects/0fecac33adfb42c8b8bd850e9ba07f63/users/754c17cea670481bb43938aaf2e8d7d2/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:31.986116 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7397fd-9611-46a1-a436-542121118dd6 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:31.989099 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ed6df-6d6c-4f36-9ce9-d10c6d3a9e6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b24a45fe16a64191a07dc27b67e336a8, user_id=933d1ebb00cd407ba39ed91d887a5254, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:31.992619 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ed6df-6d6c-4f36-9ce9-d10c6d3a9e6c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:32.014553 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 810/1611] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:26:31 2022] PUT /identity/v3/projects/b24a45fe16a64191a07dc27b67e336a8/users/933d1ebb00cd407ba39ed91d887a5254/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:32.017449 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4dc36-43c1-4419-9f20-862190cbf0bb None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:32.018248 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4dc36-43c1-4419-9f20-862190cbf0bb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:32.018540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4dc36-43c1-4419-9f20-862190cbf0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:32.067747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7397fd-9611-46a1-a436-542121118dd6 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:32.075128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f0c4dc36-43c1-4419-9f20-862190cbf0bb None None] MFA Rules not processed for user `9840901248ac4678ac746b3ff57716d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:32.078191 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f0c4dc36-43c1-4419-9f20-862190cbf0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:32.138600 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981bc3f5-3911-4d60-bc9f-c0ac98b62824 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:32.139267 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bc3f5-3911-4d60-bc9f-c0ac98b62824 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:32.139544 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bc3f5-3911-4d60-bc9f-c0ac98b62824 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:32.139712 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:32.139857 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bc3f5-3911-4d60-bc9f-c0ac98b62824 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:32.178873 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 811/1612] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:32.179943 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e544ec-dd80-4d44-a479-487433d6799d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:32.180232 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e544ec-dd80-4d44-a479-487433d6799d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:32.180553 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e544ec-dd80-4d44-a479-487433d6799d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:32.189072 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:32.213442 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981bc3f5-3911-4d60-bc9f-c0ac98b62824 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:32.214929 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981bc3f5-3911-4d60-bc9f-c0ac98b62824 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:32.217321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-15e544ec-dd80-4d44-a479-487433d6799d None None] MFA Rules not processed for user `b116b852bd5b4e5688d65b5bf7a037e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:32.218603 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-15e544ec-dd80-4d44-a479-487433d6799d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:32.227767 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 802/1613] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:26:32.229239 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981bc3f5-3911-4d60-bc9f-c0ac98b62824 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:32.326856 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 812/1614] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:32.328954 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e65f1-6250-487f-9489-0a66faf2d90f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:32.329338 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e65f1-6250-487f-9489-0a66faf2d90f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:32.330159 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e65f1-6250-487f-9489-0a66faf2d90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:32.346811 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981bc3f5-3911-4d60-bc9f-c0ac98b62824 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:32.355544 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34996dd-068c-4ba1-b334-4f32f63b9055 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:32.356180 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34996dd-068c-4ba1-b334-4f32f63b9055 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:32.356456 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34996dd-068c-4ba1-b334-4f32f63b9055 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:32.356725 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34996dd-068c-4ba1-b334-4f32f63b9055 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:32.359686 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c09e65f1-6250-487f-9489-0a66faf2d90f None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:32.364168 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c09e65f1-6250-487f-9489-0a66faf2d90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:32.383074 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 813/1615] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:32.384676 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53bc438-4136-4b8c-b795-176b088f5c33 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:32.384965 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53bc438-4136-4b8c-b795-176b088f5c33 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:32.385421 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53bc438-4136-4b8c-b795-176b088f5c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:32.415381 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a53bc438-4136-4b8c-b795-176b088f5c33 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:32.416933 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a53bc438-4136-4b8c-b795-176b088f5c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:32.433763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 814/1616] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:32.433763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53bc438-4136-4b8c-b795-176b088f5c33 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:32.449763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53bc438-4136-4b8c-b795-176b088f5c33 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:32.456485 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfeb428-b807-4d88-822a-3e8609767752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:32.457833 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfeb428-b807-4d88-822a-3e8609767752 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:32.457833 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfeb428-b807-4d88-822a-3e8609767752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:32.458011 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfeb428-b807-4d88-822a-3e8609767752 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:32.458832 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfeb428-b807-4d88-822a-3e8609767752 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:32.461262 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfeb428-b807-4d88-822a-3e8609767752 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:32.472850 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34996dd-068c-4ba1-b334-4f32f63b9055 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:32.479382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34996dd-068c-4ba1-b334-4f32f63b9055 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:32.506364 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 803/1617] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:26:32.507480 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34996dd-068c-4ba1-b334-4f32f63b9055 service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:32.518697 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 815/1618] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:26:32 2022] POST /identity/v3/projects => generated 367 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:32.519637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfeb428-b807-4d88-822a-3e8609767752 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:32.523373 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34996dd-068c-4ba1-b334-4f32f63b9055 service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:32.661226 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a555646-e272-4e2a-b069-5e948050f884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:32.661611 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a555646-e272-4e2a-b069-5e948050f884 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:32.661892 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a555646-e272-4e2a-b069-5e948050f884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:32.662162 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a555646-e272-4e2a-b069-5e948050f884 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:32.667805 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a555646-e272-4e2a-b069-5e948050f884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:32.673118 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfeb428-b807-4d88-822a-3e8609767752 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:32.673718 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a555646-e272-4e2a-b069-5e948050f884 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:32.683105 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4f603-830d-4ab9-bad9-99b1124652d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:32.684881 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4f603-830d-4ab9-bad9-99b1124652d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:32.685170 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4f603-830d-4ab9-bad9-99b1124652d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:32.688226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4f603-830d-4ab9-bad9-99b1124652d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:32.709871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4f603-830d-4ab9-bad9-99b1124652d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:32.712136 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4f603-830d-4ab9-bad9-99b1124652d2 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:32.733569 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 804/1619] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:26:32 2022] POST /identity/v3/projects => generated 363 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:32.736265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a555646-e272-4e2a-b069-5e948050f884 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:32.737842 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 816/1620] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:26:32.738472 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4f603-830d-4ab9-bad9-99b1124652d2 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:32.763005 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:32.767681 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4f603-830d-4ab9-bad9-99b1124652d2 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:32.839537 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:32.881316 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e7cc9-a381-4083-998e-40db7aef5c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:32.882461 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e7cc9-a381-4083-998e-40db7aef5c5b admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:32.883165 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e7cc9-a381-4083-998e-40db7aef5c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:32.883756 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e7cc9-a381-4083-998e-40db7aef5c5b admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:32.884833 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e7cc9-a381-4083-998e-40db7aef5c5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:32.887728 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e7cc9-a381-4083-998e-40db7aef5c5b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:32.892279 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a555646-e272-4e2a-b069-5e948050f884 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:32.908884 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e9b2a-d787-4d46-888a-20ae279a543a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:32.909629 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e9b2a-d787-4d46-888a-20ae279a543a service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:32.909915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e9b2a-d787-4d46-888a-20ae279a543a service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:32.910221 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e9b2a-d787-4d46-888a-20ae279a543a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:32.934318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e9b2a-d787-4d46-888a-20ae279a543a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:32.940144 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e9b2a-d787-4d46-888a-20ae279a543a service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:32.947478 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 817/1621] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:26:32 2022] POST /identity/v3/users => generated 290 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:32.952726 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e7cc9-a381-4083-998e-40db7aef5c5b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:32.987617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 805/1622] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:26:32.990789 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e7cc9-a381-4083-998e-40db7aef5c5b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:32.994887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135fd01-b90a-4468-a2b7-41f80713637c None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:32.995283 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135fd01-b90a-4468-a2b7-41f80713637c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:32.996973 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135fd01-b90a-4468-a2b7-41f80713637c None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:33.017861 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813f4b8-a303-414b-881c-9d9fce3349a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:33.018580 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813f4b8-a303-414b-881c-9d9fce3349a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:33.018872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813f4b8-a303-414b-881c-9d9fce3349a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:33.018983 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 806/1623] 10.222.0.94 () {54 vars in 912 bytes} [Thu Sep 1 17:26:32 2022] GET /identity => generated 270 bytes in 30 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:26:33.019126 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813f4b8-a303-414b-881c-9d9fce3349a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:33.019771 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813f4b8-a303-414b-881c-9d9fce3349a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:33.021765 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813f4b8-a303-414b-881c-9d9fce3349a3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:33.030559 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135fd01-b90a-4468-a2b7-41f80713637c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:33.055181 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135fd01-b90a-4468-a2b7-41f80713637c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:33.064760 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb99f5-267a-4931-80b7-6c74e6f3447b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:33.066079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb99f5-267a-4931-80b7-6c74e6f3447b admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:33.066567 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb99f5-267a-4931-80b7-6c74e6f3447b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:33.066936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb99f5-267a-4931-80b7-6c74e6f3447b admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:33.067719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb99f5-267a-4931-80b7-6c74e6f3447b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:33.069940 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb99f5-267a-4931-80b7-6c74e6f3447b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:33.070687 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 818/1624] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:26:32 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:33.072953 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d32aed-3370-4e5c-a8f5-bc6cac1bd7d8 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:33.072953 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d32aed-3370-4e5c-a8f5-bc6cac1bd7d8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:33.073210 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d32aed-3370-4e5c-a8f5-bc6cac1bd7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:33.086445 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 807/1625] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:33.091289 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb99f5-267a-4931-80b7-6c74e6f3447b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:33.102583 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb99f5-267a-4931-80b7-6c74e6f3447b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:33.111102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933ea48-5377-4b65-9571-0b781a0fba89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:33.111781 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933ea48-5377-4b65-9571-0b781a0fba89 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:33.112068 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933ea48-5377-4b65-9571-0b781a0fba89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:33.112345 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933ea48-5377-4b65-9571-0b781a0fba89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:33.113002 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933ea48-5377-4b65-9571-0b781a0fba89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:33.115140 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933ea48-5377-4b65-9571-0b781a0fba89 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:33.122578 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-41d32aed-3370-4e5c-a8f5-bc6cac1bd7d8 None None] MFA Rules not processed for user `8b7fa3c4c5d94b3c9b7f17dde35d39a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:33.123857 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-41d32aed-3370-4e5c-a8f5-bc6cac1bd7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:33.135636 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 808/1626] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:33.144298 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933ea48-5377-4b65-9571-0b781a0fba89 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:33.158568 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933ea48-5377-4b65-9571-0b781a0fba89 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:33.166714 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a495f5-aa86-4663-bee9-e6782031ffb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:33.167542 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a495f5-aa86-4663-bee9-e6782031ffb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:33.167828 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a495f5-aa86-4663-bee9-e6782031ffb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:33.168133 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a495f5-aa86-4663-bee9-e6782031ffb1 admin admin] PATH_INFO: `/v3/projects/e7784eed0e844f3fb77e7f3edefd3d50/users/b8aebf48d158496f9a32c750f6048c8e/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:33.189999 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a495f5-aa86-4663-bee9-e6782031ffb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7784eed0e844f3fb77e7f3edefd3d50, user_id=b8aebf48d158496f9a32c750f6048c8e, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:33.194604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a495f5-aa86-4663-bee9-e6782031ffb1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:33.236832 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 809/1627] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:26:33 2022] PUT /identity/v3/projects/e7784eed0e844f3fb77e7f3edefd3d50/users/b8aebf48d158496f9a32c750f6048c8e/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:33.239299 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a495f5-aa86-4663-bee9-e6782031ffb1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:33.306186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 819/1628] 10.222.0.94 () {58 vars in 1009 bytes} [Thu Sep 1 17:26:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:33.308966 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d32aed-3370-4e5c-a8f5-bc6cac1bd7d8 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:33.334325 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d32aed-3370-4e5c-a8f5-bc6cac1bd7d8 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:33.407913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a495f5-aa86-4663-bee9-e6782031ffb1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:33.416363 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141e1fb-b43f-4d25-aa31-edb54bf46bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:33.417812 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141e1fb-b43f-4d25-aa31-edb54bf46bcd admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:33.418306 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141e1fb-b43f-4d25-aa31-edb54bf46bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:33.418634 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141e1fb-b43f-4d25-aa31-edb54bf46bcd admin admin] PATH_INFO: `/v3/projects/c8962c31030e4e8681a90cb73f49f8c6/users/e038be19c2134004bc419b7af1f9f6d9/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:33.439869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141e1fb-b43f-4d25-aa31-edb54bf46bcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8962c31030e4e8681a90cb73f49f8c6, user_id=e038be19c2134004bc419b7af1f9f6d9, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:33.443376 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141e1fb-b43f-4d25-aa31-edb54bf46bcd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:33.466985 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 810/1629] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:26:33 2022] PUT /identity/v3/projects/c8962c31030e4e8681a90cb73f49f8c6/users/e038be19c2134004bc419b7af1f9f6d9/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:33.468082 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef86347-fc14-48e8-b5c9-89889a550abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:33.468952 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef86347-fc14-48e8-b5c9-89889a550abe admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:33.469432 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef86347-fc14-48e8-b5c9-89889a550abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:33.469946 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef86347-fc14-48e8-b5c9-89889a550abe admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:33.470771 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef86347-fc14-48e8-b5c9-89889a550abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:33.472617 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef86347-fc14-48e8-b5c9-89889a550abe admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:33.473483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96665a2-f406-4bbd-aa9c-ed6c153dc1aa None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:33.473774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96665a2-f406-4bbd-aa9c-ed6c153dc1aa None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:33.474046 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96665a2-f406-4bbd-aa9c-ed6c153dc1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:33.486235 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 820/1630] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:33.487904 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef86347-fc14-48e8-b5c9-89889a550abe admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:33.540864 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:33.553160 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b96665a2-f406-4bbd-aa9c-ed6c153dc1aa None None] MFA Rules not processed for user `e75a67f37877499ab6545ecac5b1acf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:33.554433 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b96665a2-f406-4bbd-aa9c-ed6c153dc1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:33.594895 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef86347-fc14-48e8-b5c9-89889a550abe admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:33.643843 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:33.706316 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd059616-955c-4968-987d-9650b4c10a99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:33.706929 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd059616-955c-4968-987d-9650b4c10a99 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:33.707203 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd059616-955c-4968-987d-9650b4c10a99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:33.707507 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd059616-955c-4968-987d-9650b4c10a99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:33.717056 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 811/1631] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:33 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:33.717967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96665a2-f406-4bbd-aa9c-ed6c153dc1aa None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:33.843167 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd059616-955c-4968-987d-9650b4c10a99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:33.845959 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd059616-955c-4968-987d-9650b4c10a99 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:33.849293 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96665a2-f406-4bbd-aa9c-ed6c153dc1aa None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:33.855182 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3fed4-456f-41e8-9739-9dad9c077471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:33.855811 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3fed4-456f-41e8-9739-9dad9c077471 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:33.856092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3fed4-456f-41e8-9739-9dad9c077471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:33.856439 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3fed4-456f-41e8-9739-9dad9c077471 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:33.857014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3fed4-456f-41e8-9739-9dad9c077471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:33.858524 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 821/1632] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:26:33.858726 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3fed4-456f-41e8-9739-9dad9c077471 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:33.859356 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd059616-955c-4968-987d-9650b4c10a99 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:33.875389 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 812/1633] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:33.876635 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3fed4-456f-41e8-9739-9dad9c077471 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:33.887537 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd059616-955c-4968-987d-9650b4c10a99 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:33.891879 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3fed4-456f-41e8-9739-9dad9c077471 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:33.898336 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fac1b7-35f8-4846-a3e5-3b33f2de9419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:33.899265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fac1b7-35f8-4846-a3e5-3b33f2de9419 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:33.900135 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fac1b7-35f8-4846-a3e5-3b33f2de9419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:33.900529 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fac1b7-35f8-4846-a3e5-3b33f2de9419 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:33.901247 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fac1b7-35f8-4846-a3e5-3b33f2de9419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:33.901461 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd795b87-913e-4d81-aa08-445f30f8cc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:33.902313 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd795b87-913e-4d81-aa08-445f30f8cc90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:33.902896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd795b87-913e-4d81-aa08-445f30f8cc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:33.903740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fac1b7-35f8-4846-a3e5-3b33f2de9419 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:33.904179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd795b87-913e-4d81-aa08-445f30f8cc90 admin admin] PATH_INFO: `/v3/projects/e7784eed0e844f3fb77e7f3edefd3d50/users/b8aebf48d158496f9a32c750f6048c8e/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:33.913034 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd795b87-913e-4d81-aa08-445f30f8cc90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7784eed0e844f3fb77e7f3edefd3d50, user_id=b8aebf48d158496f9a32c750f6048c8e, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:33.916035 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd795b87-913e-4d81-aa08-445f30f8cc90 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:33.934937 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 813/1634] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:26:33 2022] POST /identity/v3/projects => generated 405 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:33.939222 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fac1b7-35f8-4846-a3e5-3b33f2de9419 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:33.940154 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 822/1635] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:26:33 2022] PUT /identity/v3/projects/e7784eed0e844f3fb77e7f3edefd3d50/users/b8aebf48d158496f9a32c750f6048c8e/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:33.941530 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd795b87-913e-4d81-aa08-445f30f8cc90 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:34.019882 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd795b87-913e-4d81-aa08-445f30f8cc90 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:34.042895 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:34.090811 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fac1b7-35f8-4846-a3e5-3b33f2de9419 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:34.096500 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764af4b7-05cb-4a6c-b95d-6c6905f04202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:34.097524 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764af4b7-05cb-4a6c-b95d-6c6905f04202 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:34.098114 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764af4b7-05cb-4a6c-b95d-6c6905f04202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:34.098596 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764af4b7-05cb-4a6c-b95d-6c6905f04202 admin admin] PATH_INFO: `/v3/projects/c8962c31030e4e8681a90cb73f49f8c6/users/e038be19c2134004bc419b7af1f9f6d9/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:34.100927 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764af4b7-05cb-4a6c-b95d-6c6905f04202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8962c31030e4e8681a90cb73f49f8c6, user_id=e038be19c2134004bc419b7af1f9f6d9, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:34.104654 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764af4b7-05cb-4a6c-b95d-6c6905f04202 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:34.121237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735ea18-9fd4-4321-a77d-c19cd3109561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:34.123538 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735ea18-9fd4-4321-a77d-c19cd3109561 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:34.124305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735ea18-9fd4-4321-a77d-c19cd3109561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:34.125451 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735ea18-9fd4-4321-a77d-c19cd3109561 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:34.126300 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735ea18-9fd4-4321-a77d-c19cd3109561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:34.130662 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735ea18-9fd4-4321-a77d-c19cd3109561 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:34.131174 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 814/1636] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:26:33 2022] PUT /identity/v3/projects/c8962c31030e4e8681a90cb73f49f8c6/users/e038be19c2134004bc419b7af1f9f6d9/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:34.132730 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf91c81-8d24-4320-aafa-0ffd33c3ab37 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:34.137070 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf91c81-8d24-4320-aafa-0ffd33c3ab37 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:34.137616 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf91c81-8d24-4320-aafa-0ffd33c3ab37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:34.185142 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 823/1637] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:26:33 2022] POST /identity/v3/users => generated 309 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:34.185142 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4302cb8-a104-415d-b637-53d773a04e25 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:34.185142 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4302cb8-a104-415d-b637-53d773a04e25 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:34.185142 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4302cb8-a104-415d-b637-53d773a04e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:34.207027 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-abf91c81-8d24-4320-aafa-0ffd33c3ab37 None None] MFA Rules not processed for user `b8aebf48d158496f9a32c750f6048c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:34.209525 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-abf91c81-8d24-4320-aafa-0ffd33c3ab37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:34.239323 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b4302cb8-a104-415d-b637-53d773a04e25 None None] MFA Rules not processed for user `e038be19c2134004bc419b7af1f9f6d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:34.240670 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b4302cb8-a104-415d-b637-53d773a04e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:34.270522 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:34.331550 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 815/1638] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:34.334603 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf91c81-8d24-4320-aafa-0ffd33c3ab37 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:34.417129 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 824/1639] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:34.417129 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4302cb8-a104-415d-b637-53d773a04e25 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:34.491483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf91c81-8d24-4320-aafa-0ffd33c3ab37 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:34.497917 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94641e7d-7ecf-401c-9035-b973dffcaee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:34.497917 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94641e7d-7ecf-401c-9035-b973dffcaee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:34.498216 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94641e7d-7ecf-401c-9035-b973dffcaee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:34.498384 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94641e7d-7ecf-401c-9035-b973dffcaee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:34.499043 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94641e7d-7ecf-401c-9035-b973dffcaee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:34.501225 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94641e7d-7ecf-401c-9035-b973dffcaee9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:34.526001 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 816/1640] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:34.526979 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94641e7d-7ecf-401c-9035-b973dffcaee9 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:34.560539 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4302cb8-a104-415d-b637-53d773a04e25 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:34.562147 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94641e7d-7ecf-401c-9035-b973dffcaee9 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:34.564766 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb15f3-a879-49ce-8020-01b11b885220 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:34.565826 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb15f3-a879-49ce-8020-01b11b885220 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:34.566659 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb15f3-a879-49ce-8020-01b11b885220 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:34.566940 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb15f3-a879-49ce-8020-01b11b885220 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:34.573532 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d55a97-4f68-48c4-98e4-28414f69e125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:34.574215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d55a97-4f68-48c4-98e4-28414f69e125 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:34.574494 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d55a97-4f68-48c4-98e4-28414f69e125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:34.576793 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d55a97-4f68-48c4-98e4-28414f69e125 admin admin] PATH_INFO: `/v3/projects/3759f9781fb34b528852ab29a44569f1/users/d90ac122f98144e780e6eaaaf812366e/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:34.587583 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb15f3-a879-49ce-8020-01b11b885220 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:34.592305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb15f3-a879-49ce-8020-01b11b885220 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:34.629333 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 825/1641] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:26:34.629569 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d55a97-4f68-48c4-98e4-28414f69e125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3759f9781fb34b528852ab29a44569f1, user_id=d90ac122f98144e780e6eaaaf812366e, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:34.632334 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d55a97-4f68-48c4-98e4-28414f69e125 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:34.666998 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 817/1642] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:26:34 2022] PUT /identity/v3/projects/3759f9781fb34b528852ab29a44569f1/users/d90ac122f98144e780e6eaaaf812366e/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:34.674838 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb15f3-a879-49ce-8020-01b11b885220 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:34.709438 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb15f3-a879-49ce-8020-01b11b885220 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:34.711385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d55a97-4f68-48c4-98e4-28414f69e125 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:34.850292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:34.874861 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d55a97-4f68-48c4-98e4-28414f69e125 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:34.887086 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d152733-977d-4c17-9053-33a96ae351c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:34.887734 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d152733-977d-4c17-9053-33a96ae351c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:34.888019 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d152733-977d-4c17-9053-33a96ae351c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:34.888293 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d152733-977d-4c17-9053-33a96ae351c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:34.912703 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd008b-a5e8-42fa-8f18-b378db897285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:34.913333 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd008b-a5e8-42fa-8f18-b378db897285 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:34.913667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd008b-a5e8-42fa-8f18-b378db897285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:34.913939 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd008b-a5e8-42fa-8f18-b378db897285 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:34.914591 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd008b-a5e8-42fa-8f18-b378db897285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:34.917111 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd008b-a5e8-42fa-8f18-b378db897285 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:34.954802 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 826/1643] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:34.961380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd008b-a5e8-42fa-8f18-b378db897285 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:34.995377 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd008b-a5e8-42fa-8f18-b378db897285 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:35.023912 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:35.025880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560525a-2c5e-4608-b939-e35aefe23753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:35.027593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560525a-2c5e-4608-b939-e35aefe23753 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:35.032800 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560525a-2c5e-4608-b939-e35aefe23753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:35.033231 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560525a-2c5e-4608-b939-e35aefe23753 admin admin] PATH_INFO: `/v3/projects/3759f9781fb34b528852ab29a44569f1/users/d90ac122f98144e780e6eaaaf812366e/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:35.038718 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560525a-2c5e-4608-b939-e35aefe23753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3759f9781fb34b528852ab29a44569f1, user_id=d90ac122f98144e780e6eaaaf812366e, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:35.050872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560525a-2c5e-4608-b939-e35aefe23753 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:35.054886 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d152733-977d-4c17-9053-33a96ae351c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:35.060290 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d152733-977d-4c17-9053-33a96ae351c1 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:35.076440 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 827/1644] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:26:34 2022] PUT /identity/v3/projects/3759f9781fb34b528852ab29a44569f1/users/d90ac122f98144e780e6eaaaf812366e/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:35.080059 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560525a-2c5e-4608-b939-e35aefe23753 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:35.091053 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 818/1645] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:34 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:26:35.203449 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560525a-2c5e-4608-b939-e35aefe23753 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:35.214560 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14797d57-53c6-4c95-9a06-0156a5a6e14f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:35.216044 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14797d57-53c6-4c95-9a06-0156a5a6e14f service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:35.217486 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14797d57-53c6-4c95-9a06-0156a5a6e14f service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:35.217806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14797d57-53c6-4c95-9a06-0156a5a6e14f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:35.344236 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14797d57-53c6-4c95-9a06-0156a5a6e14f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:35.345913 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14797d57-53c6-4c95-9a06-0156a5a6e14f service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:35.374041 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 828/1646] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:26:35.693439 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c80f16-935c-4d6c-a486-7b79c4d67bc2 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:35.694130 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c80f16-935c-4d6c-a486-7b79c4d67bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:35.694288 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c80f16-935c-4d6c-a486-7b79c4d67bc2 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:35.698760 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 819/1647] 10.222.0.94 () {54 vars in 962 bytes} [Thu Sep 1 17:26:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:26:35.709377 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd1836-cae9-40a6-9bad-1abc8329aef5 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:35.710739 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd1836-cae9-40a6-9bad-1abc8329aef5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:35.711335 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd1836-cae9-40a6-9bad-1abc8329aef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:35.752629 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-80fd1836-cae9-40a6-9bad-1abc8329aef5 None None] MFA Rules not processed for user `8b7fa3c4c5d94b3c9b7f17dde35d39a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:35.754604 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-80fd1836-cae9-40a6-9bad-1abc8329aef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:35.904761 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 829/1648] 10.222.0.94 () {58 vars in 1059 bytes} [Thu Sep 1 17:26:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:35.909228 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b429af-332c-430f-8b79-d73125935abd None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:35.909680 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b429af-332c-430f-8b79-d73125935abd None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:35.910079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b429af-332c-430f-8b79-d73125935abd None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:35.911649 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 820/1649] 10.222.0.94 () {54 vars in 912 bytes} [Thu Sep 1 17:26:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:26:35.917493 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75214b22-3307-4fc9-a77e-b6689fdf99d4 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:35.917711 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75214b22-3307-4fc9-a77e-b6689fdf99d4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:35.917889 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75214b22-3307-4fc9-a77e-b6689fdf99d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:35.954792 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b429af-332c-430f-8b79-d73125935abd None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:35.976821 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-75214b22-3307-4fc9-a77e-b6689fdf99d4 None None] MFA Rules not processed for user `8b7fa3c4c5d94b3c9b7f17dde35d39a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:35.981550 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-75214b22-3307-4fc9-a77e-b6689fdf99d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:36.007574 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 830/1650] 10.222.0.94 () {58 vars in 1009 bytes} [Thu Sep 1 17:26:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:36.025373 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75214b22-3307-4fc9-a77e-b6689fdf99d4 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:36.045689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:36.058947 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75214b22-3307-4fc9-a77e-b6689fdf99d4 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:36.072815 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3cbec-9f21-4522-bd72-a7a88b7a32f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:36.075130 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3cbec-9f21-4522-bd72-a7a88b7a32f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:36.075461 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3cbec-9f21-4522-bd72-a7a88b7a32f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:36.075732 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3cbec-9f21-4522-bd72-a7a88b7a32f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:36.103888 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3cbec-9f21-4522-bd72-a7a88b7a32f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:36.104450 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b429af-332c-430f-8b79-d73125935abd None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:36.105352 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3cbec-9f21-4522-bd72-a7a88b7a32f1 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:36.114346 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cf83a-8565-4411-93ca-415b9a21713c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:36.115237 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cf83a-8565-4411-93ca-415b9a21713c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:36.115586 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cf83a-8565-4411-93ca-415b9a21713c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:36.115947 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cf83a-8565-4411-93ca-415b9a21713c admin admin] PATH_INFO: `/v3/users/b116b852bd5b4e5688d65b5bf7a037e0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:36.119860 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922cf83a-8565-4411-93ca-415b9a21713c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b116b852bd5b4e5688d65b5bf7a037e0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:36.122305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: WARNING py.warnings [None req-922cf83a-8565-4411-93ca-415b9a21713c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 17:26:36.122305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: warnings.warn(msg) Sep 01 17:26:36.122305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: Sep 01 17:26:36.129360 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922cf83a-8565-4411-93ca-415b9a21713c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:36.138251 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 831/1651] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:26:36.379676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-922cf83a-8565-4411-93ca-415b9a21713c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b116b852bd5b4e5688d65b5bf7a037e0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:36.379676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-922cf83a-8565-4411-93ca-415b9a21713c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b116b852bd5b4e5688d65b5bf7a037e0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:36.379676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-922cf83a-8565-4411-93ca-415b9a21713c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b116b852bd5b4e5688d65b5bf7a037e0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:36.379676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-922cf83a-8565-4411-93ca-415b9a21713c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b116b852bd5b4e5688d65b5bf7a037e0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:36.421311 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-922cf83a-8565-4411-93ca-415b9a21713c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b116b852bd5b4e5688d65b5bf7a037e0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:36.475904 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 821/1652] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:26:35 2022] DELETE /identity/v3/users/b116b852bd5b4e5688d65b5bf7a037e0 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:26:36.480858 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76807b-cca0-4c0a-aa68-0b2728a119f7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:36.481439 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76807b-cca0-4c0a-aa68-0b2728a119f7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:36.482006 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76807b-cca0-4c0a-aa68-0b2728a119f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:36.510194 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8b76807b-cca0-4c0a-aa68-0b2728a119f7 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:36.511604 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8b76807b-cca0-4c0a-aa68-0b2728a119f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:36.612575 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 832/1653] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:36.641705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cf83a-8565-4411-93ca-415b9a21713c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:36.643915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-922cf83a-8565-4411-93ca-415b9a21713c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:36.739042 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cf83a-8565-4411-93ca-415b9a21713c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:36.746030 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713dbc55-d774-4799-b190-2bdf4fb695bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:36.748436 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dbc55-d774-4799-b190-2bdf4fb695bc service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:36.749225 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dbc55-d774-4799-b190-2bdf4fb695bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:36.749840 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dbc55-d774-4799-b190-2bdf4fb695bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:36.764411 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713dbc55-d774-4799-b190-2bdf4fb695bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:36.766632 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713dbc55-d774-4799-b190-2bdf4fb695bc service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:36.782160 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 822/1654] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:26:37.998120 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76807b-cca0-4c0a-aa68-0b2728a119f7 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:37.998988 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8b76807b-cca0-4c0a-aa68-0b2728a119f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:38.012874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76807b-cca0-4c0a-aa68-0b2728a119f7 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:38.030556 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf31b59-e54e-4644-b36c-79ca211d40a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:38.031397 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf31b59-e54e-4644-b36c-79ca211d40a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:38.031800 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf31b59-e54e-4644-b36c-79ca211d40a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:38.032149 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf31b59-e54e-4644-b36c-79ca211d40a6 admin admin] PATH_INFO: `/v3/users/9488a385bb174e46ace86da0cb3920ee` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:38.033769 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf31b59-e54e-4644-b36c-79ca211d40a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9488a385bb174e46ace86da0cb3920ee)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:38.038148 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf31b59-e54e-4644-b36c-79ca211d40a6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:38.159575 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9bf31b59-e54e-4644-b36c-79ca211d40a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9488a385bb174e46ace86da0cb3920ee'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:38.160456 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9bf31b59-e54e-4644-b36c-79ca211d40a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9488a385bb174e46ace86da0cb3920ee'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:38.193912 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9bf31b59-e54e-4644-b36c-79ca211d40a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9488a385bb174e46ace86da0cb3920ee'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:38.215199 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9bf31b59-e54e-4644-b36c-79ca211d40a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9488a385bb174e46ace86da0cb3920ee'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:38.233926 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9bf31b59-e54e-4644-b36c-79ca211d40a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9488a385bb174e46ace86da0cb3920ee'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:38.248573 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 833/1655] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:26:37 2022] DELETE /identity/v3/users/9488a385bb174e46ace86da0cb3920ee => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:38.250867 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0d3b2-433b-4b88-87d2-032a26fc8b13 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:38.251815 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0d3b2-433b-4b88-87d2-032a26fc8b13 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:38.252366 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0d3b2-433b-4b88-87d2-032a26fc8b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:38.279551 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-31a0d3b2-433b-4b88-87d2-032a26fc8b13 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:38.281023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-31a0d3b2-433b-4b88-87d2-032a26fc8b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:38.285758 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:38.420704 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 823/1656] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:26:38.502188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf31b59-e54e-4644-b36c-79ca211d40a6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:38.507047 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9bf31b59-e54e-4644-b36c-79ca211d40a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:38.625573 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf31b59-e54e-4644-b36c-79ca211d40a6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:38.629655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d66a08-3a83-46fc-9be6-996017ac4cde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:38.630391 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d66a08-3a83-46fc-9be6-996017ac4cde service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:38.631278 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d66a08-3a83-46fc-9be6-996017ac4cde service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:38.631992 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d66a08-3a83-46fc-9be6-996017ac4cde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:38.646110 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d66a08-3a83-46fc-9be6-996017ac4cde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:38.647735 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d66a08-3a83-46fc-9be6-996017ac4cde service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:38.667103 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 834/1657] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:26:38.796556 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489443e9-9a03-4210-a911-a4e4495afbe8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:38.796827 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489443e9-9a03-4210-a911-a4e4495afbe8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:38.797698 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489443e9-9a03-4210-a911-a4e4495afbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:38.831758 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-489443e9-9a03-4210-a911-a4e4495afbe8 None None] MFA Rules not processed for user `d90ac122f98144e780e6eaaaf812366e`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:38.833012 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-489443e9-9a03-4210-a911-a4e4495afbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:38.921832 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 824/1658] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:38 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:39.564561 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d66a08-3a83-46fc-9be6-996017ac4cde service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:39.570410 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d3d66a08-3a83-46fc-9be6-996017ac4cde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:39.630309 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d66a08-3a83-46fc-9be6-996017ac4cde service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:39.655554 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb2615-369e-482f-b034-9b32e9274f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:39.656242 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb2615-369e-482f-b034-9b32e9274f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:39.656533 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb2615-369e-482f-b034-9b32e9274f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:39.657721 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb2615-369e-482f-b034-9b32e9274f7b admin admin] PATH_INFO: `/v3/projects/291913f110aa4bb1a67e7210619b4e2f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:39.662089 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb2615-369e-482f-b034-9b32e9274f7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=291913f110aa4bb1a67e7210619b4e2f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:39.664091 dv-cinder-852211-8-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-edcb2615-369e-482f-b034-9b32e9274f7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 17:26:39.664091 dv-cinder-852211-8-smb devstack@keystone.service[81458]: warnings.warn(msg) Sep 01 17:26:39.664091 dv-cinder-852211-8-smb devstack@keystone.service[81458]: Sep 01 17:26:39.665419 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb2615-369e-482f-b034-9b32e9274f7b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:39.669434 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:39.823366 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-edcb2615-369e-482f-b034-9b32e9274f7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '291913f110aa4bb1a67e7210619b4e2f', 'request_id': 'req-edcb2615-369e-482f-b034-9b32e9274f7b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:39.834694 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-edcb2615-369e-482f-b034-9b32e9274f7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '291913f110aa4bb1a67e7210619b4e2f', 'request_id': 'req-edcb2615-369e-482f-b034-9b32e9274f7b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:39.856243 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-edcb2615-369e-482f-b034-9b32e9274f7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '291913f110aa4bb1a67e7210619b4e2f', 'request_id': 'req-edcb2615-369e-482f-b034-9b32e9274f7b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:39.882995 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-edcb2615-369e-482f-b034-9b32e9274f7b admin admin] The token cache is being invalidate because project 291913f110aa4bb1a67e7210619b4e2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:26:39.883391 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-edcb2615-369e-482f-b034-9b32e9274f7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:39.884584 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-edcb2615-369e-482f-b034-9b32e9274f7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:39.894345 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 835/1659] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:26:39 2022] DELETE /identity/v3/projects/291913f110aa4bb1a67e7210619b4e2f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:39.895642 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489443e9-9a03-4210-a911-a4e4495afbe8 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:39.916940 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489443e9-9a03-4210-a911-a4e4495afbe8 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:40.093282 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3441f15-e815-45b4-94cc-d3f5ae0efb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:40.094670 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3441f15-e815-45b4-94cc-d3f5ae0efb74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:40.095073 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3441f15-e815-45b4-94cc-d3f5ae0efb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:40.095639 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3441f15-e815-45b4-94cc-d3f5ae0efb74 admin admin] PATH_INFO: `/v3/users/e038be19c2134004bc419b7af1f9f6d9` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:40.097544 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3441f15-e815-45b4-94cc-d3f5ae0efb74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e038be19c2134004bc419b7af1f9f6d9)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:40.105727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3441f15-e815-45b4-94cc-d3f5ae0efb74 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:40.252594 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:40.285702 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c3441f15-e815-45b4-94cc-d3f5ae0efb74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e038be19c2134004bc419b7af1f9f6d9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:40.287567 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c3441f15-e815-45b4-94cc-d3f5ae0efb74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e038be19c2134004bc419b7af1f9f6d9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:40.305384 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c3441f15-e815-45b4-94cc-d3f5ae0efb74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e038be19c2134004bc419b7af1f9f6d9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:40.306489 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c3441f15-e815-45b4-94cc-d3f5ae0efb74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e038be19c2134004bc419b7af1f9f6d9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:40.325765 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c3441f15-e815-45b4-94cc-d3f5ae0efb74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e038be19c2134004bc419b7af1f9f6d9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:40.373464 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 825/1660] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:26:39 2022] DELETE /identity/v3/users/e038be19c2134004bc419b7af1f9f6d9 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:40.969468 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb2615-369e-482f-b034-9b32e9274f7b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:40.970998 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-edcb2615-369e-482f-b034-9b32e9274f7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:41.009509 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb2615-369e-482f-b034-9b32e9274f7b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:41.127438 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7506d-016f-4d31-ac03-66a637add4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:41.128269 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7506d-016f-4d31-ac03-66a637add4e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:41.128749 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7506d-016f-4d31-ac03-66a637add4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:41.129120 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7506d-016f-4d31-ac03-66a637add4e8 admin admin] PATH_INFO: `/v3/users/9840901248ac4678ac746b3ff57716d4` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:41.130990 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7506d-016f-4d31-ac03-66a637add4e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9840901248ac4678ac746b3ff57716d4)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:41.134447 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7506d-016f-4d31-ac03-66a637add4e8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:41.266618 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d2c7506d-016f-4d31-ac03-66a637add4e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9840901248ac4678ac746b3ff57716d4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:41.267370 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d2c7506d-016f-4d31-ac03-66a637add4e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9840901248ac4678ac746b3ff57716d4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:41.285733 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d2c7506d-016f-4d31-ac03-66a637add4e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9840901248ac4678ac746b3ff57716d4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:41.295822 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d2c7506d-016f-4d31-ac03-66a637add4e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9840901248ac4678ac746b3ff57716d4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:41.312347 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d2c7506d-016f-4d31-ac03-66a637add4e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9840901248ac4678ac746b3ff57716d4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:41.322108 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 836/1661] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:26:40 2022] DELETE /identity/v3/users/9840901248ac4678ac746b3ff57716d4 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:41.327351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9075b-45b2-468a-afe8-43d73e92416c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:41.327848 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9075b-45b2-468a-afe8-43d73e92416c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:41.329023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9075b-45b2-468a-afe8-43d73e92416c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:41.383752 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-98f9075b-45b2-468a-afe8-43d73e92416c None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:41.386155 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-98f9075b-45b2-468a-afe8-43d73e92416c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:41.542584 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 826/1662] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:41.600074 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7506d-016f-4d31-ac03-66a637add4e8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:41.601991 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d2c7506d-016f-4d31-ac03-66a637add4e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:41.621911 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:41.700687 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7506d-016f-4d31-ac03-66a637add4e8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:41.704841 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a44e5-ed43-4403-b01d-9231f6117200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:41.705834 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a44e5-ed43-4403-b01d-9231f6117200 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:41.706121 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a44e5-ed43-4403-b01d-9231f6117200 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:41.706395 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a44e5-ed43-4403-b01d-9231f6117200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:41.723736 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a44e5-ed43-4403-b01d-9231f6117200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:41.725502 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a44e5-ed43-4403-b01d-9231f6117200 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:41.739446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 837/1663] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:26:41.930678 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9075b-45b2-468a-afe8-43d73e92416c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:41.932980 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-98f9075b-45b2-468a-afe8-43d73e92416c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:41.966974 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9075b-45b2-468a-afe8-43d73e92416c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:41.967266 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a44e5-ed43-4403-b01d-9231f6117200 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:41.971067 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bc8a44e5-ed43-4403-b01d-9231f6117200 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:41.984444 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69d3af-9798-44d3-b188-a79314ed2618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:41.985111 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69d3af-9798-44d3-b188-a79314ed2618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:41.985391 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69d3af-9798-44d3-b188-a79314ed2618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:41.985693 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69d3af-9798-44d3-b188-a79314ed2618 admin admin] PATH_INFO: `/v3/projects/c8962c31030e4e8681a90cb73f49f8c6` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:41.987840 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69d3af-9798-44d3-b188-a79314ed2618 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8962c31030e4e8681a90cb73f49f8c6)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:41.989833 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69d3af-9798-44d3-b188-a79314ed2618 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:41.994343 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a44e5-ed43-4403-b01d-9231f6117200 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:42.007599 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebe0e7-265d-473b-aaba-6bac65d6daf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:42.009683 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebe0e7-265d-473b-aaba-6bac65d6daf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:42.011354 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebe0e7-265d-473b-aaba-6bac65d6daf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:42.011636 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebe0e7-265d-473b-aaba-6bac65d6daf4 admin admin] PATH_INFO: `/v3/projects/267c66820db44f0cb14f8e17e00505c3` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:42.020529 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebe0e7-265d-473b-aaba-6bac65d6daf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=267c66820db44f0cb14f8e17e00505c3)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:42.025150 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebe0e7-265d-473b-aaba-6bac65d6daf4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:42.158526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3a69d3af-9798-44d3-b188-a79314ed2618 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8962c31030e4e8681a90cb73f49f8c6', 'request_id': 'req-3a69d3af-9798-44d3-b188-a79314ed2618'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:42.191306 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-86ebe0e7-265d-473b-aaba-6bac65d6daf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '267c66820db44f0cb14f8e17e00505c3', 'request_id': 'req-86ebe0e7-265d-473b-aaba-6bac65d6daf4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:42.195565 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3a69d3af-9798-44d3-b188-a79314ed2618 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8962c31030e4e8681a90cb73f49f8c6', 'request_id': 'req-3a69d3af-9798-44d3-b188-a79314ed2618'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:42.216698 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-86ebe0e7-265d-473b-aaba-6bac65d6daf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '267c66820db44f0cb14f8e17e00505c3', 'request_id': 'req-86ebe0e7-265d-473b-aaba-6bac65d6daf4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:42.219337 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3a69d3af-9798-44d3-b188-a79314ed2618 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8962c31030e4e8681a90cb73f49f8c6', 'request_id': 'req-3a69d3af-9798-44d3-b188-a79314ed2618'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:42.238580 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-86ebe0e7-265d-473b-aaba-6bac65d6daf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '267c66820db44f0cb14f8e17e00505c3', 'request_id': 'req-86ebe0e7-265d-473b-aaba-6bac65d6daf4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:42.261207 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3a69d3af-9798-44d3-b188-a79314ed2618 admin admin] The token cache is being invalidate because project c8962c31030e4e8681a90cb73f49f8c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:26:42.263411 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3a69d3af-9798-44d3-b188-a79314ed2618 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:42.264910 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3a69d3af-9798-44d3-b188-a79314ed2618 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:42.271477 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 827/1664] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:26:41 2022] DELETE /identity/v3/projects/c8962c31030e4e8681a90cb73f49f8c6 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:42.271615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-86ebe0e7-265d-473b-aaba-6bac65d6daf4 admin admin] The token cache is being invalidate because project 267c66820db44f0cb14f8e17e00505c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:26:42.271615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-86ebe0e7-265d-473b-aaba-6bac65d6daf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:42.272955 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60deaa5f-af8f-4eff-a653-0404474d066c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:42.273242 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60deaa5f-af8f-4eff-a653-0404474d066c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:42.273658 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60deaa5f-af8f-4eff-a653-0404474d066c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:42.276642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-86ebe0e7-265d-473b-aaba-6bac65d6daf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:42.278580 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 838/1665] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:26:41 2022] DELETE /identity/v3/projects/267c66820db44f0cb14f8e17e00505c3 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:42.283620 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab45bf5-7ac3-4a76-a5e9-80341dab91db None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:42.283903 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab45bf5-7ac3-4a76-a5e9-80341dab91db None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:42.284171 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab45bf5-7ac3-4a76-a5e9-80341dab91db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:42.301877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-60deaa5f-af8f-4eff-a653-0404474d066c None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:42.303484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-60deaa5f-af8f-4eff-a653-0404474d066c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:42.308764 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-cab45bf5-7ac3-4a76-a5e9-80341dab91db None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:42.310366 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cab45bf5-7ac3-4a76-a5e9-80341dab91db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:42.345005 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:42.405621 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 828/1666] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:42.407134 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b84756-df57-4e10-8aca-8c75663e1c48 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:42.407520 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b84756-df57-4e10-8aca-8c75663e1c48 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:42.408121 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b84756-df57-4e10-8aca-8c75663e1c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:42.433917 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b7b84756-df57-4e10-8aca-8c75663e1c48 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:42.435170 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b7b84756-df57-4e10-8aca-8c75663e1c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:42.447729 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 829/1667] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:42.451725 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 839/1668] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:26:42.458952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b84756-df57-4e10-8aca-8c75663e1c48 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:42.459918 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb821613-5540-4d2e-84db-8828c8b54ec7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:42.460465 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb821613-5540-4d2e-84db-8828c8b54ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:42.460993 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb821613-5540-4d2e-84db-8828c8b54ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:42.473168 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b84756-df57-4e10-8aca-8c75663e1c48 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:42.484077 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210787a4-abb6-4914-96e2-34ddb28cba66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:42.485119 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210787a4-abb6-4914-96e2-34ddb28cba66 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:42.492126 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210787a4-abb6-4914-96e2-34ddb28cba66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:42.492991 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210787a4-abb6-4914-96e2-34ddb28cba66 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:42.493923 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210787a4-abb6-4914-96e2-34ddb28cba66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:26:42.494437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210787a4-abb6-4914-96e2-34ddb28cba66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:42.496309 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210787a4-abb6-4914-96e2-34ddb28cba66 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:42.510495 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 830/1669] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:26:42.516647 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210787a4-abb6-4914-96e2-34ddb28cba66 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:42.528928 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210787a4-abb6-4914-96e2-34ddb28cba66 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:42.531474 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-cb821613-5540-4d2e-84db-8828c8b54ec7 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:42.540208 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ac909-be72-4594-adaf-0552744d578d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:42.540497 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ac909-be72-4594-adaf-0552744d578d admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:42.540741 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ac909-be72-4594-adaf-0552744d578d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:42.541018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ac909-be72-4594-adaf-0552744d578d admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:42.541692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cb821613-5540-4d2e-84db-8828c8b54ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:42.543626 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ac909-be72-4594-adaf-0552744d578d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:42.549809 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ac909-be72-4594-adaf-0552744d578d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:42.566313 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 840/1670] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:42.568389 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb821613-5540-4d2e-84db-8828c8b54ec7 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:42.596361 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb821613-5540-4d2e-84db-8828c8b54ec7 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:42.613412 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c868f-0630-444b-84b2-cb26324c4e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:42.614807 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c868f-0630-444b-84b2-cb26324c4e20 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:42.616673 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c868f-0630-444b-84b2-cb26324c4e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:42.617162 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c868f-0630-444b-84b2-cb26324c4e20 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:42.619035 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c868f-0630-444b-84b2-cb26324c4e20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:26:42.619583 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c868f-0630-444b-84b2-cb26324c4e20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:42.621629 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c868f-0630-444b-84b2-cb26324c4e20 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:42.622554 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 831/1671] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:26:42 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:26:42.623578 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ac909-be72-4594-adaf-0552744d578d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:42.672486 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 841/1672] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:26:42.674745 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c868f-0630-444b-84b2-cb26324c4e20 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:42.686347 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c868f-0630-444b-84b2-cb26324c4e20 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:42.704713 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:42.808077 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ac909-be72-4594-adaf-0552744d578d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:42.827797 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92fa8a-01c7-40f9-9fca-f688647768f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:42.828369 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92fa8a-01c7-40f9-9fca-f688647768f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:42.829023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92fa8a-01c7-40f9-9fca-f688647768f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:42.831468 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92fa8a-01c7-40f9-9fca-f688647768f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:42.833156 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92fa8a-01c7-40f9-9fca-f688647768f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:42.844815 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92fa8a-01c7-40f9-9fca-f688647768f1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:42.860969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071eb6ec-c5ce-4442-babc-4c1efcb0a89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:42.863254 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071eb6ec-c5ce-4442-babc-4c1efcb0a89e admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:42.866071 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071eb6ec-c5ce-4442-babc-4c1efcb0a89e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:42.866372 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071eb6ec-c5ce-4442-babc-4c1efcb0a89e admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:42.871435 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071eb6ec-c5ce-4442-babc-4c1efcb0a89e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:42.874679 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071eb6ec-c5ce-4442-babc-4c1efcb0a89e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:42.916684 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 832/1673] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:26:42 2022] POST /identity/v3/users => generated 288 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:42.921297 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92fa8a-01c7-40f9-9fca-f688647768f1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:42.945373 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92fa8a-01c7-40f9-9fca-f688647768f1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:42.956352 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 842/1674] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:26:42 2022] POST /identity/v3/projects => generated 363 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:42.957685 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071eb6ec-c5ce-4442-babc-4c1efcb0a89e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:42.965255 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe031e-8129-4645-a00f-c13ce49fe5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:42.966856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe031e-8129-4645-a00f-c13ce49fe5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:42.967157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe031e-8129-4645-a00f-c13ce49fe5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:42.967806 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe031e-8129-4645-a00f-c13ce49fe5d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:42.970027 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe031e-8129-4645-a00f-c13ce49fe5d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:42.973898 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe031e-8129-4645-a00f-c13ce49fe5d7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:43.005527 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 833/1675] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:26:43.006216 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe031e-8129-4645-a00f-c13ce49fe5d7 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:43.031009 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe031e-8129-4645-a00f-c13ce49fe5d7 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:43.124302 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071eb6ec-c5ce-4442-babc-4c1efcb0a89e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:43.130422 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf781b1-d78c-4557-b105-d41b42cd76aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:43.137019 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf781b1-d78c-4557-b105-d41b42cd76aa admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:43.137386 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf781b1-d78c-4557-b105-d41b42cd76aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:43.137733 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf781b1-d78c-4557-b105-d41b42cd76aa admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:43.138418 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf781b1-d78c-4557-b105-d41b42cd76aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:43.140951 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf781b1-d78c-4557-b105-d41b42cd76aa admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:43.172916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 843/1676] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:26:42 2022] POST /identity/v3/users => generated 282 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:43.174474 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285e675-0667-4c13-aeb1-f92e1e32aaa4 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:43.174770 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285e675-0667-4c13-aeb1-f92e1e32aaa4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:43.175542 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285e675-0667-4c13-aeb1-f92e1e32aaa4 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:43.175645 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0f163-5884-47d2-8b88-44e6484458a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:43.177462 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0f163-5884-47d2-8b88-44e6484458a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:43.177739 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0f163-5884-47d2-8b88-44e6484458a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:43.178081 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0f163-5884-47d2-8b88-44e6484458a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:43.178662 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0f163-5884-47d2-8b88-44e6484458a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:43.178761 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 844/1677] 10.222.0.94 () {54 vars in 921 bytes} [Thu Sep 1 17:26:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:26:43.179512 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285e675-0667-4c13-aeb1-f92e1e32aaa4 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:43.184032 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0f163-5884-47d2-8b88-44e6484458a0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:43.217663 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 834/1678] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:43.217789 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285e675-0667-4c13-aeb1-f92e1e32aaa4 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:43.218584 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0f163-5884-47d2-8b88-44e6484458a0 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:43.229962 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a1c68-01a7-4884-ae2e-47d3f1a06bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:43.231173 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a1c68-01a7-4884-ae2e-47d3f1a06bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:43.231459 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a1c68-01a7-4884-ae2e-47d3f1a06bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:43.231732 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a1c68-01a7-4884-ae2e-47d3f1a06bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:43.232715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a1c68-01a7-4884-ae2e-47d3f1a06bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:43.234367 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a1c68-01a7-4884-ae2e-47d3f1a06bb6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:43.234480 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0f163-5884-47d2-8b88-44e6484458a0 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:43.248280 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e2e0d-9dbc-46d7-aa16-22c1c6ff727a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:43.248975 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e2e0d-9dbc-46d7-aa16-22c1c6ff727a admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:43.249255 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e2e0d-9dbc-46d7-aa16-22c1c6ff727a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:43.249562 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e2e0d-9dbc-46d7-aa16-22c1c6ff727a admin admin] PATH_INFO: `/v3/projects/ef9e69a78fee4b018b9fc3f08549b85e/users/ca8e5ae28c124480a03eda98fc0f0922/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:43.264494 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 845/1679] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:43.264785 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:43.265436 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a1c68-01a7-4884-ae2e-47d3f1a06bb6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:43.282168 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e2e0d-9dbc-46d7-aa16-22c1c6ff727a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef9e69a78fee4b018b9fc3f08549b85e, user_id=ca8e5ae28c124480a03eda98fc0f0922, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:43.285060 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e2e0d-9dbc-46d7-aa16-22c1c6ff727a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:43.289685 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a1c68-01a7-4884-ae2e-47d3f1a06bb6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:43.295179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d1051-2155-4699-9e10-f9872414b992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:43.295802 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d1051-2155-4699-9e10-f9872414b992 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:43.296226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d1051-2155-4699-9e10-f9872414b992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:43.296535 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d1051-2155-4699-9e10-f9872414b992 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:43.297246 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d1051-2155-4699-9e10-f9872414b992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:43.299973 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d1051-2155-4699-9e10-f9872414b992 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:43.315468 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 846/1680] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:43.319189 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba531c96-c315-4c2a-9416-c21664c877ea None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:43.319482 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba531c96-c315-4c2a-9416-c21664c877ea None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:43.319758 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba531c96-c315-4c2a-9416-c21664c877ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:43.346429 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 835/1681] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:26:43 2022] PUT /identity/v3/projects/ef9e69a78fee4b018b9fc3f08549b85e/users/ca8e5ae28c124480a03eda98fc0f0922/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:43.347396 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ba531c96-c315-4c2a-9416-c21664c877ea None None] MFA Rules not processed for user `e3622621761f4f18ae3e9dfb5ba99bef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:43.348801 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ba531c96-c315-4c2a-9416-c21664c877ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:43.349485 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e2e0d-9dbc-46d7-aa16-22c1c6ff727a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:43.486718 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e2e0d-9dbc-46d7-aa16-22c1c6ff727a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:43.487891 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 847/1682] 10.222.0.94 () {58 vars in 1018 bytes} [Thu Sep 1 17:26:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:43.489990 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ceb993-6f8f-4577-8ca2-2d2add8e46e8 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:43.490281 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ceb993-6f8f-4577-8ca2-2d2add8e46e8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:43.490558 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ceb993-6f8f-4577-8ca2-2d2add8e46e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:43.498080 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39414d56-de4b-4010-8dcc-c96b8bf145e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:43.499268 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39414d56-de4b-4010-8dcc-c96b8bf145e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:43.500160 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39414d56-de4b-4010-8dcc-c96b8bf145e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:43.501431 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39414d56-de4b-4010-8dcc-c96b8bf145e7 admin admin] PATH_INFO: `/v3/projects/852c4be565844999968def5a133db78d/users/904775718c1549c189b0ec714ea551e7/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:43.518854 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:43.548874 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39414d56-de4b-4010-8dcc-c96b8bf145e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=852c4be565844999968def5a133db78d, user_id=904775718c1549c189b0ec714ea551e7, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:43.555043 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39414d56-de4b-4010-8dcc-c96b8bf145e7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:43.556394 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b2ceb993-6f8f-4577-8ca2-2d2add8e46e8 None None] MFA Rules not processed for user `ca8e5ae28c124480a03eda98fc0f0922`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:43.557684 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b2ceb993-6f8f-4577-8ca2-2d2add8e46e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:43.594875 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 836/1683] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:26:43 2022] PUT /identity/v3/projects/852c4be565844999968def5a133db78d/users/904775718c1549c189b0ec714ea551e7/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:43.596867 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402b693-0059-482e-8fac-d4eeeb76db25 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:43.597681 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402b693-0059-482e-8fac-d4eeeb76db25 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:43.597971 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402b693-0059-482e-8fac-d4eeeb76db25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:43.653565 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 848/1684] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:43.654931 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ceb993-6f8f-4577-8ca2-2d2add8e46e8 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:43.656611 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b2ceb993-6f8f-4577-8ca2-2d2add8e46e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:43.663105 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7402b693-0059-482e-8fac-d4eeeb76db25 None None] MFA Rules not processed for user `904775718c1549c189b0ec714ea551e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:43.664986 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7402b693-0059-482e-8fac-d4eeeb76db25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:43.694648 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ceb993-6f8f-4577-8ca2-2d2add8e46e8 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:43.823070 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cac0be-4c31-471d-921d-4d23aa84e402 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3622621761f4f18ae3e9dfb5ba99bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:43.823468 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cac0be-4c31-471d-921d-4d23aa84e402 service placement] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:43.824301 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cac0be-4c31-471d-921d-4d23aa84e402 service placement] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:43.824579 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cac0be-4c31-471d-921d-4d23aa84e402 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:43.836164 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 837/1685] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:43.837789 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cac0be-4c31-471d-921d-4d23aa84e402 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:43.839409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cac0be-4c31-471d-921d-4d23aa84e402 service placement] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:43.840816 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402b693-0059-482e-8fac-d4eeeb76db25 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:43.854585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 849/1686] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:26:43.855678 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cac0be-4c31-471d-921d-4d23aa84e402 service placement] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:43.942227 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cac0be-4c31-471d-921d-4d23aa84e402 service placement] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:43.949303 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6ee0a-a83c-47b8-9b03-14a1f2f9241f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:43.950151 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6ee0a-a83c-47b8-9b03-14a1f2f9241f admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:43.950438 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6ee0a-a83c-47b8-9b03-14a1f2f9241f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:43.950730 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6ee0a-a83c-47b8-9b03-14a1f2f9241f admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:43.951425 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6ee0a-a83c-47b8-9b03-14a1f2f9241f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:43.953663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6ee0a-a83c-47b8-9b03-14a1f2f9241f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:43.979160 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402b693-0059-482e-8fac-d4eeeb76db25 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:43.985219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f7f75-c64e-4a30-818f-c23453ba5c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:43.986174 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f7f75-c64e-4a30-818f-c23453ba5c16 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:43.986683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f7f75-c64e-4a30-818f-c23453ba5c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:43.987199 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f7f75-c64e-4a30-818f-c23453ba5c16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:43.988217 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f7f75-c64e-4a30-818f-c23453ba5c16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:43.990800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f7f75-c64e-4a30-818f-c23453ba5c16 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:43.997494 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:43.997631 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 850/1687] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:26:43 2022] POST /identity/v3/projects => generated 363 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:44.002709 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6ee0a-a83c-47b8-9b03-14a1f2f9241f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:44.027329 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:44.037149 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 838/1688] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:26:43 2022] POST /identity/v3/projects => generated 377 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:44.042248 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f7f75-c64e-4a30-818f-c23453ba5c16 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:44.131926 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f7f75-c64e-4a30-818f-c23453ba5c16 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:44.139557 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14c5dd-c684-4948-ae59-8abe46f1227f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:44.140359 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14c5dd-c684-4948-ae59-8abe46f1227f admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:44.140741 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14c5dd-c684-4948-ae59-8abe46f1227f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:44.141163 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14c5dd-c684-4948-ae59-8abe46f1227f admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:44.142055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14c5dd-c684-4948-ae59-8abe46f1227f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:44.144382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14c5dd-c684-4948-ae59-8abe46f1227f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:44.148975 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6ee0a-a83c-47b8-9b03-14a1f2f9241f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:44.161916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8fa9b7-103e-44a9-bf1c-d769514b102d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:44.162645 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8fa9b7-103e-44a9-bf1c-d769514b102d admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:44.164757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8fa9b7-103e-44a9-bf1c-d769514b102d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:44.164757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8fa9b7-103e-44a9-bf1c-d769514b102d admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:44.164757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8fa9b7-103e-44a9-bf1c-d769514b102d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:44.166728 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8fa9b7-103e-44a9-bf1c-d769514b102d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:44.180803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 839/1689] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:26:44 2022] POST /identity/v3/users => generated 295 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:44.183881 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14c5dd-c684-4948-ae59-8abe46f1227f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:44.196740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14c5dd-c684-4948-ae59-8abe46f1227f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:44.201029 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 851/1690] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:26:44 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:26:44.202275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8fa9b7-103e-44a9-bf1c-d769514b102d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:44.207559 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c98b6-8fbe-4283-89a6-6c6ffaa84ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:44.208707 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c98b6-8fbe-4283-89a6-6c6ffaa84ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:44.209192 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c98b6-8fbe-4283-89a6-6c6ffaa84ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:44.210204 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c98b6-8fbe-4283-89a6-6c6ffaa84ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:44.211231 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c98b6-8fbe-4283-89a6-6c6ffaa84ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:44.214137 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8fa9b7-103e-44a9-bf1c-d769514b102d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:44.214261 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c98b6-8fbe-4283-89a6-6c6ffaa84ff8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:44.227785 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeade01-1eb2-4d74-b578-a75cd0f5d64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:44.228412 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeade01-1eb2-4d74-b578-a75cd0f5d64d admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:44.228692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeade01-1eb2-4d74-b578-a75cd0f5d64d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:44.229440 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeade01-1eb2-4d74-b578-a75cd0f5d64d admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:44.233070 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeade01-1eb2-4d74-b578-a75cd0f5d64d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:44.236021 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 840/1691] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:44.237017 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c98b6-8fbe-4283-89a6-6c6ffaa84ff8 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:44.241136 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeade01-1eb2-4d74-b578-a75cd0f5d64d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:44.255958 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c98b6-8fbe-4283-89a6-6c6ffaa84ff8 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:44.267263 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f444f-fbe2-4923-9e96-0cd20fa69a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:44.268050 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 852/1692] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:44.268641 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f444f-fbe2-4923-9e96-0cd20fa69a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:44.268922 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f444f-fbe2-4923-9e96-0cd20fa69a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:44.269023 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeade01-1eb2-4d74-b578-a75cd0f5d64d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:44.269585 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f444f-fbe2-4923-9e96-0cd20fa69a2c admin admin] PATH_INFO: `/v3/projects/c4690597a50a4e4cb00ebd50ef61125d/users/d07f09fd53c04c77bae022fad7102c08/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:44.284792 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeade01-1eb2-4d74-b578-a75cd0f5d64d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:44.287544 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f444f-fbe2-4923-9e96-0cd20fa69a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4690597a50a4e4cb00ebd50ef61125d, user_id=d07f09fd53c04c77bae022fad7102c08, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:44.291127 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f444f-fbe2-4923-9e96-0cd20fa69a2c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:44.303427 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725528c-1027-480c-baa1-e4315d5c48af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:44.304245 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725528c-1027-480c-baa1-e4315d5c48af admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:44.304532 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725528c-1027-480c-baa1-e4315d5c48af admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:44.305496 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725528c-1027-480c-baa1-e4315d5c48af admin admin] PATH_INFO: `/v3/projects/a0379c30f744439e90b5373f2dc31ad9/users/0f0f5412a4804d879a3e636187dc4a17/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:44.313526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 841/1693] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:26:44 2022] PUT /identity/v3/projects/c4690597a50a4e4cb00ebd50ef61125d/users/d07f09fd53c04c77bae022fad7102c08/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:44.315633 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f444f-fbe2-4923-9e96-0cd20fa69a2c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:44.342655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d725528c-1027-480c-baa1-e4315d5c48af admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0379c30f744439e90b5373f2dc31ad9, user_id=0f0f5412a4804d879a3e636187dc4a17, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:44.345570 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d725528c-1027-480c-baa1-e4315d5c48af admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:44.378274 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 853/1694] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:26:44 2022] PUT /identity/v3/projects/a0379c30f744439e90b5373f2dc31ad9/users/0f0f5412a4804d879a3e636187dc4a17/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:44.378457 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725528c-1027-480c-baa1-e4315d5c48af admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:44.467901 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f444f-fbe2-4923-9e96-0cd20fa69a2c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:44.518868 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725528c-1027-480c-baa1-e4315d5c48af admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:44.542728 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81461c6c-ddd9-4bf4-971a-0c3ec6f559c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:44.543476 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81461c6c-ddd9-4bf4-971a-0c3ec6f559c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:44.543674 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81461c6c-ddd9-4bf4-971a-0c3ec6f559c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:44.543953 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81461c6c-ddd9-4bf4-971a-0c3ec6f559c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:44.544619 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81461c6c-ddd9-4bf4-971a-0c3ec6f559c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:44.546320 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81461c6c-ddd9-4bf4-971a-0c3ec6f559c7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:44.576872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 854/1695] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:44.577990 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81461c6c-ddd9-4bf4-971a-0c3ec6f559c7 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:44.589663 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:44.596104 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81461c6c-ddd9-4bf4-971a-0c3ec6f559c7 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:44.605004 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d906b-5014-4abe-8545-f294f61a8c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:44.605834 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d906b-5014-4abe-8545-f294f61a8c35 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:44.606229 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d906b-5014-4abe-8545-f294f61a8c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:44.606570 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d906b-5014-4abe-8545-f294f61a8c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:44.607647 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d906b-5014-4abe-8545-f294f61a8c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:44.609143 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d906b-5014-4abe-8545-f294f61a8c35 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:44.613527 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f27840-79f6-4e82-a704-bc48cea2d769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:44.614216 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f27840-79f6-4e82-a704-bc48cea2d769 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:44.614502 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f27840-79f6-4e82-a704-bc48cea2d769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:44.614776 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f27840-79f6-4e82-a704-bc48cea2d769 admin admin] PATH_INFO: `/v3/projects/a0379c30f744439e90b5373f2dc31ad9/users/0f0f5412a4804d879a3e636187dc4a17/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:44.620689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f27840-79f6-4e82-a704-bc48cea2d769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0379c30f744439e90b5373f2dc31ad9, user_id=0f0f5412a4804d879a3e636187dc4a17, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:44.623415 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f27840-79f6-4e82-a704-bc48cea2d769 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:44.625140 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 842/1696] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:44.626074 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d906b-5014-4abe-8545-f294f61a8c35 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:44.636870 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d906b-5014-4abe-8545-f294f61a8c35 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:44.654215 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 855/1697] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:26:44 2022] PUT /identity/v3/projects/a0379c30f744439e90b5373f2dc31ad9/users/0f0f5412a4804d879a3e636187dc4a17/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:44.665176 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e293fe7-dbf2-4f2d-89fc-4dc79b9289c1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:44.665526 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e293fe7-dbf2-4f2d-89fc-4dc79b9289c1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:44.665823 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e293fe7-dbf2-4f2d-89fc-4dc79b9289c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:44.722779 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b44b6-7911-4499-8bee-6a1f162a923e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:44.723539 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b44b6-7911-4499-8bee-6a1f162a923e admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:44.723826 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b44b6-7911-4499-8bee-6a1f162a923e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:44.724101 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b44b6-7911-4499-8bee-6a1f162a923e admin admin] PATH_INFO: `/v3/projects/c4690597a50a4e4cb00ebd50ef61125d/users/d07f09fd53c04c77bae022fad7102c08/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:44.728186 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b44b6-7911-4499-8bee-6a1f162a923e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4690597a50a4e4cb00ebd50ef61125d, user_id=d07f09fd53c04c77bae022fad7102c08, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:44.732422 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b44b6-7911-4499-8bee-6a1f162a923e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:44.732833 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3e293fe7-dbf2-4f2d-89fc-4dc79b9289c1 None None] MFA Rules not processed for user `0f0f5412a4804d879a3e636187dc4a17`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:44.734204 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3e293fe7-dbf2-4f2d-89fc-4dc79b9289c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:44.747070 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 843/1698] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:26:44 2022] PUT /identity/v3/projects/c4690597a50a4e4cb00ebd50ef61125d/users/d07f09fd53c04c77bae022fad7102c08/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:44.758478 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fc009-8d10-4e88-96e6-a39cadd3f046 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:44.758808 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fc009-8d10-4e88-96e6-a39cadd3f046 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:44.759030 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fc009-8d10-4e88-96e6-a39cadd3f046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:44.795144 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-118fc009-8d10-4e88-96e6-a39cadd3f046 None None] MFA Rules not processed for user `d07f09fd53c04c77bae022fad7102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:44.796426 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-118fc009-8d10-4e88-96e6-a39cadd3f046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:44.820384 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:44.907823 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 856/1699] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:44.908739 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e293fe7-dbf2-4f2d-89fc-4dc79b9289c1 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:44.913253 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3e293fe7-dbf2-4f2d-89fc-4dc79b9289c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:44.940447 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 844/1700] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:44.940662 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e293fe7-dbf2-4f2d-89fc-4dc79b9289c1 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:44.941230 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fc009-8d10-4e88-96e6-a39cadd3f046 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:44.943640 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-118fc009-8d10-4e88-96e6-a39cadd3f046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:45.099787 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7581e-a24d-4053-b579-b8584603ac2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:45.100496 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7581e-a24d-4053-b579-b8584603ac2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:45.100811 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7581e-a24d-4053-b579-b8584603ac2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:45.101043 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7581e-a24d-4053-b579-b8584603ac2c admin admin] PATH_INFO: `/v3/projects/20dfd9c2e82c4626b9c36834edcebbe1` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:45.109284 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7581e-a24d-4053-b579-b8584603ac2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=20dfd9c2e82c4626b9c36834edcebbe1)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:45.111305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7581e-a24d-4053-b579-b8584603ac2c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:45.150300 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fc009-8d10-4e88-96e6-a39cadd3f046 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:45.161219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18bb85-c627-416c-a1b2-8e1e2fc03668 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:45.162229 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18bb85-c627-416c-a1b2-8e1e2fc03668 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:45.162337 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18bb85-c627-416c-a1b2-8e1e2fc03668 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:45.162568 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18bb85-c627-416c-a1b2-8e1e2fc03668 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:45.199325 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:45.313434 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c9b7581e-a24d-4053-b579-b8584603ac2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20dfd9c2e82c4626b9c36834edcebbe1', 'request_id': 'req-c9b7581e-a24d-4053-b579-b8584603ac2c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:45.322338 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c9b7581e-a24d-4053-b579-b8584603ac2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20dfd9c2e82c4626b9c36834edcebbe1', 'request_id': 'req-c9b7581e-a24d-4053-b579-b8584603ac2c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:45.332729 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c9b7581e-a24d-4053-b579-b8584603ac2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20dfd9c2e82c4626b9c36834edcebbe1', 'request_id': 'req-c9b7581e-a24d-4053-b579-b8584603ac2c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:45.357795 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da18bb85-c627-416c-a1b2-8e1e2fc03668 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:45.359386 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da18bb85-c627-416c-a1b2-8e1e2fc03668 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:45.360568 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c9b7581e-a24d-4053-b579-b8584603ac2c admin admin] The token cache is being invalidate because project 20dfd9c2e82c4626b9c36834edcebbe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:26:45.361019 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c9b7581e-a24d-4053-b579-b8584603ac2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:45.362213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c9b7581e-a24d-4053-b579-b8584603ac2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:45.366934 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 857/1701] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:26:44 2022] DELETE /identity/v3/projects/20dfd9c2e82c4626b9c36834edcebbe1 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:45.368855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7581e-a24d-4053-b579-b8584603ac2c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:45.371555 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c9b7581e-a24d-4053-b579-b8584603ac2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:45.390099 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 845/1702] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:26:45.398342 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18bb85-c627-416c-a1b2-8e1e2fc03668 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:45.422632 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18bb85-c627-416c-a1b2-8e1e2fc03668 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:45.537316 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7581e-a24d-4053-b579-b8584603ac2c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:45.554548 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2f565-2679-4556-ac49-d6bdfd0c4bb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:45.555268 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2f565-2679-4556-ac49-d6bdfd0c4bb6 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:45.557944 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2f565-2679-4556-ac49-d6bdfd0c4bb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:45.558265 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2f565-2679-4556-ac49-d6bdfd0c4bb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:45.563664 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-63c2f565-2679-4556-ac49-d6bdfd0c4bb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:45.609842 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:45.670180 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ded780-3899-4eac-a9a2-a1e5b398c2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:45.677625 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ded780-3899-4eac-a9a2-a1e5b398c2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:45.678211 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ded780-3899-4eac-a9a2-a1e5b398c2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:45.678634 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ded780-3899-4eac-a9a2-a1e5b398c2a5 admin admin] PATH_INFO: `/v3/users/b8aebf48d158496f9a32c750f6048c8e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:45.680268 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ded780-3899-4eac-a9a2-a1e5b398c2a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8aebf48d158496f9a32c750f6048c8e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:45.684691 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ded780-3899-4eac-a9a2-a1e5b398c2a5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:45.747915 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2f565-2679-4556-ac49-d6bdfd0c4bb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:45.750114 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2f565-2679-4556-ac49-d6bdfd0c4bb6 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:45.770963 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 858/1703] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:26:45.775651 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2f565-2679-4556-ac49-d6bdfd0c4bb6 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:45.779950 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-63c2f565-2679-4556-ac49-d6bdfd0c4bb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:45.804117 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-56ded780-3899-4eac-a9a2-a1e5b398c2a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8aebf48d158496f9a32c750f6048c8e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:45.805269 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-56ded780-3899-4eac-a9a2-a1e5b398c2a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8aebf48d158496f9a32c750f6048c8e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:45.817898 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-56ded780-3899-4eac-a9a2-a1e5b398c2a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8aebf48d158496f9a32c750f6048c8e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:45.818889 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-56ded780-3899-4eac-a9a2-a1e5b398c2a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8aebf48d158496f9a32c750f6048c8e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:45.821098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2f565-2679-4556-ac49-d6bdfd0c4bb6 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:45.831476 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69cec7-e6d2-4232-8447-9fec19cfc14c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:45.832287 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69cec7-e6d2-4232-8447-9fec19cfc14c service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:45.835613 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69cec7-e6d2-4232-8447-9fec19cfc14c service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:45.836773 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69cec7-e6d2-4232-8447-9fec19cfc14c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:45.843279 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4b69cec7-e6d2-4232-8447-9fec19cfc14c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:45.843909 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-56ded780-3899-4eac-a9a2-a1e5b398c2a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8aebf48d158496f9a32c750f6048c8e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:45.871480 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 846/1704] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:26:45 2022] DELETE /identity/v3/users/b8aebf48d158496f9a32c750f6048c8e => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:45.976111 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69cec7-e6d2-4232-8447-9fec19cfc14c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:45.980578 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69cec7-e6d2-4232-8447-9fec19cfc14c service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:45.998789 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 859/1705] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:26:46.276480 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ded780-3899-4eac-a9a2-a1e5b398c2a5 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:46.278571 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-56ded780-3899-4eac-a9a2-a1e5b398c2a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:46.387119 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:46.464859 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ded780-3899-4eac-a9a2-a1e5b398c2a5 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:46.480021 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b45e90-332a-47ce-aa88-90bea0bccf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:46.481300 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b45e90-332a-47ce-aa88-90bea0bccf2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:46.481720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b45e90-332a-47ce-aa88-90bea0bccf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:46.482104 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b45e90-332a-47ce-aa88-90bea0bccf2b admin admin] PATH_INFO: `/v3/users/e75a67f37877499ab6545ecac5b1acf0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:46.483764 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b45e90-332a-47ce-aa88-90bea0bccf2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e75a67f37877499ab6545ecac5b1acf0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:46.486606 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b45e90-332a-47ce-aa88-90bea0bccf2b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:46.583199 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a5b45e90-332a-47ce-aa88-90bea0bccf2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e75a67f37877499ab6545ecac5b1acf0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:46.599443 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a5b45e90-332a-47ce-aa88-90bea0bccf2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e75a67f37877499ab6545ecac5b1acf0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:46.621617 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0f530-2d3f-4b47-8279-7b7443dbf988 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:46.622086 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0f530-2d3f-4b47-8279-7b7443dbf988 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:46.622349 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0f530-2d3f-4b47-8279-7b7443dbf988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:46.622648 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a5b45e90-332a-47ce-aa88-90bea0bccf2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e75a67f37877499ab6545ecac5b1acf0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:46.623613 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a5b45e90-332a-47ce-aa88-90bea0bccf2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e75a67f37877499ab6545ecac5b1acf0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:46.636240 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a5b45e90-332a-47ce-aa88-90bea0bccf2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e75a67f37877499ab6545ecac5b1acf0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:46.681438 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 847/1706] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:26:46 2022] DELETE /identity/v3/users/e75a67f37877499ab6545ecac5b1acf0 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:46.709698 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-dac0f530-2d3f-4b47-8279-7b7443dbf988 None None] MFA Rules not processed for user `eb6bfd9c259748d0a705cf2780b5c194`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:46.712665 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-dac0f530-2d3f-4b47-8279-7b7443dbf988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:46.854186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 860/1707] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:26:46.864714 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d263e4-a6bb-4b40-9971-22d8a8f76776 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:46.865259 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d263e4-a6bb-4b40-9971-22d8a8f76776 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:46.865681 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d263e4-a6bb-4b40-9971-22d8a8f76776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:46.909972 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-46d263e4-a6bb-4b40-9971-22d8a8f76776 None None] MFA Rules not processed for user `eb6bfd9c259748d0a705cf2780b5c194`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:46.914949 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-46d263e4-a6bb-4b40-9971-22d8a8f76776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:46.932192 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 848/1708] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:46.947562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0f530-2d3f-4b47-8279-7b7443dbf988 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:46.953282 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-dac0f530-2d3f-4b47-8279-7b7443dbf988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:47.046220 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:47.114408 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0f530-2d3f-4b47-8279-7b7443dbf988 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:47.127962 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d21ea-7059-4d59-a7aa-80be53af22aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:47.129176 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d21ea-7059-4d59-a7aa-80be53af22aa service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:47.129724 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d21ea-7059-4d59-a7aa-80be53af22aa service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:47.130496 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d21ea-7059-4d59-a7aa-80be53af22aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:47.155167 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d21ea-7059-4d59-a7aa-80be53af22aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:47.157446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d21ea-7059-4d59-a7aa-80be53af22aa service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:47.189641 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 861/1709] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:46 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:26:47.295695 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d263e4-a6bb-4b40-9971-22d8a8f76776 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:47.298728 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-46d263e4-a6bb-4b40-9971-22d8a8f76776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:47.530193 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d263e4-a6bb-4b40-9971-22d8a8f76776 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:47.543707 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77733dd0-7fd1-48ce-93f6-8f0c22bbd139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:47.544255 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77733dd0-7fd1-48ce-93f6-8f0c22bbd139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:47.544537 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77733dd0-7fd1-48ce-93f6-8f0c22bbd139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:47.544811 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77733dd0-7fd1-48ce-93f6-8f0c22bbd139 admin admin] PATH_INFO: `/v3/projects/e7784eed0e844f3fb77e7f3edefd3d50` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:47.548207 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77733dd0-7fd1-48ce-93f6-8f0c22bbd139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7784eed0e844f3fb77e7f3edefd3d50)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:47.554067 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77733dd0-7fd1-48ce-93f6-8f0c22bbd139 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:47.663063 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:47.673847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-77733dd0-7fd1-48ce-93f6-8f0c22bbd139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7784eed0e844f3fb77e7f3edefd3d50', 'request_id': 'req-77733dd0-7fd1-48ce-93f6-8f0c22bbd139'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:47.692372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-77733dd0-7fd1-48ce-93f6-8f0c22bbd139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7784eed0e844f3fb77e7f3edefd3d50', 'request_id': 'req-77733dd0-7fd1-48ce-93f6-8f0c22bbd139'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:47.709167 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-77733dd0-7fd1-48ce-93f6-8f0c22bbd139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7784eed0e844f3fb77e7f3edefd3d50', 'request_id': 'req-77733dd0-7fd1-48ce-93f6-8f0c22bbd139'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:47.739641 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-77733dd0-7fd1-48ce-93f6-8f0c22bbd139 admin admin] The token cache is being invalidate because project e7784eed0e844f3fb77e7f3edefd3d50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:26:47.740227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-77733dd0-7fd1-48ce-93f6-8f0c22bbd139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:47.742477 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-77733dd0-7fd1-48ce-93f6-8f0c22bbd139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:47.756224 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 849/1710] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:26:47 2022] DELETE /identity/v3/projects/e7784eed0e844f3fb77e7f3edefd3d50 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:47.757732 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d8bbf-b9cb-4538-a13b-cc664acfe7c5 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:47.758177 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d8bbf-b9cb-4538-a13b-cc664acfe7c5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:47.758340 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d8bbf-b9cb-4538-a13b-cc664acfe7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:47.808657 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77733dd0-7fd1-48ce-93f6-8f0c22bbd139 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:47.811009 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-77733dd0-7fd1-48ce-93f6-8f0c22bbd139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:47.828539 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-666d8bbf-b9cb-4538-a13b-cc664acfe7c5 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:47.829868 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-666d8bbf-b9cb-4538-a13b-cc664acfe7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:48.036655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77733dd0-7fd1-48ce-93f6-8f0c22bbd139 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:48.048962 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 862/1711] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:48.059206 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52d430-eab8-4571-be1c-3f7c1395cadd None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:48.059565 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52d430-eab8-4571-be1c-3f7c1395cadd None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:48.059949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52d430-eab8-4571-be1c-3f7c1395cadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:48.066334 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3efffe-5454-423c-83d8-af41094bf6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:48.066990 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3efffe-5454-423c-83d8-af41094bf6a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:48.068350 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3efffe-5454-423c-83d8-af41094bf6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:48.068555 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3efffe-5454-423c-83d8-af41094bf6a8 admin admin] PATH_INFO: `/v3/projects/9e05ba77bff64527aaa60a522b4cad50` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:48.070624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3efffe-5454-423c-83d8-af41094bf6a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e05ba77bff64527aaa60a522b4cad50)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:48.076241 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3efffe-5454-423c-83d8-af41094bf6a8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:48.108624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3a52d430-eab8-4571-be1c-3f7c1395cadd None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:48.127417 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3a52d430-eab8-4571-be1c-3f7c1395cadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:48.162998 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 863/1712] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:26:48.165695 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52d430-eab8-4571-be1c-3f7c1395cadd None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:48.183304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52d430-eab8-4571-be1c-3f7c1395cadd None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:48.198138 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0e3efffe-5454-423c-83d8-af41094bf6a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e05ba77bff64527aaa60a522b4cad50', 'request_id': 'req-0e3efffe-5454-423c-83d8-af41094bf6a8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:48.232032 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0e3efffe-5454-423c-83d8-af41094bf6a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e05ba77bff64527aaa60a522b4cad50', 'request_id': 'req-0e3efffe-5454-423c-83d8-af41094bf6a8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:48.251632 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0e3efffe-5454-423c-83d8-af41094bf6a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e05ba77bff64527aaa60a522b4cad50', 'request_id': 'req-0e3efffe-5454-423c-83d8-af41094bf6a8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:48.290770 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421f683-84a0-4a9c-888c-b0c673751aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:48.291677 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421f683-84a0-4a9c-888c-b0c673751aee admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:48.292747 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421f683-84a0-4a9c-888c-b0c673751aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:48.293208 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421f683-84a0-4a9c-888c-b0c673751aee admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:48.294084 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1421f683-84a0-4a9c-888c-b0c673751aee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:26:48.294197 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0e3efffe-5454-423c-83d8-af41094bf6a8 admin admin] The token cache is being invalidate because project 9e05ba77bff64527aaa60a522b4cad50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:26:48.294607 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1421f683-84a0-4a9c-888c-b0c673751aee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:48.295357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0e3efffe-5454-423c-83d8-af41094bf6a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:48.296968 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0e3efffe-5454-423c-83d8-af41094bf6a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:48.297988 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1421f683-84a0-4a9c-888c-b0c673751aee admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:48.299371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 850/1713] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:26:47 2022] DELETE /identity/v3/projects/9e05ba77bff64527aaa60a522b4cad50 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:26:48.303312 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3efffe-5454-423c-83d8-af41094bf6a8 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:48.306207 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0e3efffe-5454-423c-83d8-af41094bf6a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:48.317236 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 864/1714] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:26:48.318541 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421f683-84a0-4a9c-888c-b0c673751aee admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:48.321112 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1421f683-84a0-4a9c-888c-b0c673751aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:48.340382 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421f683-84a0-4a9c-888c-b0c673751aee admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:48.343942 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3efffe-5454-423c-83d8-af41094bf6a8 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:48.346359 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64762fe-f37f-4955-9f9c-5e37f86548c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:48.348120 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64762fe-f37f-4955-9f9c-5e37f86548c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:48.348666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64762fe-f37f-4955-9f9c-5e37f86548c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:48.349053 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64762fe-f37f-4955-9f9c-5e37f86548c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:48.350059 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64762fe-f37f-4955-9f9c-5e37f86548c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:48.352584 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64762fe-f37f-4955-9f9c-5e37f86548c8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:48.358117 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d90da-b00c-4d17-a104-22599122dfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:48.359109 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d90da-b00c-4d17-a104-22599122dfe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:48.369336 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d90da-b00c-4d17-a104-22599122dfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:48.369804 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d90da-b00c-4d17-a104-22599122dfe9 admin admin] PATH_INFO: `/v3/users/d90ac122f98144e780e6eaaaf812366e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:48.372000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d90da-b00c-4d17-a104-22599122dfe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d90ac122f98144e780e6eaaaf812366e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:48.374604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d90da-b00c-4d17-a104-22599122dfe9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:48.409069 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 865/1715] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:26:48 2022] POST /identity/v3/projects => generated 383 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:26:48.410547 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64762fe-f37f-4955-9f9c-5e37f86548c8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:48.493126 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:48.519623 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c57d90da-b00c-4d17-a104-22599122dfe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd90ac122f98144e780e6eaaaf812366e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:48.522219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c57d90da-b00c-4d17-a104-22599122dfe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd90ac122f98144e780e6eaaaf812366e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:48.537534 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c57d90da-b00c-4d17-a104-22599122dfe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd90ac122f98144e780e6eaaaf812366e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:48.538442 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c57d90da-b00c-4d17-a104-22599122dfe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd90ac122f98144e780e6eaaaf812366e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:48.551680 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c57d90da-b00c-4d17-a104-22599122dfe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd90ac122f98144e780e6eaaaf812366e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:48.559820 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64762fe-f37f-4955-9f9c-5e37f86548c8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:48.568419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=19,keystone:SELECT=78,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:48.572333 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdaa11-5300-41cc-899b-d6178fbd6ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:48.576215 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdaa11-5300-41cc-899b-d6178fbd6ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:48.577179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdaa11-5300-41cc-899b-d6178fbd6ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:48.578889 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdaa11-5300-41cc-899b-d6178fbd6ab6 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:48.580743 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdaa11-5300-41cc-899b-d6178fbd6ab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:48.583103 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdaa11-5300-41cc-899b-d6178fbd6ab6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:48.621284 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 866/1716] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:26:48 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:48.625472 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 851/1717] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:26:48 2022] DELETE /identity/v3/users/d90ac122f98144e780e6eaaaf812366e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:48.628459 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdaa11-5300-41cc-899b-d6178fbd6ab6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:48.628459 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-dfbdaa11-5300-41cc-899b-d6178fbd6ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:48.650399 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdaa11-5300-41cc-899b-d6178fbd6ab6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:48.771642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170758bb-238d-440c-98f2-d74513effe6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:48.777620 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170758bb-238d-440c-98f2-d74513effe6d admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:48.780592 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170758bb-238d-440c-98f2-d74513effe6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:48.781246 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170758bb-238d-440c-98f2-d74513effe6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:48.783377 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170758bb-238d-440c-98f2-d74513effe6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:48.789689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170758bb-238d-440c-98f2-d74513effe6d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:48.811986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 867/1718] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:26:48.816477 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d90da-b00c-4d17-a104-22599122dfe9 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:48.833079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d90da-b00c-4d17-a104-22599122dfe9 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:48.841255 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ea993-0763-46d2-bd35-e5e85271bbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:48.841904 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ea993-0763-46d2-bd35-e5e85271bbe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:48.842178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ea993-0763-46d2-bd35-e5e85271bbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:48.842447 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ea993-0763-46d2-bd35-e5e85271bbe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:48.843239 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ea993-0763-46d2-bd35-e5e85271bbe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:48.851821 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ea993-0763-46d2-bd35-e5e85271bbe2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:48.871310 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 852/1719] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:26:48.874540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170758bb-238d-440c-98f2-d74513effe6d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:48.889483 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170758bb-238d-440c-98f2-d74513effe6d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:48.919319 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e278033-4b7f-43bf-9b59-3835229aad1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:48.922087 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e278033-4b7f-43bf-9b59-3835229aad1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:48.924129 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e278033-4b7f-43bf-9b59-3835229aad1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:48.924246 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e278033-4b7f-43bf-9b59-3835229aad1e admin admin] PATH_INFO: `/v3/projects/58d7606d13db4e6e8caacae15e2153bc/users/cb51f4715fc84d8987ede59a3d36908c/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:48.968563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e278033-4b7f-43bf-9b59-3835229aad1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=58d7606d13db4e6e8caacae15e2153bc, user_id=cb51f4715fc84d8987ede59a3d36908c, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:48.975368 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e278033-4b7f-43bf-9b59-3835229aad1e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:49.036902 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 868/1720] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:26:48 2022] PUT /identity/v3/projects/58d7606d13db4e6e8caacae15e2153bc/users/cb51f4715fc84d8987ede59a3d36908c/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:49.037380 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0527cc3-76f6-480e-ad3c-d0a5034dfe44 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:49.038068 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0527cc3-76f6-480e-ad3c-d0a5034dfe44 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:49.038347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0527cc3-76f6-480e-ad3c-d0a5034dfe44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:49.118379 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f0527cc3-76f6-480e-ad3c-d0a5034dfe44 None None] MFA Rules not processed for user `cb51f4715fc84d8987ede59a3d36908c`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:49.119786 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f0527cc3-76f6-480e-ad3c-d0a5034dfe44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:49.264608 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc683c4-b583-4f6e-898b-32b7fd1c4640 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:49.265160 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc683c4-b583-4f6e-898b-32b7fd1c4640 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:49.265660 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc683c4-b583-4f6e-898b-32b7fd1c4640 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:49.267254 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 869/1721] 10.222.0.94 () {54 vars in 912 bytes} [Thu Sep 1 17:26:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:26:49.277144 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e95892-fab7-4d11-b996-c521f4b0640c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:49.277344 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e95892-fab7-4d11-b996-c521f4b0640c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:49.277654 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e95892-fab7-4d11-b996-c521f4b0640c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:49.342781 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 853/1722] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:26:49.344950 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263eff0-ce85-4c65-be06-ef748f45a20f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:49.345823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263eff0-ce85-4c65-be06-ef748f45a20f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:49.346226 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263eff0-ce85-4c65-be06-ef748f45a20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:49.383766 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f4e95892-fab7-4d11-b996-c521f4b0640c None None] MFA Rules not processed for user `9492a32538da4b0a8dc781e3485ac892`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:49.385040 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f4e95892-fab7-4d11-b996-c521f4b0640c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:49.462689 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a263eff0-ce85-4c65-be06-ef748f45a20f None None] MFA Rules not processed for user `92edc2953b8e4e42aa64569335acfc9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:49.464201 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a263eff0-ce85-4c65-be06-ef748f45a20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:49.540876 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 854/1723] 10.222.0.94 () {58 vars in 1009 bytes} [Thu Sep 1 17:26:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:49.542454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263eff0-ce85-4c65-be06-ef748f45a20f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:49.610412 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:49.630803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263eff0-ce85-4c65-be06-ef748f45a20f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:49.638999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 870/1724] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:49.638999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e95892-fab7-4d11-b996-c521f4b0640c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:49.638999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f4e95892-fab7-4d11-b996-c521f4b0640c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:49.650127 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd4427-b8a9-4e2b-8f79-f8c668c43245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:49.650786 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd4427-b8a9-4e2b-8f79-f8c668c43245 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:49.651065 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd4427-b8a9-4e2b-8f79-f8c668c43245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:49.651371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd4427-b8a9-4e2b-8f79-f8c668c43245 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:49.657441 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd4427-b8a9-4e2b-8f79-f8c668c43245 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:49.663915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd4427-b8a9-4e2b-8f79-f8c668c43245 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:49.733179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:49.737919 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 855/1725] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:26:49 2022] POST /identity/v3/projects => generated 381 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:49.737919 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd4427-b8a9-4e2b-8f79-f8c668c43245 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:49.741681 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8afd4427-b8a9-4e2b-8f79-f8c668c43245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:49.821135 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e95892-fab7-4d11-b996-c521f4b0640c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:49.912305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd4427-b8a9-4e2b-8f79-f8c668c43245 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:49.917464 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf985612-3c06-4b8f-96d0-bec831eb517c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:49.918157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf985612-3c06-4b8f-96d0-bec831eb517c service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:49.918438 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf985612-3c06-4b8f-96d0-bec831eb517c service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:49.918764 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf985612-3c06-4b8f-96d0-bec831eb517c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:49.926871 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf985612-3c06-4b8f-96d0-bec831eb517c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:49.931309 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf985612-3c06-4b8f-96d0-bec831eb517c service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:49.943019 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 856/1726] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:26:49.943989 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf985612-3c06-4b8f-96d0-bec831eb517c service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:49.959100 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cf985612-3c06-4b8f-96d0-bec831eb517c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:50.006193 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38319987-cdcc-4df4-a1ea-109bbaab6315 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:50.011226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38319987-cdcc-4df4-a1ea-109bbaab6315 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:50.011226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38319987-cdcc-4df4-a1ea-109bbaab6315 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:50.011226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38319987-cdcc-4df4-a1ea-109bbaab6315 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:50.020558 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-38319987-cdcc-4df4-a1ea-109bbaab6315 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:50.199341 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf985612-3c06-4b8f-96d0-bec831eb517c service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:50.214461 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38319987-cdcc-4df4-a1ea-109bbaab6315 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:50.221855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38319987-cdcc-4df4-a1ea-109bbaab6315 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:50.244445 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45c9f3-2e91-4259-ac66-6fae88da666b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:50.246796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45c9f3-2e91-4259-ac66-6fae88da666b service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:50.247251 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45c9f3-2e91-4259-ac66-6fae88da666b service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:50.247723 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45c9f3-2e91-4259-ac66-6fae88da666b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:50.285844 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 871/1727] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:26:50.292583 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38319987-cdcc-4df4-a1ea-109bbaab6315 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:50.512646 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45c9f3-2e91-4259-ac66-6fae88da666b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:50.526261 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45c9f3-2e91-4259-ac66-6fae88da666b service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:50.566753 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 857/1728] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:26:50.567675 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45c9f3-2e91-4259-ac66-6fae88da666b service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:50.575675 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4e45c9f3-2e91-4259-ac66-6fae88da666b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:50.589645 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38319987-cdcc-4df4-a1ea-109bbaab6315 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:50.614882 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd074d5-6a91-4b7f-ac4f-c3e87863d11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:50.620917 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd074d5-6a91-4b7f-ac4f-c3e87863d11c admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:50.621222 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd074d5-6a91-4b7f-ac4f-c3e87863d11c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:50.621523 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd074d5-6a91-4b7f-ac4f-c3e87863d11c admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:50.622208 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd074d5-6a91-4b7f-ac4f-c3e87863d11c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:50.627410 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd074d5-6a91-4b7f-ac4f-c3e87863d11c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:50.628785 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45c9f3-2e91-4259-ac66-6fae88da666b service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:50.648800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190f755-bb6d-469d-9b9b-1c112efaad4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:50.649314 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190f755-bb6d-469d-9b9b-1c112efaad4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:50.649618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190f755-bb6d-469d-9b9b-1c112efaad4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:50.649893 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190f755-bb6d-469d-9b9b-1c112efaad4f admin admin] PATH_INFO: `/v3/projects/3759f9781fb34b528852ab29a44569f1` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:50.651451 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190f755-bb6d-469d-9b9b-1c112efaad4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3759f9781fb34b528852ab29a44569f1)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:50.656954 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190f755-bb6d-469d-9b9b-1c112efaad4f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:50.677073 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 872/1729] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:26:50 2022] POST /identity/v3/users => generated 297 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:50.679245 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e49503-256f-4697-9c57-1359825fdb6d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:50.680929 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e49503-256f-4697-9c57-1359825fdb6d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:50.681483 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e49503-256f-4697-9c57-1359825fdb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:50.703306 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:50.777164 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-25e49503-256f-4697-9c57-1359825fdb6d None None] MFA Rules not processed for user `754c17cea670481bb43938aaf2e8d7d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:50.780566 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-25e49503-256f-4697-9c57-1359825fdb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:50.820842 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a190f755-bb6d-469d-9b9b-1c112efaad4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3759f9781fb34b528852ab29a44569f1', 'request_id': 'req-a190f755-bb6d-469d-9b9b-1c112efaad4f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:50.821514 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:50.840772 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a190f755-bb6d-469d-9b9b-1c112efaad4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3759f9781fb34b528852ab29a44569f1', 'request_id': 'req-a190f755-bb6d-469d-9b9b-1c112efaad4f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:50.862842 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a190f755-bb6d-469d-9b9b-1c112efaad4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3759f9781fb34b528852ab29a44569f1', 'request_id': 'req-a190f755-bb6d-469d-9b9b-1c112efaad4f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:50.895893 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a190f755-bb6d-469d-9b9b-1c112efaad4f admin admin] The token cache is being invalidate because project 3759f9781fb34b528852ab29a44569f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:26:50.896111 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a190f755-bb6d-469d-9b9b-1c112efaad4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:50.896895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a190f755-bb6d-469d-9b9b-1c112efaad4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:50.898955 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 858/1730] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:26:50 2022] DELETE /identity/v3/projects/3759f9781fb34b528852ab29a44569f1 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:50.900055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190f755-bb6d-469d-9b9b-1c112efaad4f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:50.906388 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a190f755-bb6d-469d-9b9b-1c112efaad4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:50.959259 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 873/1731] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:50.962233 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768419d-b810-4b4a-a526-6be342a04c7a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:50.962585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768419d-b810-4b4a-a526-6be342a04c7a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:50.963385 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768419d-b810-4b4a-a526-6be342a04c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:51.014595 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2768419d-b810-4b4a-a526-6be342a04c7a None None] MFA Rules not processed for user `933d1ebb00cd407ba39ed91d887a5254`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:51.017253 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2768419d-b810-4b4a-a526-6be342a04c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:51.077683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190f755-bb6d-469d-9b9b-1c112efaad4f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:51.099415 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe77a3-48e9-443b-afba-92ceb2110df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:51.100239 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe77a3-48e9-443b-afba-92ceb2110df8 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:51.100623 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe77a3-48e9-443b-afba-92ceb2110df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:51.101002 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe77a3-48e9-443b-afba-92ceb2110df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:51.102996 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe77a3-48e9-443b-afba-92ceb2110df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:51.105168 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe77a3-48e9-443b-afba-92ceb2110df8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:51.131251 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 859/1732] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:51.132806 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b873b8-2acb-4029-a812-eda95a372888 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:51.133288 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b873b8-2acb-4029-a812-eda95a372888 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:51.133995 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 874/1733] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:51.134470 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b873b8-2acb-4029-a812-eda95a372888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:51.135096 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768419d-b810-4b4a-a526-6be342a04c7a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:51.137209 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2768419d-b810-4b4a-a526-6be342a04c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:51.180010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b1b873b8-2acb-4029-a812-eda95a372888 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:51.181489 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b1b873b8-2acb-4029-a812-eda95a372888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:51.202859 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 860/1734] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:51.203891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b873b8-2acb-4029-a812-eda95a372888 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:51.224776 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b873b8-2acb-4029-a812-eda95a372888 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:51.250231 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f3bbc-ed62-4ce0-a150-dddd5f535987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:51.254227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f3bbc-ed62-4ce0-a150-dddd5f535987 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:51.254644 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f3bbc-ed62-4ce0-a150-dddd5f535987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:51.255516 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f3bbc-ed62-4ce0-a150-dddd5f535987 admin admin] PATH_INFO: `/v3/projects/722f10477e4f4ef782c46fc020328b9d/users/be426d0b740f404ca7f228a65145ac11/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:51.305188 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f3bbc-ed62-4ce0-a150-dddd5f535987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=722f10477e4f4ef782c46fc020328b9d, user_id=be426d0b740f404ca7f228a65145ac11, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:51.308350 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f3bbc-ed62-4ce0-a150-dddd5f535987 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:51.345439 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 861/1735] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:26:51 2022] PUT /identity/v3/projects/722f10477e4f4ef782c46fc020328b9d/users/be426d0b740f404ca7f228a65145ac11/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:51.351126 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db73e35-3e92-43f2-b9aa-3ceb3413eb15 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:51.359675 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db73e35-3e92-43f2-b9aa-3ceb3413eb15 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:51.360142 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db73e35-3e92-43f2-b9aa-3ceb3413eb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:51.386342 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768419d-b810-4b4a-a526-6be342a04c7a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:51.406790 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-1db73e35-3e92-43f2-b9aa-3ceb3413eb15 None None] MFA Rules not processed for user `933d1ebb00cd407ba39ed91d887a5254`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:51.408808 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1db73e35-3e92-43f2-b9aa-3ceb3413eb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:51.516879 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:51.576210 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11aa01-1023-4f7c-b492-d341fc639059 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:51.576210 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11aa01-1023-4f7c-b492-d341fc639059 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:51.576210 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11aa01-1023-4f7c-b492-d341fc639059 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:51.576210 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11aa01-1023-4f7c-b492-d341fc639059 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:51.612483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 862/1736] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:51.614170 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ae29a-0482-4727-912d-321f85544b58 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:51.614569 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ae29a-0482-4727-912d-321f85544b58 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:51.614953 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ae29a-0482-4727-912d-321f85544b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:51.663823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c67ae29a-0482-4727-912d-321f85544b58 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:51.665293 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c67ae29a-0482-4727-912d-321f85544b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:51.666023 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11aa01-1023-4f7c-b492-d341fc639059 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:51.668173 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11aa01-1023-4f7c-b492-d341fc639059 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:51.677780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:51.682779 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 875/1737] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:26:51.683699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11aa01-1023-4f7c-b492-d341fc639059 service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:51.774548 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11aa01-1023-4f7c-b492-d341fc639059 service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:51.781572 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8b194-7a6c-46bf-8952-606f2e160f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:51.782305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8b194-7a6c-46bf-8952-606f2e160f5c admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:51.782936 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8b194-7a6c-46bf-8952-606f2e160f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:51.782936 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8b194-7a6c-46bf-8952-606f2e160f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:51.783683 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8b194-7a6c-46bf-8952-606f2e160f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:51.785873 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8b194-7a6c-46bf-8952-606f2e160f5c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:51.801007 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 876/1738] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:51.801007 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8b194-7a6c-46bf-8952-606f2e160f5c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:51.801782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b1f8b194-7a6c-46bf-8952-606f2e160f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:51.838783 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 863/1739] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:51.840686 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9989c73-f623-4b2b-a0eb-d91f24ff8e70 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:51.841171 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9989c73-f623-4b2b-a0eb-d91f24ff8e70 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:51.841591 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9989c73-f623-4b2b-a0eb-d91f24ff8e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:51.876382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b9989c73-f623-4b2b-a0eb-d91f24ff8e70 None None] MFA Rules not processed for user `eb6bfd9c259748d0a705cf2780b5c194`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:51.878421 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b9989c73-f623-4b2b-a0eb-d91f24ff8e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:51.901797 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8b194-7a6c-46bf-8952-606f2e160f5c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:51.910422 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74065d-1ba8-4f70-bb1d-dcf08ddb0450 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3622621761f4f18ae3e9dfb5ba99bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:51.911321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74065d-1ba8-4f70-bb1d-dcf08ddb0450 service placement] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:51.911974 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74065d-1ba8-4f70-bb1d-dcf08ddb0450 service placement] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:51.912488 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74065d-1ba8-4f70-bb1d-dcf08ddb0450 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:51.915951 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0f74065d-1ba8-4f70-bb1d-dcf08ddb0450 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:51.930064 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74065d-1ba8-4f70-bb1d-dcf08ddb0450 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:51.932149 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74065d-1ba8-4f70-bb1d-dcf08ddb0450 service placement] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:51.947669 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 877/1740] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:26:51.950761 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74065d-1ba8-4f70-bb1d-dcf08ddb0450 service placement] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:51.955310 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0f74065d-1ba8-4f70-bb1d-dcf08ddb0450 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:51.970214 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:51.978917 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74065d-1ba8-4f70-bb1d-dcf08ddb0450 service placement] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:51.986311 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1f2db-72f7-4d92-a566-80123e55f8fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:51.986835 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1f2db-72f7-4d92-a566-80123e55f8fa service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:51.987180 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1f2db-72f7-4d92-a566-80123e55f8fa service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:51.987551 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1f2db-72f7-4d92-a566-80123e55f8fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:51.997639 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 864/1741] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:52.001223 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9989c73-f623-4b2b-a0eb-d91f24ff8e70 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:52.004638 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1f2db-72f7-4d92-a566-80123e55f8fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:52.008157 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1f2db-72f7-4d92-a566-80123e55f8fa service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:52.020431 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 878/1742] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:26:52.021672 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1f2db-72f7-4d92-a566-80123e55f8fa service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:52.043877 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1f2db-72f7-4d92-a566-80123e55f8fa service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:52.067331 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc754d-25c0-4471-9642-b1de4340a91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:52.067729 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9989c73-f623-4b2b-a0eb-d91f24ff8e70 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:52.068119 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc754d-25c0-4471-9642-b1de4340a91a admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:52.068404 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc754d-25c0-4471-9642-b1de4340a91a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:52.069680 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc754d-25c0-4471-9642-b1de4340a91a admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:52.082696 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc754d-25c0-4471-9642-b1de4340a91a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:26:52.082696 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc754d-25c0-4471-9642-b1de4340a91a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:52.084456 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8365070-904c-4406-8587-aee092ed0610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:52.085840 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8365070-904c-4406-8587-aee092ed0610 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:52.086322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8365070-904c-4406-8587-aee092ed0610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:52.086792 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8365070-904c-4406-8587-aee092ed0610 admin admin] PATH_INFO: `/v3/projects/722f10477e4f4ef782c46fc020328b9d/users/be426d0b740f404ca7f228a65145ac11/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:52.093858 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc754d-25c0-4471-9642-b1de4340a91a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:52.094206 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8365070-904c-4406-8587-aee092ed0610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=722f10477e4f4ef782c46fc020328b9d, user_id=be426d0b740f404ca7f228a65145ac11, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:52.097324 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8365070-904c-4406-8587-aee092ed0610 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:52.128702 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 865/1743] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:26:51 2022] PUT /identity/v3/projects/722f10477e4f4ef782c46fc020328b9d/users/be426d0b740f404ca7f228a65145ac11/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:52.140719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5cf6f-44ae-423b-9fd5-590a08ef4c5f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:52.141182 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5cf6f-44ae-423b-9fd5-590a08ef4c5f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:52.141528 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 879/1744] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:26:52.141849 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5cf6f-44ae-423b-9fd5-590a08ef4c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:52.142714 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc754d-25c0-4471-9642-b1de4340a91a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:52.175714 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc754d-25c0-4471-9642-b1de4340a91a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:52.275511 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8cf5cf6f-44ae-423b-9fd5-590a08ef4c5f None None] MFA Rules not processed for user `be426d0b740f404ca7f228a65145ac11`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:52.278119 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8cf5cf6f-44ae-423b-9fd5-590a08ef4c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:52.417031 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f54d8c-2353-4e09-a074-07a289fa9e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:52.419239 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f54d8c-2353-4e09-a074-07a289fa9e92 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:52.422079 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f54d8c-2353-4e09-a074-07a289fa9e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:52.424058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f54d8c-2353-4e09-a074-07a289fa9e92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:52.424847 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f54d8c-2353-4e09-a074-07a289fa9e92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:52.426806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f54d8c-2353-4e09-a074-07a289fa9e92 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:52.533243 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 880/1745] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:26:52 2022] POST /identity/v3/projects => generated 379 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:52.534674 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f54d8c-2353-4e09-a074-07a289fa9e92 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:52.556624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 866/1746] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:52 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:52.725512 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5cf6f-44ae-423b-9fd5-590a08ef4c5f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:52.727652 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8cf5cf6f-44ae-423b-9fd5-590a08ef4c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:52.740429 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f54d8c-2353-4e09-a074-07a289fa9e92 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:52.750582 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402156a-ea81-4ec7-95bb-6f18ffe83fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:52.752704 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402156a-ea81-4ec7-95bb-6f18ffe83fda admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:52.753383 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402156a-ea81-4ec7-95bb-6f18ffe83fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:52.753721 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402156a-ea81-4ec7-95bb-6f18ffe83fda admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:52.754479 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402156a-ea81-4ec7-95bb-6f18ffe83fda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:52.756489 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402156a-ea81-4ec7-95bb-6f18ffe83fda admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:52.793059 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:52.803984 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 881/1747] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:26:52 2022] POST /identity/v3/users => generated 290 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:52.805585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402156a-ea81-4ec7-95bb-6f18ffe83fda admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:52.843837 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402156a-ea81-4ec7-95bb-6f18ffe83fda admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:52.861604 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac33c38-8921-4ff9-9977-71ffca9d8200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:52.862434 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac33c38-8921-4ff9-9977-71ffca9d8200 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:52.862723 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac33c38-8921-4ff9-9977-71ffca9d8200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:52.863173 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac33c38-8921-4ff9-9977-71ffca9d8200 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:52.863881 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac33c38-8921-4ff9-9977-71ffca9d8200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:52.867829 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac33c38-8921-4ff9-9977-71ffca9d8200 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:52.901667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 882/1748] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:52.901952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5cf6f-44ae-423b-9fd5-590a08ef4c5f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:52.905026 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac33c38-8921-4ff9-9977-71ffca9d8200 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:52.990962 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac33c38-8921-4ff9-9977-71ffca9d8200 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:53.008265 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480350b-a020-4331-aa7c-eaca723be59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:53.014276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480350b-a020-4331-aa7c-eaca723be59d admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:53.017609 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480350b-a020-4331-aa7c-eaca723be59d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:53.017764 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480350b-a020-4331-aa7c-eaca723be59d admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:53.018734 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480350b-a020-4331-aa7c-eaca723be59d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:53.024600 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480350b-a020-4331-aa7c-eaca723be59d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:53.066260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 883/1749] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:53.071390 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480350b-a020-4331-aa7c-eaca723be59d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:53.109063 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480350b-a020-4331-aa7c-eaca723be59d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:53.119077 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20eb61-9f9b-4515-a8c0-a3477ff2e110 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:53.119704 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20eb61-9f9b-4515-a8c0-a3477ff2e110 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:53.119936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20eb61-9f9b-4515-a8c0-a3477ff2e110 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:53.120284 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20eb61-9f9b-4515-a8c0-a3477ff2e110 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:53.122062 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f9e23-3411-4925-b463-b7840621a141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:53.122718 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f9e23-3411-4925-b463-b7840621a141 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:53.124668 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f9e23-3411-4925-b463-b7840621a141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:53.124668 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f9e23-3411-4925-b463-b7840621a141 admin admin] PATH_INFO: `/v3/projects/ecc1b43ca8184b4fb2f4652f8d303978/users/b60ea57169724ec981ba04f0c189f7f8/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:53.172265 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f9e23-3411-4925-b463-b7840621a141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecc1b43ca8184b4fb2f4652f8d303978, user_id=b60ea57169724ec981ba04f0c189f7f8, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:53.182396 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f9e23-3411-4925-b463-b7840621a141 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:53.214943 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 884/1750] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:26:53 2022] PUT /identity/v3/projects/ecc1b43ca8184b4fb2f4652f8d303978/users/b60ea57169724ec981ba04f0c189f7f8/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:53.228916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae75e3d-a86a-4f60-ae37-caca838f8b61 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:53.229360 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae75e3d-a86a-4f60-ae37-caca838f8b61 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:53.229733 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae75e3d-a86a-4f60-ae37-caca838f8b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:53.252811 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:53.342731 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-fae75e3d-a86a-4f60-ae37-caca838f8b61 None None] MFA Rules not processed for user `b60ea57169724ec981ba04f0c189f7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:53.351025 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fae75e3d-a86a-4f60-ae37-caca838f8b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:53.399800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20eb61-9f9b-4515-a8c0-a3477ff2e110 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:53.405496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20eb61-9f9b-4515-a8c0-a3477ff2e110 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:53.459179 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 867/1751] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:52 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 735 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:26:53.465717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b69afc-1ba4-4aca-bcfa-2326a43bb065 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:53.468205 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b69afc-1ba4-4aca-bcfa-2326a43bb065 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:53.468504 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b69afc-1ba4-4aca-bcfa-2326a43bb065 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:53.475234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 868/1752] 10.222.0.94 () {54 vars in 912 bytes} [Thu Sep 1 17:26:53 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:26:53.482204 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a9f01-befa-446d-82fa-8d70310cd2fe None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:53.484748 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a9f01-befa-446d-82fa-8d70310cd2fe None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:53.487231 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a9f01-befa-446d-82fa-8d70310cd2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:53.571320 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6d8a9f01-befa-446d-82fa-8d70310cd2fe None None] MFA Rules not processed for user `92edc2953b8e4e42aa64569335acfc9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:53.574389 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6d8a9f01-befa-446d-82fa-8d70310cd2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:53.597026 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 885/1753] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:53.602322 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae75e3d-a86a-4f60-ae37-caca838f8b61 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:53.819872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae75e3d-a86a-4f60-ae37-caca838f8b61 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:53.832929 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 869/1754] 10.222.0.94 () {58 vars in 1009 bytes} [Thu Sep 1 17:26:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:53.836371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a9f01-befa-446d-82fa-8d70310cd2fe None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:53.866005 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff18fbe-3ad9-411b-949b-7212f9cb8cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:53.869012 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff18fbe-3ad9-411b-949b-7212f9cb8cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:53.870208 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff18fbe-3ad9-411b-949b-7212f9cb8cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:53.871284 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff18fbe-3ad9-411b-949b-7212f9cb8cb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:53.875443 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff18fbe-3ad9-411b-949b-7212f9cb8cb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:53.880178 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff18fbe-3ad9-411b-949b-7212f9cb8cb4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:53.950505 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 886/1755] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:26:53 2022] POST /identity/v3/projects => generated 377 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:53.954192 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:53.959467 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff18fbe-3ad9-411b-949b-7212f9cb8cb4 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:54.006299 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a9f01-befa-446d-82fa-8d70310cd2fe None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:54.072487 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff18fbe-3ad9-411b-949b-7212f9cb8cb4 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:54.084307 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf85f71-c433-49fd-a38e-8fff47a12267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:54.085055 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf85f71-c433-49fd-a38e-8fff47a12267 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:54.086238 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf85f71-c433-49fd-a38e-8fff47a12267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:54.086689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf85f71-c433-49fd-a38e-8fff47a12267 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:54.087811 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf85f71-c433-49fd-a38e-8fff47a12267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:54.094665 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf85f71-c433-49fd-a38e-8fff47a12267 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:54.157608 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 887/1756] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:26:53 2022] POST /identity/v3/users => generated 295 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:26:54.161907 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf85f71-c433-49fd-a38e-8fff47a12267 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:54.181043 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86008ea-e75b-4499-b741-dcf49749e5c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:54.181729 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86008ea-e75b-4499-b741-dcf49749e5c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:54.182016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86008ea-e75b-4499-b741-dcf49749e5c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:54.187486 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86008ea-e75b-4499-b741-dcf49749e5c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:54.202877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b86008ea-e75b-4499-b741-dcf49749e5c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:54.220860 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf85f71-c433-49fd-a38e-8fff47a12267 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:54.239890 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa552fec-239a-4aa3-ae4d-48faf445eeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:54.241777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa552fec-239a-4aa3-ae4d-48faf445eeb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:54.243303 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa552fec-239a-4aa3-ae4d-48faf445eeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:54.243800 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa552fec-239a-4aa3-ae4d-48faf445eeb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:54.245355 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa552fec-239a-4aa3-ae4d-48faf445eeb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:54.248628 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa552fec-239a-4aa3-ae4d-48faf445eeb7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:54.264732 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:54.285744 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 888/1757] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:26:54.289689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa552fec-239a-4aa3-ae4d-48faf445eeb7 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:54.331250 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa552fec-239a-4aa3-ae4d-48faf445eeb7 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:54.353060 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c900fad-dfec-41d7-9103-1dc412d8e7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:54.353786 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c900fad-dfec-41d7-9103-1dc412d8e7f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:54.354067 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c900fad-dfec-41d7-9103-1dc412d8e7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:54.354338 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c900fad-dfec-41d7-9103-1dc412d8e7f0 admin admin] PATH_INFO: `/v3/projects/c455da3d05f348218057235faa0440d3/users/75fbe852c23147cb822d77b9e0ea7c30/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:54.388956 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86008ea-e75b-4499-b741-dcf49749e5c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:54.390525 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86008ea-e75b-4499-b741-dcf49749e5c3 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:54.410168 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c900fad-dfec-41d7-9103-1dc412d8e7f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c455da3d05f348218057235faa0440d3, user_id=75fbe852c23147cb822d77b9e0ea7c30, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:54.414558 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c900fad-dfec-41d7-9103-1dc412d8e7f0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:54.421298 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 870/1758] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:26:54.422091 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86008ea-e75b-4499-b741-dcf49749e5c3 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:54.426199 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b86008ea-e75b-4499-b741-dcf49749e5c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:54.437875 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 889/1759] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:26:54 2022] PUT /identity/v3/projects/c455da3d05f348218057235faa0440d3/users/75fbe852c23147cb822d77b9e0ea7c30/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:54.441829 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c900fad-dfec-41d7-9103-1dc412d8e7f0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:54.642948 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86008ea-e75b-4499-b741-dcf49749e5c3 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:54.702991 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c900fad-dfec-41d7-9103-1dc412d8e7f0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:54.722909 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797557dd-ae98-4d75-945e-540fa7edfad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:54.724682 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797557dd-ae98-4d75-945e-540fa7edfad6 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:54.726813 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797557dd-ae98-4d75-945e-540fa7edfad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:54.727107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797557dd-ae98-4d75-945e-540fa7edfad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:54.729267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797557dd-ae98-4d75-945e-540fa7edfad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:54.735136 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797557dd-ae98-4d75-945e-540fa7edfad6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:54.767186 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec2ac2-305e-4804-baf6-73ab03e5041c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:54.767960 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec2ac2-305e-4804-baf6-73ab03e5041c service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:54.768405 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec2ac2-305e-4804-baf6-73ab03e5041c service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:54.768776 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 890/1760] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:26:54.769033 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec2ac2-305e-4804-baf6-73ab03e5041c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:54.771835 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797557dd-ae98-4d75-945e-540fa7edfad6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:54.798553 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec2ac2-305e-4804-baf6-73ab03e5041c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:54.800289 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec2ac2-305e-4804-baf6-73ab03e5041c service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:54.816024 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797557dd-ae98-4d75-945e-540fa7edfad6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:54.823468 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 871/1761] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:26:54.836337 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f83f14-4de3-4cac-9420-49e3b6c5b9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:54.840069 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f83f14-4de3-4cac-9420-49e3b6c5b9a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:54.840388 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f83f14-4de3-4cac-9420-49e3b6c5b9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:54.841210 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f83f14-4de3-4cac-9420-49e3b6c5b9a8 admin admin] PATH_INFO: `/v3/projects/c455da3d05f348218057235faa0440d3/users/75fbe852c23147cb822d77b9e0ea7c30/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:54.852417 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f83f14-4de3-4cac-9420-49e3b6c5b9a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c455da3d05f348218057235faa0440d3, user_id=75fbe852c23147cb822d77b9e0ea7c30, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:54.860872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f83f14-4de3-4cac-9420-49e3b6c5b9a8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:54.921037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 891/1762] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:26:54 2022] PUT /identity/v3/projects/c455da3d05f348218057235faa0440d3/users/75fbe852c23147cb822d77b9e0ea7c30/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:54.939330 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5debe-301a-4a05-b46b-a5ec1a208a89 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:54.942515 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5debe-301a-4a05-b46b-a5ec1a208a89 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:54.942891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5debe-301a-4a05-b46b-a5ec1a208a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:55.006134 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:55.057100 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-0bc5debe-301a-4a05-b46b-a5ec1a208a89 None None] MFA Rules not processed for user `75fbe852c23147cb822d77b9e0ea7c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:55.059671 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0bc5debe-301a-4a05-b46b-a5ec1a208a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:55.294007 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 872/1763] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:55.323919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f83f14-4de3-4cac-9420-49e3b6c5b9a8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:55.327504 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-19f83f14-4de3-4cac-9420-49e3b6c5b9a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:55.557748 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f83f14-4de3-4cac-9420-49e3b6c5b9a8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:55.569173 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf95be4-4e7e-4e9b-a4b2-0dee645c21d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:55.570152 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf95be4-4e7e-4e9b-a4b2-0dee645c21d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:55.570876 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf95be4-4e7e-4e9b-a4b2-0dee645c21d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:55.572643 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf95be4-4e7e-4e9b-a4b2-0dee645c21d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:55.596825 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf95be4-4e7e-4e9b-a4b2-0dee645c21d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:55.604856 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf95be4-4e7e-4e9b-a4b2-0dee645c21d7 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:55.649886 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 892/1764] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:26:55.855906 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5debe-301a-4a05-b46b-a5ec1a208a89 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:55.869027 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5debe-301a-4a05-b46b-a5ec1a208a89 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:55.879874 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5217ee-96c1-44b7-a119-dac3f7adfbb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:55.880512 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5217ee-96c1-44b7-a119-dac3f7adfbb6 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:55.880792 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5217ee-96c1-44b7-a119-dac3f7adfbb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:55.881918 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5217ee-96c1-44b7-a119-dac3f7adfbb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:56.099656 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5217ee-96c1-44b7-a119-dac3f7adfbb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:56.102277 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5217ee-96c1-44b7-a119-dac3f7adfbb6 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:56.143107 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 873/1765] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:26:56.565465 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d921a6a-6bfd-4a39-a3cb-ec759ef419a0 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:56.566037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d921a6a-6bfd-4a39-a3cb-ec759ef419a0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:56.566216 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d921a6a-6bfd-4a39-a3cb-ec759ef419a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:56.633182 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5217ee-96c1-44b7-a119-dac3f7adfbb6 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:56.635579 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-da5217ee-96c1-44b7-a119-dac3f7adfbb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:56.818943 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5d921a6a-6bfd-4a39-a3cb-ec759ef419a0 None None] MFA Rules not processed for user `9e7444bc40314e73b282217bbb94798d`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:56.826660 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5d921a6a-6bfd-4a39-a3cb-ec759ef419a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:56.920287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5217ee-96c1-44b7-a119-dac3f7adfbb6 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:56.932755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a7c1b-73d8-47c5-9185-61aab275c310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:56.933875 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a7c1b-73d8-47c5-9185-61aab275c310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:56.933996 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a7c1b-73d8-47c5-9185-61aab275c310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:56.934366 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a7c1b-73d8-47c5-9185-61aab275c310 admin admin] PATH_INFO: `/v3/users/904775718c1549c189b0ec714ea551e7` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:56.941330 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a7c1b-73d8-47c5-9185-61aab275c310 admin admin] RBAC: Authorizing `identity:delete_user(user_id=904775718c1549c189b0ec714ea551e7)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:56.945599 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a7c1b-73d8-47c5-9185-61aab275c310 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:56.975537 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:57.070324 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:57.085596 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a45a7c1b-73d8-47c5-9185-61aab275c310 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '904775718c1549c189b0ec714ea551e7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:57.086821 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a45a7c1b-73d8-47c5-9185-61aab275c310 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '904775718c1549c189b0ec714ea551e7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:57.107976 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a45a7c1b-73d8-47c5-9185-61aab275c310 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '904775718c1549c189b0ec714ea551e7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:57.109176 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a45a7c1b-73d8-47c5-9185-61aab275c310 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '904775718c1549c189b0ec714ea551e7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:57.129654 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a45a7c1b-73d8-47c5-9185-61aab275c310 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '904775718c1549c189b0ec714ea551e7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:57.129868 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 893/1766] 10.222.0.94 () {58 vars in 1009 bytes} [Thu Sep 1 17:26:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 566 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:57.178183 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d921a6a-6bfd-4a39-a3cb-ec759ef419a0 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:57.263109 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 874/1767] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:26:56 2022] DELETE /identity/v3/users/904775718c1549c189b0ec714ea551e7 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:57.277996 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289121d0-f999-4cb2-afde-f505f0f1784c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:57.280021 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289121d0-f999-4cb2-afde-f505f0f1784c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:57.281866 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289121d0-f999-4cb2-afde-f505f0f1784c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:57.291642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d921a6a-6bfd-4a39-a3cb-ec759ef419a0 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:57.416039 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-289121d0-f999-4cb2-afde-f505f0f1784c None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:57.428461 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-289121d0-f999-4cb2-afde-f505f0f1784c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:57.662298 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4a6a5-66a5-4ab6-ab31-a0ab2a12f8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:57.666565 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4a6a5-66a5-4ab6-ab31-a0ab2a12f8d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:57.666843 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4a6a5-66a5-4ab6-ab31-a0ab2a12f8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:57.667122 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4a6a5-66a5-4ab6-ab31-a0ab2a12f8d2 admin admin] PATH_INFO: `/v3/users/cb51f4715fc84d8987ede59a3d36908c` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:57.680113 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf4a6a5-66a5-4ab6-ab31-a0ab2a12f8d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb51f4715fc84d8987ede59a3d36908c)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:57.707046 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf4a6a5-66a5-4ab6-ab31-a0ab2a12f8d2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:57.847638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 875/1768] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 572 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:57.848677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289121d0-f999-4cb2-afde-f505f0f1784c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:57.853310 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-289121d0-f999-4cb2-afde-f505f0f1784c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:57.868152 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4bf4a6a5-66a5-4ab6-ab31-a0ab2a12f8d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb51f4715fc84d8987ede59a3d36908c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:57.873223 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4bf4a6a5-66a5-4ab6-ab31-a0ab2a12f8d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb51f4715fc84d8987ede59a3d36908c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:57.926970 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4bf4a6a5-66a5-4ab6-ab31-a0ab2a12f8d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb51f4715fc84d8987ede59a3d36908c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:57.984642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4bf4a6a5-66a5-4ab6-ab31-a0ab2a12f8d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb51f4715fc84d8987ede59a3d36908c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:58.022755 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4bf4a6a5-66a5-4ab6-ab31-a0ab2a12f8d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb51f4715fc84d8987ede59a3d36908c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:26:58.050275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 894/1769] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:26:57 2022] DELETE /identity/v3/users/cb51f4715fc84d8987ede59a3d36908c => generated 0 bytes in 875 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:26:58.053731 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859dc1fb-9426-4fa6-ad63-2c6eedc437a3 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:58.054076 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859dc1fb-9426-4fa6-ad63-2c6eedc437a3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:58.054327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859dc1fb-9426-4fa6-ad63-2c6eedc437a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:58.151363 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-859dc1fb-9426-4fa6-ad63-2c6eedc437a3 None None] MFA Rules not processed for user `754c17cea670481bb43938aaf2e8d7d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:58.152617 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-859dc1fb-9426-4fa6-ad63-2c6eedc437a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:58.296000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289121d0-f999-4cb2-afde-f505f0f1784c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:58.319624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:58.353913 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 895/1770] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:58.357991 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859dc1fb-9426-4fa6-ad63-2c6eedc437a3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:58.360166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-859dc1fb-9426-4fa6-ad63-2c6eedc437a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:58.455682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:26:58.517842 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859dc1fb-9426-4fa6-ad63-2c6eedc437a3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:58.524550 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b49d8e-facf-4a4d-99ed-f7f7b76d933d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:58.525393 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b49d8e-facf-4a4d-99ed-f7f7b76d933d service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:58.525832 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b49d8e-facf-4a4d-99ed-f7f7b76d933d service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:58.526220 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b49d8e-facf-4a4d-99ed-f7f7b76d933d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:58.528741 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-47b49d8e-facf-4a4d-99ed-f7f7b76d933d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:58.586510 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb83e68-010f-48a7-b59c-54e16839a19f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7ebf43f36c4862a3c527941e033666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:58.586942 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb83e68-010f-48a7-b59c-54e16839a19f service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:58.596024 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb83e68-010f-48a7-b59c-54e16839a19f service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:58.596369 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb83e68-010f-48a7-b59c-54e16839a19f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:58.607228 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9eb83e68-010f-48a7-b59c-54e16839a19f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:58.669430 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b49d8e-facf-4a4d-99ed-f7f7b76d933d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:58.673873 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b49d8e-facf-4a4d-99ed-f7f7b76d933d service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:58.714607 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 896/1771] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:26:58.717515 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ac0f1-26e4-48c2-b86c-8ea7e5cd7e82 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:58.719380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ac0f1-26e4-48c2-b86c-8ea7e5cd7e82 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:58.720016 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ac0f1-26e4-48c2-b86c-8ea7e5cd7e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:58.814083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb83e68-010f-48a7-b59c-54e16839a19f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:58.815987 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb83e68-010f-48a7-b59c-54e16839a19f service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:58.823012 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-535ac0f1-26e4-48c2-b86c-8ea7e5cd7e82 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:58.831704 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-535ac0f1-26e4-48c2-b86c-8ea7e5cd7e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:58.854498 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 876/1772] 10.222.0.94 () {60 vars in 1384 bytes} [Thu Sep 1 17:26:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 1005 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 17:26:58.856018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b82c20-64e5-4e58-900f-70c32862e166 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:58.856234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b82c20-64e5-4e58-900f-70c32862e166 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:58.856565 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b82c20-64e5-4e58-900f-70c32862e166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:58.858639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 897/1773] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:58.909626 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-30b82c20-64e5-4e58-900f-70c32862e166 None None] MFA Rules not processed for user `9492a32538da4b0a8dc781e3485ac892`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:26:58.912606 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-30b82c20-64e5-4e58-900f-70c32862e166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:26:58.925956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ac0f1-26e4-48c2-b86c-8ea7e5cd7e82 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:26:58.937815 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ac0f1-26e4-48c2-b86c-8ea7e5cd7e82 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:26:58.951195 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8615410-246f-4378-a826-bce1ab0cbb14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:26:58.951825 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8615410-246f-4378-a826-bce1ab0cbb14 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:58.952094 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8615410-246f-4378-a826-bce1ab0cbb14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:58.952367 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8615410-246f-4378-a826-bce1ab0cbb14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:26:58.987315 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8615410-246f-4378-a826-bce1ab0cbb14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:26:58.989107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8615410-246f-4378-a826-bce1ab0cbb14 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:26:59.032849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 898/1774] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:26:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:26:59.124671 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 877/1775] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:26:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:26:59.952576 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195cc57-efcc-43af-9b8d-218a94b847a1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:26:59.952948 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195cc57-efcc-43af-9b8d-218a94b847a1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:26:59.952948 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195cc57-efcc-43af-9b8d-218a94b847a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:00.002007 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6195cc57-efcc-43af-9b8d-218a94b847a1 None None] MFA Rules not processed for user `92edc2953b8e4e42aa64569335acfc9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:00.008618 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6195cc57-efcc-43af-9b8d-218a94b847a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:00.039485 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 899/1776] 10.222.0.91 () {58 vars in 1015 bytes} [Thu Sep 1 17:26:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:00.127627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b82c20-64e5-4e58-900f-70c32862e166 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:00.130678 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-30b82c20-64e5-4e58-900f-70c32862e166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:00.162703 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b82c20-64e5-4e58-900f-70c32862e166 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:00.173064 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7114e-1e71-496c-931f-3f14030391a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:00.173875 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7114e-1e71-496c-931f-3f14030391a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:00.174157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7114e-1e71-496c-931f-3f14030391a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:00.176478 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7114e-1e71-496c-931f-3f14030391a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:00.220884 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7114e-1e71-496c-931f-3f14030391a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:00.227578 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7114e-1e71-496c-931f-3f14030391a8 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:00.261209 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 878/1777] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:02.460989 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41fbc9-2b9e-461b-8f22-c96e7531bae4 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:02.461521 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41fbc9-2b9e-461b-8f22-c96e7531bae4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:02.461786 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41fbc9-2b9e-461b-8f22-c96e7531bae4 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:02.463533 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 900/1778] 10.222.0.94 () {54 vars in 921 bytes} [Thu Sep 1 17:27:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:27:02.504774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d4473-2afa-4d0a-97d7-bc456faefccc None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:02.505340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d4473-2afa-4d0a-97d7-bc456faefccc None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:02.505636 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d4473-2afa-4d0a-97d7-bc456faefccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:02.598259 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-499d4473-2afa-4d0a-97d7-bc456faefccc None None] MFA Rules not processed for user `8b7fa3c4c5d94b3c9b7f17dde35d39a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:02.608984 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-499d4473-2afa-4d0a-97d7-bc456faefccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:02.831387 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 879/1779] 10.222.0.94 () {58 vars in 1018 bytes} [Thu Sep 1 17:27:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:03.347720 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41fbc9-2b9e-461b-8f22-c96e7531bae4 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:03.349867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0b41fbc9-2b9e-461b-8f22-c96e7531bae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:03.400263 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41fbc9-2b9e-461b-8f22-c96e7531bae4 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:03.418278 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b708965-767d-4eef-b97e-403b4b89debf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:03.422351 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b708965-767d-4eef-b97e-403b4b89debf service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:03.422860 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b708965-767d-4eef-b97e-403b4b89debf service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:03.424042 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b708965-767d-4eef-b97e-403b4b89debf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:03.457359 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b708965-767d-4eef-b97e-403b4b89debf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:03.462140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b708965-767d-4eef-b97e-403b4b89debf service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:03.499740 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 901/1780] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:03.615107 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d4473-2afa-4d0a-97d7-bc456faefccc None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:03.616604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-499d4473-2afa-4d0a-97d7-bc456faefccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:03.625803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:03.654319 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d4473-2afa-4d0a-97d7-bc456faefccc None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:03.665580 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c58a3-7480-4375-8b9f-009b4650606d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:03.669762 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c58a3-7480-4375-8b9f-009b4650606d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:03.670607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c58a3-7480-4375-8b9f-009b4650606d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:03.677216 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c58a3-7480-4375-8b9f-009b4650606d admin admin] PATH_INFO: `/v3/projects/58d7606d13db4e6e8caacae15e2153bc` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:03.686008 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c58a3-7480-4375-8b9f-009b4650606d admin admin] RBAC: Authorizing `identity:delete_project(project_id=58d7606d13db4e6e8caacae15e2153bc)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:03.695630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c58a3-7480-4375-8b9f-009b4650606d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:03.834605 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ba0c58a3-7480-4375-8b9f-009b4650606d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58d7606d13db4e6e8caacae15e2153bc', 'request_id': 'req-ba0c58a3-7480-4375-8b9f-009b4650606d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:03.879921 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ba0c58a3-7480-4375-8b9f-009b4650606d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58d7606d13db4e6e8caacae15e2153bc', 'request_id': 'req-ba0c58a3-7480-4375-8b9f-009b4650606d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:03.895870 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ba0c58a3-7480-4375-8b9f-009b4650606d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58d7606d13db4e6e8caacae15e2153bc', 'request_id': 'req-ba0c58a3-7480-4375-8b9f-009b4650606d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:03.937517 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ba0c58a3-7480-4375-8b9f-009b4650606d admin admin] The token cache is being invalidate because project 58d7606d13db4e6e8caacae15e2153bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:03.937807 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ba0c58a3-7480-4375-8b9f-009b4650606d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:03.941276 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ba0c58a3-7480-4375-8b9f-009b4650606d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:03.945962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 880/1781] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:03 2022] DELETE /identity/v3/projects/58d7606d13db4e6e8caacae15e2153bc => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:03.949900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b708965-767d-4eef-b97e-403b4b89debf service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:03.969185 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b708965-767d-4eef-b97e-403b4b89debf service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:04.153597 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9b100-9d92-4c29-bbe7-c43d034edddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:04.154866 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9b100-9d92-4c29-bbe7-c43d034edddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:04.155884 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9b100-9d92-4c29-bbe7-c43d034edddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:04.156350 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9b100-9d92-4c29-bbe7-c43d034edddc admin admin] PATH_INFO: `/v3/users/be426d0b740f404ca7f228a65145ac11` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:04.160101 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9b100-9d92-4c29-bbe7-c43d034edddc admin admin] RBAC: Authorizing `identity:delete_user(user_id=be426d0b740f404ca7f228a65145ac11)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:04.167002 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9b100-9d92-4c29-bbe7-c43d034edddc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:04.176660 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:04.270374 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9ed9b100-9d92-4c29-bbe7-c43d034edddc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be426d0b740f404ca7f228a65145ac11'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:04.273014 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9ed9b100-9d92-4c29-bbe7-c43d034edddc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be426d0b740f404ca7f228a65145ac11'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:04.312373 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9ed9b100-9d92-4c29-bbe7-c43d034edddc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be426d0b740f404ca7f228a65145ac11'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:04.329788 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9ed9b100-9d92-4c29-bbe7-c43d034edddc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be426d0b740f404ca7f228a65145ac11'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:04.359261 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9ed9b100-9d92-4c29-bbe7-c43d034edddc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be426d0b740f404ca7f228a65145ac11'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:04.370637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 902/1782] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:03 2022] DELETE /identity/v3/users/be426d0b740f404ca7f228a65145ac11 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:04.400572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c58a3-7480-4375-8b9f-009b4650606d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:04.402011 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ba0c58a3-7480-4375-8b9f-009b4650606d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:04.440908 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c58a3-7480-4375-8b9f-009b4650606d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:04.716921 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95348948-5334-4fff-a8db-feb32e6db8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:04.718425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95348948-5334-4fff-a8db-feb32e6db8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:04.719223 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95348948-5334-4fff-a8db-feb32e6db8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:04.721759 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95348948-5334-4fff-a8db-feb32e6db8b4 admin admin] PATH_INFO: `/v3/projects/852c4be565844999968def5a133db78d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:04.735042 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95348948-5334-4fff-a8db-feb32e6db8b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=852c4be565844999968def5a133db78d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:04.745737 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95348948-5334-4fff-a8db-feb32e6db8b4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:04.954679 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-95348948-5334-4fff-a8db-feb32e6db8b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '852c4be565844999968def5a133db78d', 'request_id': 'req-95348948-5334-4fff-a8db-feb32e6db8b4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:04.972373 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-95348948-5334-4fff-a8db-feb32e6db8b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '852c4be565844999968def5a133db78d', 'request_id': 'req-95348948-5334-4fff-a8db-feb32e6db8b4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:04.993042 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-95348948-5334-4fff-a8db-feb32e6db8b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '852c4be565844999968def5a133db78d', 'request_id': 'req-95348948-5334-4fff-a8db-feb32e6db8b4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:05.039966 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-95348948-5334-4fff-a8db-feb32e6db8b4 admin admin] The token cache is being invalidate because project 852c4be565844999968def5a133db78d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:05.043693 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-95348948-5334-4fff-a8db-feb32e6db8b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:05.046606 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-95348948-5334-4fff-a8db-feb32e6db8b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:05.052767 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 881/1783] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:04 2022] DELETE /identity/v3/projects/852c4be565844999968def5a133db78d => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:05.054415 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9b100-9d92-4c29-bbe7-c43d034edddc admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:05.055974 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9ed9b100-9d92-4c29-bbe7-c43d034edddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:05.085535 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9b100-9d92-4c29-bbe7-c43d034edddc admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:05.277949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd535a-a770-4a24-80a4-8b0d0ae36574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:05.278615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd535a-a770-4a24-80a4-8b0d0ae36574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:05.278891 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd535a-a770-4a24-80a4-8b0d0ae36574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:05.279171 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd535a-a770-4a24-80a4-8b0d0ae36574 admin admin] PATH_INFO: `/v3/users/0f0f5412a4804d879a3e636187dc4a17` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:05.280385 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd535a-a770-4a24-80a4-8b0d0ae36574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f0f5412a4804d879a3e636187dc4a17)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:05.282518 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd535a-a770-4a24-80a4-8b0d0ae36574 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:05.420808 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-02bd535a-a770-4a24-80a4-8b0d0ae36574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f0f5412a4804d879a3e636187dc4a17'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:05.421982 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-02bd535a-a770-4a24-80a4-8b0d0ae36574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f0f5412a4804d879a3e636187dc4a17'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:05.470985 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-02bd535a-a770-4a24-80a4-8b0d0ae36574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f0f5412a4804d879a3e636187dc4a17'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:05.481223 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-02bd535a-a770-4a24-80a4-8b0d0ae36574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f0f5412a4804d879a3e636187dc4a17'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:05.504497 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-02bd535a-a770-4a24-80a4-8b0d0ae36574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f0f5412a4804d879a3e636187dc4a17'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:05.507430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95348948-5334-4fff-a8db-feb32e6db8b4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:05.509557 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-95348948-5334-4fff-a8db-feb32e6db8b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:05.522394 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 903/1784] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:05 2022] DELETE /identity/v3/users/0f0f5412a4804d879a3e636187dc4a17 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:27:05.544373 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95348948-5334-4fff-a8db-feb32e6db8b4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:05.565026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:05.799112 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f74b64-a331-4d16-a977-f96e0cf52d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:05.800910 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f74b64-a331-4d16-a977-f96e0cf52d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:05.801514 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f74b64-a331-4d16-a977-f96e0cf52d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:05.804605 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f74b64-a331-4d16-a977-f96e0cf52d04 admin admin] PATH_INFO: `/v3/users/b60ea57169724ec981ba04f0c189f7f8` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:05.809216 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f74b64-a331-4d16-a977-f96e0cf52d04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b60ea57169724ec981ba04f0c189f7f8)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:05.816941 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f74b64-a331-4d16-a977-f96e0cf52d04 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:05.971021 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a6f74b64-a331-4d16-a977-f96e0cf52d04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b60ea57169724ec981ba04f0c189f7f8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:05.972662 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a6f74b64-a331-4d16-a977-f96e0cf52d04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b60ea57169724ec981ba04f0c189f7f8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:05.996401 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a6f74b64-a331-4d16-a977-f96e0cf52d04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b60ea57169724ec981ba04f0c189f7f8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:05.997633 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a6f74b64-a331-4d16-a977-f96e0cf52d04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b60ea57169724ec981ba04f0c189f7f8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:06.032851 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a6f74b64-a331-4d16-a977-f96e0cf52d04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b60ea57169724ec981ba04f0c189f7f8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:06.075184 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd535a-a770-4a24-80a4-8b0d0ae36574 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:06.081157 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-02bd535a-a770-4a24-80a4-8b0d0ae36574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:06.088209 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 882/1785] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:05 2022] DELETE /identity/v3/users/b60ea57169724ec981ba04f0c189f7f8 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:06.092587 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702493c-9407-41d0-92dd-00d50e4d373e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:06.092878 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702493c-9407-41d0-92dd-00d50e4d373e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:06.093148 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702493c-9407-41d0-92dd-00d50e4d373e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:06.108801 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:06.119569 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd535a-a770-4a24-80a4-8b0d0ae36574 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:06.145960 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-1702493c-9407-41d0-92dd-00d50e4d373e None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:06.147542 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1702493c-9407-41d0-92dd-00d50e4d373e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:06.391411 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 883/1786] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:06.427389 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36269286-d22f-4174-af68-ca9e0055dd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:06.429728 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36269286-d22f-4174-af68-ca9e0055dd6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:06.430016 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36269286-d22f-4174-af68-ca9e0055dd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:06.430298 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36269286-d22f-4174-af68-ca9e0055dd6f admin admin] PATH_INFO: `/v3/projects/722f10477e4f4ef782c46fc020328b9d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:06.438407 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36269286-d22f-4174-af68-ca9e0055dd6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=722f10477e4f4ef782c46fc020328b9d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:06.443789 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36269286-d22f-4174-af68-ca9e0055dd6f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:06.466526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702493c-9407-41d0-92dd-00d50e4d373e None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:06.467995 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1702493c-9407-41d0-92dd-00d50e4d373e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:06.644041 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:06.739913 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-36269286-d22f-4174-af68-ca9e0055dd6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '722f10477e4f4ef782c46fc020328b9d', 'request_id': 'req-36269286-d22f-4174-af68-ca9e0055dd6f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:06.747860 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702493c-9407-41d0-92dd-00d50e4d373e None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:06.761139 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-36269286-d22f-4174-af68-ca9e0055dd6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '722f10477e4f4ef782c46fc020328b9d', 'request_id': 'req-36269286-d22f-4174-af68-ca9e0055dd6f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:06.771005 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-36269286-d22f-4174-af68-ca9e0055dd6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '722f10477e4f4ef782c46fc020328b9d', 'request_id': 'req-36269286-d22f-4174-af68-ca9e0055dd6f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:06.791315 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-36269286-d22f-4174-af68-ca9e0055dd6f admin admin] The token cache is being invalidate because project 722f10477e4f4ef782c46fc020328b9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:06.792008 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-36269286-d22f-4174-af68-ca9e0055dd6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:06.792984 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-36269286-d22f-4174-af68-ca9e0055dd6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:06.795289 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 904/1787] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:06 2022] DELETE /identity/v3/projects/722f10477e4f4ef782c46fc020328b9d => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:27:06.811331 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af735a-5434-4be5-9acb-1708327a34c0 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:06.811951 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af735a-5434-4be5-9acb-1708327a34c0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:06.813207 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af735a-5434-4be5-9acb-1708327a34c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:06.842955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-12af735a-5434-4be5-9acb-1708327a34c0 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:06.844829 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-12af735a-5434-4be5-9acb-1708327a34c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:06.938069 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 905/1788] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:06.946962 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c4cb2-218f-45eb-b4c1-d5209b20f302 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:06.948248 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c4cb2-218f-45eb-b4c1-d5209b20f302 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:06.948731 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c4cb2-218f-45eb-b4c1-d5209b20f302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:06.967779 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe1292-9089-45b0-8d9a-c0adfe3b9bff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:06.969085 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe1292-9089-45b0-8d9a-c0adfe3b9bff service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:06.969590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe1292-9089-45b0-8d9a-c0adfe3b9bff service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:06.970001 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe1292-9089-45b0-8d9a-c0adfe3b9bff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:06.979608 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a1fe1292-9089-45b0-8d9a-c0adfe3b9bff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:06.995452 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ed8c4cb2-218f-45eb-b4c1-d5209b20f302 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:06.998696 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ed8c4cb2-218f-45eb-b4c1-d5209b20f302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:07.017907 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 906/1789] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:07.019990 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe1292-9089-45b0-8d9a-c0adfe3b9bff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:07.022543 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe1292-9089-45b0-8d9a-c0adfe3b9bff service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:07.028997 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c4cb2-218f-45eb-b4c1-d5209b20f302 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:07.034536 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 884/1790] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:27:07.055347 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c4cb2-218f-45eb-b4c1-d5209b20f302 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:07.078202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f65b24-0625-4bca-b836-a0839f6a09fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:07.079609 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f65b24-0625-4bca-b836-a0839f6a09fa admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:07.080141 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f65b24-0625-4bca-b836-a0839f6a09fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:07.080605 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f65b24-0625-4bca-b836-a0839f6a09fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:07.082050 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f65b24-0625-4bca-b836-a0839f6a09fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:27:07.083540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f65b24-0625-4bca-b836-a0839f6a09fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:07.086811 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f65b24-0625-4bca-b836-a0839f6a09fa admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:07.119973 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 907/1791] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:27:07.120654 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe1292-9089-45b0-8d9a-c0adfe3b9bff service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:07.133424 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe1292-9089-45b0-8d9a-c0adfe3b9bff service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:07.162620 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f65b24-0625-4bca-b836-a0839f6a09fa admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:07.164753 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8215ad0-b6cd-4101-a480-2e27ba2e4cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:07.165226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-35f65b24-0625-4bca-b836-a0839f6a09fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:07.165479 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8215ad0-b6cd-4101-a480-2e27ba2e4cbd admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:07.165765 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8215ad0-b6cd-4101-a480-2e27ba2e4cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:07.166040 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8215ad0-b6cd-4101-a480-2e27ba2e4cbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:07.168937 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8215ad0-b6cd-4101-a480-2e27ba2e4cbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:07.171305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8215ad0-b6cd-4101-a480-2e27ba2e4cbd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:07.208604 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f65b24-0625-4bca-b836-a0839f6a09fa admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:07.218903 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1558d-4f0c-49e6-80cc-46a04f3f57cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:07.219936 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1558d-4f0c-49e6-80cc-46a04f3f57cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:07.220893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1558d-4f0c-49e6-80cc-46a04f3f57cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:07.221317 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1558d-4f0c-49e6-80cc-46a04f3f57cc admin admin] PATH_INFO: `/v3/users/ca8e5ae28c124480a03eda98fc0f0922` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:07.223115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 885/1792] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:07 2022] POST /identity/v3/projects => generated 407 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:07.223735 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1558d-4f0c-49e6-80cc-46a04f3f57cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca8e5ae28c124480a03eda98fc0f0922)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:07.227949 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8215ad0-b6cd-4101-a480-2e27ba2e4cbd admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:07.228590 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1558d-4f0c-49e6-80cc-46a04f3f57cc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:07.252352 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:07.369394 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8215ad0-b6cd-4101-a480-2e27ba2e4cbd admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:07.390298 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c0d1558d-4f0c-49e6-80cc-46a04f3f57cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca8e5ae28c124480a03eda98fc0f0922'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:07.391455 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c0d1558d-4f0c-49e6-80cc-46a04f3f57cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca8e5ae28c124480a03eda98fc0f0922'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:07.423323 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2b3ae-dc3d-42a7-848d-15dbc98fb16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:07.423905 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2b3ae-dc3d-42a7-848d-15dbc98fb16d admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:07.424209 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2b3ae-dc3d-42a7-848d-15dbc98fb16d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:07.424490 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2b3ae-dc3d-42a7-848d-15dbc98fb16d admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:07.425140 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f2b3ae-dc3d-42a7-848d-15dbc98fb16d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:07.427396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f2b3ae-dc3d-42a7-848d-15dbc98fb16d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:07.431479 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c0d1558d-4f0c-49e6-80cc-46a04f3f57cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca8e5ae28c124480a03eda98fc0f0922'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:07.464472 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c0d1558d-4f0c-49e6-80cc-46a04f3f57cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca8e5ae28c124480a03eda98fc0f0922'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:07.485394 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 886/1793] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:07 2022] POST /identity/v3/users => generated 304 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:07.487137 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2b3ae-dc3d-42a7-848d-15dbc98fb16d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:07.490272 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c0d1558d-4f0c-49e6-80cc-46a04f3f57cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca8e5ae28c124480a03eda98fc0f0922'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:07.503595 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 908/1794] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:07 2022] DELETE /identity/v3/users/ca8e5ae28c124480a03eda98fc0f0922 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:27:07.508916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d95a9a-7874-4a33-91ff-d49077d3c0c0 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:07.510417 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d95a9a-7874-4a33-91ff-d49077d3c0c0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:07.510940 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d95a9a-7874-4a33-91ff-d49077d3c0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:07.530813 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2b3ae-dc3d-42a7-848d-15dbc98fb16d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:07.591023 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e7d95a9a-7874-4a33-91ff-d49077d3c0c0 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:07.592870 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e7d95a9a-7874-4a33-91ff-d49077d3c0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:07.717519 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917a9cf-11f8-4076-88a2-548ea129b600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:07.719574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917a9cf-11f8-4076-88a2-548ea129b600 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:07.721097 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917a9cf-11f8-4076-88a2-548ea129b600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:07.722400 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917a9cf-11f8-4076-88a2-548ea129b600 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:07.723420 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917a9cf-11f8-4076-88a2-548ea129b600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:07.730195 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917a9cf-11f8-4076-88a2-548ea129b600 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:07.735780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:07.763535 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 887/1795] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:07.766922 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917a9cf-11f8-4076-88a2-548ea129b600 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:07.771064 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7917a9cf-11f8-4076-88a2-548ea129b600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:07.794647 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 909/1796] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:07.807304 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917a9cf-11f8-4076-88a2-548ea129b600 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:07.821198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71e81c-7a3c-4702-b196-140e9cefa46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:07.822491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71e81c-7a3c-4702-b196-140e9cefa46b admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:07.822891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71e81c-7a3c-4702-b196-140e9cefa46b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:07.823412 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71e81c-7a3c-4702-b196-140e9cefa46b admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:07.824287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71e81c-7a3c-4702-b196-140e9cefa46b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:07.826230 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71e81c-7a3c-4702-b196-140e9cefa46b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:07.862301 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 888/1797] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:07.862604 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d95a9a-7874-4a33-91ff-d49077d3c0c0 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:07.869200 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71e81c-7a3c-4702-b196-140e9cefa46b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:07.874793 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ca71e81c-7a3c-4702-b196-140e9cefa46b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:07.879876 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d95a9a-7874-4a33-91ff-d49077d3c0c0 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:07.899461 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd601df-6d72-4f10-90ca-306137957c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:07.902093 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd601df-6d72-4f10-90ca-306137957c5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:07.904151 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd601df-6d72-4f10-90ca-306137957c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:07.904721 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd601df-6d72-4f10-90ca-306137957c5e admin admin] PATH_INFO: `/v3/projects/5cf935f125db4f9a9580ee6f441aac21/users/ceddbdc4c3d04021b14b1b972470389f/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:07.955522 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd601df-6d72-4f10-90ca-306137957c5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cf935f125db4f9a9580ee6f441aac21, user_id=ceddbdc4c3d04021b14b1b972470389f, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:07.972200 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd601df-6d72-4f10-90ca-306137957c5e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:07.997605 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71e81c-7a3c-4702-b196-140e9cefa46b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:08.025956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 910/1798] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:07 2022] PUT /identity/v3/projects/5cf935f125db4f9a9580ee6f441aac21/users/ceddbdc4c3d04021b14b1b972470389f/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:08.038059 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e6455-6e4e-4d45-bd5f-24811954074a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:08.038457 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e6455-6e4e-4d45-bd5f-24811954074a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:08.038838 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e6455-6e4e-4d45-bd5f-24811954074a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:08.100965 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739eb6a1-0e87-4f16-b838-fb926383268d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:08.101897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739eb6a1-0e87-4f16-b838-fb926383268d service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:08.102248 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739eb6a1-0e87-4f16-b838-fb926383268d service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:08.102851 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739eb6a1-0e87-4f16-b838-fb926383268d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:08.137707 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2a6e6455-6e4e-4d45-bd5f-24811954074a None None] MFA Rules not processed for user `ceddbdc4c3d04021b14b1b972470389f`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:08.140002 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2a6e6455-6e4e-4d45-bd5f-24811954074a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:08.221221 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739eb6a1-0e87-4f16-b838-fb926383268d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:08.223645 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739eb6a1-0e87-4f16-b838-fb926383268d service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:08.243569 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 889/1799] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:27:08.332228 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:08.365997 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 911/1800] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:08 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:08.370698 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739eb6a1-0e87-4f16-b838-fb926383268d service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:08.392328 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739eb6a1-0e87-4f16-b838-fb926383268d service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:08.399834 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a699dd4-bf9b-45de-a36d-276bd2ce7195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:08.400674 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a699dd4-bf9b-45de-a36d-276bd2ce7195 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:08.401188 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a699dd4-bf9b-45de-a36d-276bd2ce7195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:08.401699 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a699dd4-bf9b-45de-a36d-276bd2ce7195 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:08.402635 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a699dd4-bf9b-45de-a36d-276bd2ce7195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:08.408577 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a699dd4-bf9b-45de-a36d-276bd2ce7195 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:08.462340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 890/1801] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:08 2022] POST /identity/v3/projects => generated 409 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:08.467114 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e6455-6e4e-4d45-bd5f-24811954074a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:08.510792 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e6455-6e4e-4d45-bd5f-24811954074a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:08.710453 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089a992-e364-4ce0-a416-763ff9e9011a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:08.711279 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089a992-e364-4ce0-a416-763ff9e9011a admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:08.711721 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089a992-e364-4ce0-a416-763ff9e9011a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:08.712133 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089a992-e364-4ce0-a416-763ff9e9011a admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:08.712925 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089a992-e364-4ce0-a416-763ff9e9011a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:08.715070 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089a992-e364-4ce0-a416-763ff9e9011a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:08.779899 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 912/1802] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:08 2022] POST /identity/v3/users => generated 311 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:08.781933 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a699dd4-bf9b-45de-a36d-276bd2ce7195 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:08.796777 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a699dd4-bf9b-45de-a36d-276bd2ce7195 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:08.804843 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5abdfa9-c26f-42b8-af96-89dce6e7b84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:08.805857 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abdfa9-c26f-42b8-af96-89dce6e7b84e admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:08.808558 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abdfa9-c26f-42b8-af96-89dce6e7b84e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:08.808917 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abdfa9-c26f-42b8-af96-89dce6e7b84e admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:08.816272 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5abdfa9-c26f-42b8-af96-89dce6e7b84e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:08.816272 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5abdfa9-c26f-42b8-af96-89dce6e7b84e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:08.835638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 891/1803] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:27:08.836871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089a992-e364-4ce0-a416-763ff9e9011a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:08.854040 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089a992-e364-4ce0-a416-763ff9e9011a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:08.868831 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861fb2c-941c-420a-9f69-ef794a943fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:08.869733 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861fb2c-941c-420a-9f69-ef794a943fdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:08.870340 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861fb2c-941c-420a-9f69-ef794a943fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:08.870770 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861fb2c-941c-420a-9f69-ef794a943fdb admin admin] PATH_INFO: `/v3/projects/325b91abc57e4727b592ea8d21447204/users/a2917336f3824dbfbb9a00b08d4435e8/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:08.904177 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861fb2c-941c-420a-9f69-ef794a943fdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=325b91abc57e4727b592ea8d21447204, user_id=a2917336f3824dbfbb9a00b08d4435e8, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:08.907181 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861fb2c-941c-420a-9f69-ef794a943fdb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:08.946088 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5abdfa9-c26f-42b8-af96-89dce6e7b84e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:08.946904 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 913/1804] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:08 2022] PUT /identity/v3/projects/325b91abc57e4727b592ea8d21447204/users/a2917336f3824dbfbb9a00b08d4435e8/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:08.961626 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5abdfa9-c26f-42b8-af96-89dce6e7b84e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:09.017842 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:09.191039 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3077d9d-d0d4-4ea5-a6e4-64cd088f1db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:09.191678 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3077d9d-d0d4-4ea5-a6e4-64cd088f1db0 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:09.191959 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3077d9d-d0d4-4ea5-a6e4-64cd088f1db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:09.192233 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3077d9d-d0d4-4ea5-a6e4-64cd088f1db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:09.192888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3077d9d-d0d4-4ea5-a6e4-64cd088f1db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:09.195123 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3077d9d-d0d4-4ea5-a6e4-64cd088f1db0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:09.238646 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861fb2c-941c-420a-9f69-ef794a943fdb admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:09.251402 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861fb2c-941c-420a-9f69-ef794a943fdb admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:09.251726 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 892/1805] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:09.276908 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617baf3-c71f-478f-bcba-7a7eabc2b7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:09.277829 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617baf3-c71f-478f-bcba-7a7eabc2b7ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:09.278142 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617baf3-c71f-478f-bcba-7a7eabc2b7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:09.285886 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617baf3-c71f-478f-bcba-7a7eabc2b7ba admin admin] PATH_INFO: `/v3/projects/325b91abc57e4727b592ea8d21447204/users/a2917336f3824dbfbb9a00b08d4435e8/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:09.288854 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617baf3-c71f-478f-bcba-7a7eabc2b7ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=325b91abc57e4727b592ea8d21447204, user_id=a2917336f3824dbfbb9a00b08d4435e8, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:09.292715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617baf3-c71f-478f-bcba-7a7eabc2b7ba admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:09.313554 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 914/1806] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:09 2022] PUT /identity/v3/projects/325b91abc57e4727b592ea8d21447204/users/a2917336f3824dbfbb9a00b08d4435e8/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:27:09.326052 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3340536-ec86-4d8d-9ae0-45063e87adab None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:09.326327 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3340536-ec86-4d8d-9ae0-45063e87adab None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:09.326606 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3340536-ec86-4d8d-9ae0-45063e87adab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:09.373958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617baf3-c71f-478f-bcba-7a7eabc2b7ba admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:09.376732 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3617baf3-c71f-478f-bcba-7a7eabc2b7ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:09.379116 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c3340536-ec86-4d8d-9ae0-45063e87adab None None] MFA Rules not processed for user `a2917336f3824dbfbb9a00b08d4435e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:09.381680 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c3340536-ec86-4d8d-9ae0-45063e87adab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:09.623812 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617baf3-c71f-478f-bcba-7a7eabc2b7ba admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:09.646891 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab10e0-1927-4cd5-82a2-5be8f29ec58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:09.651094 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab10e0-1927-4cd5-82a2-5be8f29ec58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:09.651838 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab10e0-1927-4cd5-82a2-5be8f29ec58d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:09.652255 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab10e0-1927-4cd5-82a2-5be8f29ec58d admin admin] PATH_INFO: `/v3/projects/a0379c30f744439e90b5373f2dc31ad9` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:09.656242 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab10e0-1927-4cd5-82a2-5be8f29ec58d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0379c30f744439e90b5373f2dc31ad9)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:09.665040 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab10e0-1927-4cd5-82a2-5be8f29ec58d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:09.675992 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 893/1807] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:09 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:09.682696 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3340536-ec86-4d8d-9ae0-45063e87adab None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:09.684114 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c3340536-ec86-4d8d-9ae0-45063e87adab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:09.782695 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:09.788358 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-09ab10e0-1927-4cd5-82a2-5be8f29ec58d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0379c30f744439e90b5373f2dc31ad9', 'request_id': 'req-09ab10e0-1927-4cd5-82a2-5be8f29ec58d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:09.802902 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-09ab10e0-1927-4cd5-82a2-5be8f29ec58d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0379c30f744439e90b5373f2dc31ad9', 'request_id': 'req-09ab10e0-1927-4cd5-82a2-5be8f29ec58d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:09.811600 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-09ab10e0-1927-4cd5-82a2-5be8f29ec58d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0379c30f744439e90b5373f2dc31ad9', 'request_id': 'req-09ab10e0-1927-4cd5-82a2-5be8f29ec58d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:09.835264 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-09ab10e0-1927-4cd5-82a2-5be8f29ec58d admin admin] The token cache is being invalidate because project a0379c30f744439e90b5373f2dc31ad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:09.835264 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-09ab10e0-1927-4cd5-82a2-5be8f29ec58d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:09.838413 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-09ab10e0-1927-4cd5-82a2-5be8f29ec58d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:09.846689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 915/1808] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:09 2022] DELETE /identity/v3/projects/a0379c30f744439e90b5373f2dc31ad9 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:27:09.856112 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a3638-03b1-4c52-b61f-797306dbd27b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:09.856436 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a3638-03b1-4c52-b61f-797306dbd27b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:09.859325 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a3638-03b1-4c52-b61f-797306dbd27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:09.869170 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3340536-ec86-4d8d-9ae0-45063e87adab None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:09.937431 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-265a3638-03b1-4c52-b61f-797306dbd27b None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:09.940610 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-265a3638-03b1-4c52-b61f-797306dbd27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:10.054417 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 916/1809] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:10.055577 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a3638-03b1-4c52-b61f-797306dbd27b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:10.065496 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-265a3638-03b1-4c52-b61f-797306dbd27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:10.075465 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d979f-d1d8-47a3-b6a1-5c33a74f77ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:10.076119 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d979f-d1d8-47a3-b6a1-5c33a74f77ac service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:10.076388 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d979f-d1d8-47a3-b6a1-5c33a74f77ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:10.076659 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d979f-d1d8-47a3-b6a1-5c33a74f77ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:10.080642 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-602d979f-d1d8-47a3-b6a1-5c33a74f77ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:10.087568 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a3638-03b1-4c52-b61f-797306dbd27b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:10.094458 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311aecd-4cf0-4fcc-b7e4-b60102a45619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:10.095391 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311aecd-4cf0-4fcc-b7e4-b60102a45619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:10.095852 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311aecd-4cf0-4fcc-b7e4-b60102a45619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:10.096331 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311aecd-4cf0-4fcc-b7e4-b60102a45619 admin admin] PATH_INFO: `/v3/projects/ef9e69a78fee4b018b9fc3f08549b85e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:10.103781 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311aecd-4cf0-4fcc-b7e4-b60102a45619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef9e69a78fee4b018b9fc3f08549b85e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:10.107524 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311aecd-4cf0-4fcc-b7e4-b60102a45619 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:10.109243 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:10.274340 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7311aecd-4cf0-4fcc-b7e4-b60102a45619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef9e69a78fee4b018b9fc3f08549b85e', 'request_id': 'req-7311aecd-4cf0-4fcc-b7e4-b60102a45619'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:10.276431 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d979f-d1d8-47a3-b6a1-5c33a74f77ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:10.278010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d979f-d1d8-47a3-b6a1-5c33a74f77ac service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:10.290621 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 894/1810] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:09 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:27:10.298355 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a6110-60d8-40c4-9ba8-4ea8ff245b67 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:10.298355 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a6110-60d8-40c4-9ba8-4ea8ff245b67 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:10.298355 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a6110-60d8-40c4-9ba8-4ea8ff245b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:10.315720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-716a6110-60d8-40c4-9ba8-4ea8ff245b67 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:10.316553 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-716a6110-60d8-40c4-9ba8-4ea8ff245b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:10.320151 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7311aecd-4cf0-4fcc-b7e4-b60102a45619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef9e69a78fee4b018b9fc3f08549b85e', 'request_id': 'req-7311aecd-4cf0-4fcc-b7e4-b60102a45619'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:10.339955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7311aecd-4cf0-4fcc-b7e4-b60102a45619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef9e69a78fee4b018b9fc3f08549b85e', 'request_id': 'req-7311aecd-4cf0-4fcc-b7e4-b60102a45619'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:10.399058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7311aecd-4cf0-4fcc-b7e4-b60102a45619 admin admin] The token cache is being invalidate because project ef9e69a78fee4b018b9fc3f08549b85e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:10.399717 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7311aecd-4cf0-4fcc-b7e4-b60102a45619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:10.404439 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7311aecd-4cf0-4fcc-b7e4-b60102a45619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:10.407870 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 917/1811] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:10 2022] DELETE /identity/v3/projects/ef9e69a78fee4b018b9fc3f08549b85e => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:10.416444 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311aecd-4cf0-4fcc-b7e4-b60102a45619 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:10.421031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 895/1812] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:10.422222 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a6110-60d8-40c4-9ba8-4ea8ff245b67 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:10.423596 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7311aecd-4cf0-4fcc-b7e4-b60102a45619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:10.434151 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a6110-60d8-40c4-9ba8-4ea8ff245b67 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:10.440966 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f16303-0b3f-4817-9dc9-28626cdcdeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:10.441643 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f16303-0b3f-4817-9dc9-28626cdcdeae admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:10.441931 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f16303-0b3f-4817-9dc9-28626cdcdeae admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:10.442205 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f16303-0b3f-4817-9dc9-28626cdcdeae admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:10.442884 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f16303-0b3f-4817-9dc9-28626cdcdeae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:27:10.443168 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f16303-0b3f-4817-9dc9-28626cdcdeae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:10.444816 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f16303-0b3f-4817-9dc9-28626cdcdeae admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:10.458759 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 896/1813] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:27:10.468510 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f16303-0b3f-4817-9dc9-28626cdcdeae admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:10.483852 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311aecd-4cf0-4fcc-b7e4-b60102a45619 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:10.495103 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7106883-70ce-4aa3-97f3-05427ab15b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:10.496407 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7106883-70ce-4aa3-97f3-05427ab15b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:10.496791 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7106883-70ce-4aa3-97f3-05427ab15b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:10.497658 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7106883-70ce-4aa3-97f3-05427ab15b1b admin admin] PATH_INFO: `/v3/users/d07f09fd53c04c77bae022fad7102c08` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:10.499184 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7106883-70ce-4aa3-97f3-05427ab15b1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d07f09fd53c04c77bae022fad7102c08)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:10.502417 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f16303-0b3f-4817-9dc9-28626cdcdeae admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:10.516332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7106883-70ce-4aa3-97f3-05427ab15b1b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:10.518162 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543053c2-5e7f-41a0-b746-6045eee8c79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:10.518818 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543053c2-5e7f-41a0-b746-6045eee8c79d admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:10.519098 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543053c2-5e7f-41a0-b746-6045eee8c79d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:10.519340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543053c2-5e7f-41a0-b746-6045eee8c79d admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:10.519986 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543053c2-5e7f-41a0-b746-6045eee8c79d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:10.526104 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543053c2-5e7f-41a0-b746-6045eee8c79d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:10.587993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 897/1814] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:10 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:10.592061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543053c2-5e7f-41a0-b746-6045eee8c79d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:10.663991 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e7106883-70ce-4aa3-97f3-05427ab15b1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd07f09fd53c04c77bae022fad7102c08'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:10.665120 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e7106883-70ce-4aa3-97f3-05427ab15b1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd07f09fd53c04c77bae022fad7102c08'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:10.673316 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:10.689009 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e7106883-70ce-4aa3-97f3-05427ab15b1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd07f09fd53c04c77bae022fad7102c08'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:10.700760 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e7106883-70ce-4aa3-97f3-05427ab15b1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd07f09fd53c04c77bae022fad7102c08'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:10.711199 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543053c2-5e7f-41a0-b746-6045eee8c79d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:10.719834 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e7106883-70ce-4aa3-97f3-05427ab15b1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd07f09fd53c04c77bae022fad7102c08'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:10.727343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c263efd-ffd7-4de2-b0a0-fc7f979f3357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:10.728124 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c263efd-ffd7-4de2-b0a0-fc7f979f3357 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:10.729329 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c263efd-ffd7-4de2-b0a0-fc7f979f3357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:10.730832 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c263efd-ffd7-4de2-b0a0-fc7f979f3357 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:10.731676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c263efd-ffd7-4de2-b0a0-fc7f979f3357 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:10.739239 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 918/1815] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:10 2022] DELETE /identity/v3/users/d07f09fd53c04c77bae022fad7102c08 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:10.739397 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c263efd-ffd7-4de2-b0a0-fc7f979f3357 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:10.779959 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7106883-70ce-4aa3-97f3-05427ab15b1b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:10.786496 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e7106883-70ce-4aa3-97f3-05427ab15b1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:10.794741 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 898/1816] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:10 2022] POST /identity/v3/users => generated 294 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:10.810861 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c263efd-ffd7-4de2-b0a0-fc7f979f3357 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:10.813222 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1c263efd-ffd7-4de2-b0a0-fc7f979f3357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:10.823109 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:10.946573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c263efd-ffd7-4de2-b0a0-fc7f979f3357 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:10.952278 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7106883-70ce-4aa3-97f3-05427ab15b1b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:10.965061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b49cf4-173a-49a9-9af3-2b6bbc324abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:10.965785 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b49cf4-173a-49a9-9af3-2b6bbc324abe admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:10.966212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b49cf4-173a-49a9-9af3-2b6bbc324abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:10.966428 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b49cf4-173a-49a9-9af3-2b6bbc324abe admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:10.967143 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b49cf4-173a-49a9-9af3-2b6bbc324abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:10.970209 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b49cf4-173a-49a9-9af3-2b6bbc324abe admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:10.995615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 919/1817] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:11.000005 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b49cf4-173a-49a9-9af3-2b6bbc324abe admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:11.019101 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b49cf4-173a-49a9-9af3-2b6bbc324abe admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:11.022382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fec4a1-6d4a-4ec8-ba86-47c8c4ef2104 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:11.023217 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fec4a1-6d4a-4ec8-ba86-47c8c4ef2104 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:11.023849 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fec4a1-6d4a-4ec8-ba86-47c8c4ef2104 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:11.024902 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fec4a1-6d4a-4ec8-ba86-47c8c4ef2104 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:11.028287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-22fec4a1-6d4a-4ec8-ba86-47c8c4ef2104 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:11.033144 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e3a95-2b47-4c20-8ec6-398314791aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:11.033804 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e3a95-2b47-4c20-8ec6-398314791aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:11.034082 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e3a95-2b47-4c20-8ec6-398314791aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:11.034353 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e3a95-2b47-4c20-8ec6-398314791aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:11.035061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e3a95-2b47-4c20-8ec6-398314791aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:11.037391 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e3a95-2b47-4c20-8ec6-398314791aa2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:11.069567 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 920/1818] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:27:11.070626 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e3a95-2b47-4c20-8ec6-398314791aa2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:11.092492 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e3a95-2b47-4c20-8ec6-398314791aa2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:11.098082 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f60b2b-0ef8-401f-89a8-46b1c831ab71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:11.100508 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f60b2b-0ef8-401f-89a8-46b1c831ab71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:11.100999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f60b2b-0ef8-401f-89a8-46b1c831ab71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:11.101282 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f60b2b-0ef8-401f-89a8-46b1c831ab71 admin admin] PATH_INFO: `/v3/projects/0a6abdc7cd534a56826ae03ab3abddba/users/ff6e000b33284694b1e3129cc6c38579/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:11.137312 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f60b2b-0ef8-401f-89a8-46b1c831ab71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a6abdc7cd534a56826ae03ab3abddba, user_id=ff6e000b33284694b1e3129cc6c38579, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:11.140802 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f60b2b-0ef8-401f-89a8-46b1c831ab71 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:11.176043 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 921/1819] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:11 2022] PUT /identity/v3/projects/0a6abdc7cd534a56826ae03ab3abddba/users/ff6e000b33284694b1e3129cc6c38579/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:11.189727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fec4a1-6d4a-4ec8-ba86-47c8c4ef2104 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:11.190719 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09340784-2055-410b-b3a0-ee8d650738bb None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:11.191340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fec4a1-6d4a-4ec8-ba86-47c8c4ef2104 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:11.192149 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09340784-2055-410b-b3a0-ee8d650738bb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:11.192709 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09340784-2055-410b-b3a0-ee8d650738bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:11.204160 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 899/1820] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:10 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:11.264345 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fec4a1-6d4a-4ec8-ba86-47c8c4ef2104 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:11.266587 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-22fec4a1-6d4a-4ec8-ba86-47c8c4ef2104 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:11.274370 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-09340784-2055-410b-b3a0-ee8d650738bb None None] MFA Rules not processed for user `ff6e000b33284694b1e3129cc6c38579`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:11.287638 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-09340784-2055-410b-b3a0-ee8d650738bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:11.326918 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fec4a1-6d4a-4ec8-ba86-47c8c4ef2104 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:11.483153 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 922/1821] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:27:11.486673 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09340784-2055-410b-b3a0-ee8d650738bb None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:11.490023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed8d54-e3be-4475-be4a-f384fc787e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:11.491218 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed8d54-e3be-4475-be4a-f384fc787e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:11.491505 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed8d54-e3be-4475-be4a-f384fc787e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:11.491779 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed8d54-e3be-4475-be4a-f384fc787e1a admin admin] PATH_INFO: `/v3/projects/ecc1b43ca8184b4fb2f4652f8d303978` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:11.498154 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed8d54-e3be-4475-be4a-f384fc787e1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecc1b43ca8184b4fb2f4652f8d303978)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:11.503346 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed8d54-e3be-4475-be4a-f384fc787e1a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:11.509349 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09340784-2055-410b-b3a0-ee8d650738bb None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:11.524767 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3d92d-0447-4c7d-bbda-ecfe6a19d7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:11.525702 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3d92d-0447-4c7d-bbda-ecfe6a19d7bc admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:11.526141 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3d92d-0447-4c7d-bbda-ecfe6a19d7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:11.526581 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3d92d-0447-4c7d-bbda-ecfe6a19d7bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:11.527425 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3d92d-0447-4c7d-bbda-ecfe6a19d7bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:11.530471 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3d92d-0447-4c7d-bbda-ecfe6a19d7bc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:11.555444 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:11.616250 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:11.640055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b8ed8d54-e3be-4475-be4a-f384fc787e1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecc1b43ca8184b4fb2f4652f8d303978', 'request_id': 'req-b8ed8d54-e3be-4475-be4a-f384fc787e1a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:11.653783 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 923/1822] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:11 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:11.655763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3d92d-0447-4c7d-bbda-ecfe6a19d7bc admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:11.659246 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b8ed8d54-e3be-4475-be4a-f384fc787e1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecc1b43ca8184b4fb2f4652f8d303978', 'request_id': 'req-b8ed8d54-e3be-4475-be4a-f384fc787e1a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:11.676390 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b8ed8d54-e3be-4475-be4a-f384fc787e1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecc1b43ca8184b4fb2f4652f8d303978', 'request_id': 'req-b8ed8d54-e3be-4475-be4a-f384fc787e1a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:11.724235 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b8ed8d54-e3be-4475-be4a-f384fc787e1a admin admin] The token cache is being invalidate because project ecc1b43ca8184b4fb2f4652f8d303978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:11.733871 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b8ed8d54-e3be-4475-be4a-f384fc787e1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:11.735674 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b8ed8d54-e3be-4475-be4a-f384fc787e1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:11.742160 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 900/1823] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:11 2022] DELETE /identity/v3/projects/ecc1b43ca8184b4fb2f4652f8d303978 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:11.745723 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed8d54-e3be-4475-be4a-f384fc787e1a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:11.747866 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b8ed8d54-e3be-4475-be4a-f384fc787e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:11.916462 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3d92d-0447-4c7d-bbda-ecfe6a19d7bc admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:11.951019 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe907311-e987-43b7-8a8f-5bfaa71c90e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:11.951966 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe907311-e987-43b7-8a8f-5bfaa71c90e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:11.953593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe907311-e987-43b7-8a8f-5bfaa71c90e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:11.954019 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe907311-e987-43b7-8a8f-5bfaa71c90e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:11.960377 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe907311-e987-43b7-8a8f-5bfaa71c90e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:11.962671 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe907311-e987-43b7-8a8f-5bfaa71c90e6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:11.970036 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed8d54-e3be-4475-be4a-f384fc787e1a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:11.986605 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d6302-4584-439b-8944-db3c75b48c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:11.988372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d6302-4584-439b-8944-db3c75b48c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:11.989962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d6302-4584-439b-8944-db3c75b48c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:11.991897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d6302-4584-439b-8944-db3c75b48c12 admin admin] PATH_INFO: `/v3/users/75fbe852c23147cb822d77b9e0ea7c30` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:11.994894 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d6302-4584-439b-8944-db3c75b48c12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75fbe852c23147cb822d77b9e0ea7c30)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:12.000464 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d6302-4584-439b-8944-db3c75b48c12 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:12.022810 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 924/1824] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:11 2022] POST /identity/v3/users => generated 300 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:12.023945 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe907311-e987-43b7-8a8f-5bfaa71c90e6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:12.034806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fe907311-e987-43b7-8a8f-5bfaa71c90e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:12.063891 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe907311-e987-43b7-8a8f-5bfaa71c90e6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:12.088026 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ad2a0-2203-4340-a89c-31dd1294c761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:12.088948 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ad2a0-2203-4340-a89c-31dd1294c761 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:12.089489 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ad2a0-2203-4340-a89c-31dd1294c761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:12.090942 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ad2a0-2203-4340-a89c-31dd1294c761 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:12.096533 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ad2a0-2203-4340-a89c-31dd1294c761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:12.098506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ad2a0-2203-4340-a89c-31dd1294c761 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:12.132576 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 925/1825] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:12.133998 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ad2a0-2203-4340-a89c-31dd1294c761 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:12.148007 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4c8d6302-4584-439b-8944-db3c75b48c12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75fbe852c23147cb822d77b9e0ea7c30'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:12.149483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4c8d6302-4584-439b-8944-db3c75b48c12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75fbe852c23147cb822d77b9e0ea7c30'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:12.160099 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ad2a0-2203-4340-a89c-31dd1294c761 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:12.168898 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4c8d6302-4584-439b-8944-db3c75b48c12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75fbe852c23147cb822d77b9e0ea7c30'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:12.170160 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4c8d6302-4584-439b-8944-db3c75b48c12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75fbe852c23147cb822d77b9e0ea7c30'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:12.175369 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69d1a4-8b61-41f7-b28d-a09cb98c7977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:12.176611 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69d1a4-8b61-41f7-b28d-a09cb98c7977 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:12.177357 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69d1a4-8b61-41f7-b28d-a09cb98c7977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:12.177948 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69d1a4-8b61-41f7-b28d-a09cb98c7977 admin admin] PATH_INFO: `/v3/projects/6e45e00c5f7f40b698b61edd0ff3bb36/users/e0218c69e5684d24b677a9f4560feba3/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:12.189800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4c8d6302-4584-439b-8944-db3c75b48c12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75fbe852c23147cb822d77b9e0ea7c30'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:12.213909 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69d1a4-8b61-41f7-b28d-a09cb98c7977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e45e00c5f7f40b698b61edd0ff3bb36, user_id=e0218c69e5684d24b677a9f4560feba3, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:12.216882 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69d1a4-8b61-41f7-b28d-a09cb98c7977 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:12.245011 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 901/1826] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:11 2022] DELETE /identity/v3/users/75fbe852c23147cb822d77b9e0ea7c30 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:12.251907 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 926/1827] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:12 2022] PUT /identity/v3/projects/6e45e00c5f7f40b698b61edd0ff3bb36/users/e0218c69e5684d24b677a9f4560feba3/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:12.252606 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d6302-4584-439b-8944-db3c75b48c12 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:12.254161 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4c8d6302-4584-439b-8944-db3c75b48c12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:12.361243 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:12.449600 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d6302-4584-439b-8944-db3c75b48c12 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:12.455736 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f1d4d-3437-4d4a-8621-7613d352a447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:12.456248 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f1d4d-3437-4d4a-8621-7613d352a447 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:12.457039 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f1d4d-3437-4d4a-8621-7613d352a447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:12.457453 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f1d4d-3437-4d4a-8621-7613d352a447 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:12.458439 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f1d4d-3437-4d4a-8621-7613d352a447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:12.459998 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f1d4d-3437-4d4a-8621-7613d352a447 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:12.473932 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 902/1828] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:12.478231 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69d1a4-8b61-41f7-b28d-a09cb98c7977 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:12.574912 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69d1a4-8b61-41f7-b28d-a09cb98c7977 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:12.582538 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944d05e-c3ad-4dc7-a0af-6eab11ffceaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:12.583782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944d05e-c3ad-4dc7-a0af-6eab11ffceaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:12.584067 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944d05e-c3ad-4dc7-a0af-6eab11ffceaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:12.584421 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944d05e-c3ad-4dc7-a0af-6eab11ffceaa admin admin] PATH_INFO: `/v3/projects/6e45e00c5f7f40b698b61edd0ff3bb36/users/e0218c69e5684d24b677a9f4560feba3/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:12.587938 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3944d05e-c3ad-4dc7-a0af-6eab11ffceaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e45e00c5f7f40b698b61edd0ff3bb36, user_id=e0218c69e5684d24b677a9f4560feba3, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:12.588803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fbd33-0591-43ed-9ac5-45b2d872f93f None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:12.589679 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fbd33-0591-43ed-9ac5-45b2d872f93f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:12.590179 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fbd33-0591-43ed-9ac5-45b2d872f93f None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:12.590498 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3944d05e-c3ad-4dc7-a0af-6eab11ffceaa admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:12.592364 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 903/1829] 10.222.0.94 () {54 vars in 921 bytes} [Thu Sep 1 17:27:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:27:12.605442 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 927/1830] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:12 2022] PUT /identity/v3/projects/6e45e00c5f7f40b698b61edd0ff3bb36/users/e0218c69e5684d24b677a9f4560feba3/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:27:12.616530 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e30101-1ae8-45d6-a562-34057e740d71 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:12.616808 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e30101-1ae8-45d6-a562-34057e740d71 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:12.617101 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e30101-1ae8-45d6-a562-34057e740d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:12.631273 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc3fac-e3e4-424e-86ad-47157d62afeb None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:12.632151 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc3fac-e3e4-424e-86ad-47157d62afeb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:12.632590 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc3fac-e3e4-424e-86ad-47157d62afeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:12.665900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c5dc3fac-e3e4-424e-86ad-47157d62afeb None None] MFA Rules not processed for user `8b7fa3c4c5d94b3c9b7f17dde35d39a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:12.670426 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c5dc3fac-e3e4-424e-86ad-47157d62afeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:12.681094 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-66e30101-1ae8-45d6-a562-34057e740d71 None None] MFA Rules not processed for user `e0218c69e5684d24b677a9f4560feba3`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:12.682114 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-66e30101-1ae8-45d6-a562-34057e740d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:12.761987 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:12.835151 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 928/1831] 10.222.0.94 () {58 vars in 1018 bytes} [Thu Sep 1 17:27:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:27:12.859827 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 904/1832] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:12 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:12.873480 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc3fac-e3e4-424e-86ad-47157d62afeb None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:12.875101 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c5dc3fac-e3e4-424e-86ad-47157d62afeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:12.949209 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc3fac-e3e4-424e-86ad-47157d62afeb None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:12.955758 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0bf014-ccdb-4fee-b1c8-f50975536290 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:12.956753 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bf014-ccdb-4fee-b1c8-f50975536290 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:12.957107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bf014-ccdb-4fee-b1c8-f50975536290 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:12.957385 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bf014-ccdb-4fee-b1c8-f50975536290 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:12.970082 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0bf014-ccdb-4fee-b1c8-f50975536290 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:12.971717 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0bf014-ccdb-4fee-b1c8-f50975536290 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:12.994834 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 929/1833] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:12 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:13.034337 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e30101-1ae8-45d6-a562-34057e740d71 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:13.036203 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-66e30101-1ae8-45d6-a562-34057e740d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:13.043784 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0bf014-ccdb-4fee-b1c8-f50975536290 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:13.046870 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1e0bf014-ccdb-4fee-b1c8-f50975536290 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:13.060999 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e30101-1ae8-45d6-a562-34057e740d71 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:13.070017 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b7a28-b023-4e95-a259-8dae1770d77f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:13.070835 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b7a28-b023-4e95-a259-8dae1770d77f service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:13.071123 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b7a28-b023-4e95-a259-8dae1770d77f service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:13.071399 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b7a28-b023-4e95-a259-8dae1770d77f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:13.084165 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b7a28-b023-4e95-a259-8dae1770d77f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:13.086646 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b7a28-b023-4e95-a259-8dae1770d77f service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:13.114668 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 905/1834] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:13.119751 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b7a28-b023-4e95-a259-8dae1770d77f service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:13.196521 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0bf014-ccdb-4fee-b1c8-f50975536290 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:13.211213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014bebd-eb2d-4f9f-963f-24d5aa461724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:13.212067 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014bebd-eb2d-4f9f-963f-24d5aa461724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:13.213272 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014bebd-eb2d-4f9f-963f-24d5aa461724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:13.213602 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014bebd-eb2d-4f9f-963f-24d5aa461724 admin admin] PATH_INFO: `/v3/projects/c4690597a50a4e4cb00ebd50ef61125d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:13.215354 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e014bebd-eb2d-4f9f-963f-24d5aa461724 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4690597a50a4e4cb00ebd50ef61125d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:13.218470 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e014bebd-eb2d-4f9f-963f-24d5aa461724 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:13.323221 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e014bebd-eb2d-4f9f-963f-24d5aa461724 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4690597a50a4e4cb00ebd50ef61125d', 'request_id': 'req-e014bebd-eb2d-4f9f-963f-24d5aa461724'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:13.336693 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e014bebd-eb2d-4f9f-963f-24d5aa461724 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4690597a50a4e4cb00ebd50ef61125d', 'request_id': 'req-e014bebd-eb2d-4f9f-963f-24d5aa461724'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:13.345342 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e014bebd-eb2d-4f9f-963f-24d5aa461724 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4690597a50a4e4cb00ebd50ef61125d', 'request_id': 'req-e014bebd-eb2d-4f9f-963f-24d5aa461724'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:13.364688 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b7a28-b023-4e95-a259-8dae1770d77f service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:13.369204 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e014bebd-eb2d-4f9f-963f-24d5aa461724 admin admin] The token cache is being invalidate because project c4690597a50a4e4cb00ebd50ef61125d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:13.369595 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e014bebd-eb2d-4f9f-963f-24d5aa461724 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:13.370283 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e014bebd-eb2d-4f9f-963f-24d5aa461724 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:13.376908 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 930/1835] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:13 2022] DELETE /identity/v3/projects/c4690597a50a4e4cb00ebd50ef61125d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:13.378914 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014bebd-eb2d-4f9f-963f-24d5aa461724 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:13.380423 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e014bebd-eb2d-4f9f-963f-24d5aa461724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:13.422938 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:13.448906 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:13.492322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eda86c-070b-4fac-97e6-10c05b370302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:13.493257 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eda86c-070b-4fac-97e6-10c05b370302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:13.493665 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eda86c-070b-4fac-97e6-10c05b370302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:13.494307 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eda86c-070b-4fac-97e6-10c05b370302 admin admin] PATH_INFO: `/v3/users/ff6e000b33284694b1e3129cc6c38579` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:13.496296 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eda86c-070b-4fac-97e6-10c05b370302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff6e000b33284694b1e3129cc6c38579)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:13.499129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eda86c-070b-4fac-97e6-10c05b370302 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:13.545086 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014bebd-eb2d-4f9f-963f-24d5aa461724 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:13.565313 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cddeaf-f167-4326-9986-7f2ded3d4e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:13.565313 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cddeaf-f167-4326-9986-7f2ded3d4e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:13.565313 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cddeaf-f167-4326-9986-7f2ded3d4e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:13.565313 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cddeaf-f167-4326-9986-7f2ded3d4e71 admin admin] PATH_INFO: `/v3/projects/c455da3d05f348218057235faa0440d3` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:13.568443 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cddeaf-f167-4326-9986-7f2ded3d4e71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c455da3d05f348218057235faa0440d3)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:13.573716 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cddeaf-f167-4326-9986-7f2ded3d4e71 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:13.629235 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a6eda86c-070b-4fac-97e6-10c05b370302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff6e000b33284694b1e3129cc6c38579'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:13.630140 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a6eda86c-070b-4fac-97e6-10c05b370302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff6e000b33284694b1e3129cc6c38579'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:13.651203 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a6eda86c-070b-4fac-97e6-10c05b370302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff6e000b33284694b1e3129cc6c38579'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:13.652524 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a6eda86c-070b-4fac-97e6-10c05b370302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff6e000b33284694b1e3129cc6c38579'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:13.666224 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a6eda86c-070b-4fac-97e6-10c05b370302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff6e000b33284694b1e3129cc6c38579'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:13.681866 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f2cddeaf-f167-4326-9986-7f2ded3d4e71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c455da3d05f348218057235faa0440d3', 'request_id': 'req-f2cddeaf-f167-4326-9986-7f2ded3d4e71'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:13.689861 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f2cddeaf-f167-4326-9986-7f2ded3d4e71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c455da3d05f348218057235faa0440d3', 'request_id': 'req-f2cddeaf-f167-4326-9986-7f2ded3d4e71'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:13.697697 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f2cddeaf-f167-4326-9986-7f2ded3d4e71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c455da3d05f348218057235faa0440d3', 'request_id': 'req-f2cddeaf-f167-4326-9986-7f2ded3d4e71'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:13.703962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 906/1836] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:13 2022] DELETE /identity/v3/users/ff6e000b33284694b1e3129cc6c38579 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:13.706403 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87a96e-1b2f-4650-b0c8-bcd163421a0d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:13.707236 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87a96e-1b2f-4650-b0c8-bcd163421a0d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:13.707615 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87a96e-1b2f-4650-b0c8-bcd163421a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:13.718633 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f2cddeaf-f167-4326-9986-7f2ded3d4e71 admin admin] The token cache is being invalidate because project c455da3d05f348218057235faa0440d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:13.718926 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f2cddeaf-f167-4326-9986-7f2ded3d4e71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:13.719615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f2cddeaf-f167-4326-9986-7f2ded3d4e71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:13.721388 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 931/1837] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:13 2022] DELETE /identity/v3/projects/c455da3d05f348218057235faa0440d3 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:13.722640 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0da86-9251-4760-8b8e-17b741814e1c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:13.722920 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0da86-9251-4760-8b8e-17b741814e1c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:13.723191 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0da86-9251-4760-8b8e-17b741814e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:13.738551 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ee87a96e-1b2f-4650-b0c8-bcd163421a0d None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:13.741097 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ee87a96e-1b2f-4650-b0c8-bcd163421a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:13.748599 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-78c0da86-9251-4760-8b8e-17b741814e1c None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:13.750502 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-78c0da86-9251-4760-8b8e-17b741814e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:13.825218 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 907/1838] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:13.826399 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28f124-4fa3-44be-8597-3a233544814b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:13.826687 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28f124-4fa3-44be-8597-3a233544814b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:13.826991 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28f124-4fa3-44be-8597-3a233544814b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:13.832177 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 932/1839] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:13.834669 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d27006-6809-4047-a2d7-b25e9b09eda8 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:13.835841 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d27006-6809-4047-a2d7-b25e9b09eda8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:13.836157 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d27006-6809-4047-a2d7-b25e9b09eda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:13.852771 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3c28f124-4fa3-44be-8597-3a233544814b None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:13.854310 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3c28f124-4fa3-44be-8597-3a233544814b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:13.860911 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b5d27006-6809-4047-a2d7-b25e9b09eda8 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:13.862309 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b5d27006-6809-4047-a2d7-b25e9b09eda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:13.866087 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 908/1840] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:13.866087 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28f124-4fa3-44be-8597-3a233544814b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:13.866301 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3c28f124-4fa3-44be-8597-3a233544814b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:13.872944 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 933/1841] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:13.874461 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d9872-7c39-485a-9426-c65ae6d1b930 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:13.874893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d9872-7c39-485a-9426-c65ae6d1b930 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:13.875327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d9872-7c39-485a-9426-c65ae6d1b930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:13.902755 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-985d9872-7c39-485a-9426-c65ae6d1b930 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:13.904244 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-985d9872-7c39-485a-9426-c65ae6d1b930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:13.914200 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 934/1842] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:13.915250 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d9872-7c39-485a-9426-c65ae6d1b930 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:13.925914 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d9872-7c39-485a-9426-c65ae6d1b930 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:13.936809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa860b84-3521-48a1-b781-d755d9368726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:13.937462 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa860b84-3521-48a1-b781-d755d9368726 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:13.937746 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa860b84-3521-48a1-b781-d755d9368726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:13.938024 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa860b84-3521-48a1-b781-d755d9368726 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:13.938688 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa860b84-3521-48a1-b781-d755d9368726 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:27:13.938994 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa860b84-3521-48a1-b781-d755d9368726 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:13.941230 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa860b84-3521-48a1-b781-d755d9368726 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:13.948084 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28f124-4fa3-44be-8597-3a233544814b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:13.954876 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce1a49-4efb-45fd-a780-62cee414794c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:13.955502 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce1a49-4efb-45fd-a780-62cee414794c service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:13.955782 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce1a49-4efb-45fd-a780-62cee414794c service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:13.956192 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce1a49-4efb-45fd-a780-62cee414794c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:13.957568 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 935/1843] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:27:13.958428 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa860b84-3521-48a1-b781-d755d9368726 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:13.966990 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:13.972411 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce1a49-4efb-45fd-a780-62cee414794c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:13.973648 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa860b84-3521-48a1-b781-d755d9368726 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:13.974207 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce1a49-4efb-45fd-a780-62cee414794c service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:13.980222 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a23e4e-ef1d-4c55-97a8-a7dc5efb472e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:13.980954 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a23e4e-ef1d-4c55-97a8-a7dc5efb472e admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:13.981264 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a23e4e-ef1d-4c55-97a8-a7dc5efb472e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:13.981573 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a23e4e-ef1d-4c55-97a8-a7dc5efb472e admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:13.982221 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a23e4e-ef1d-4c55-97a8-a7dc5efb472e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:27:13.982524 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a23e4e-ef1d-4c55-97a8-a7dc5efb472e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:13.984321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a23e4e-ef1d-4c55-97a8-a7dc5efb472e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:13.987215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 909/1844] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:13.988181 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce1a49-4efb-45fd-a780-62cee414794c service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:13.998647 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce1a49-4efb-45fd-a780-62cee414794c service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:14.004269 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8c991-9291-448b-9fef-b8d5a33c9be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:14.004884 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8c991-9291-448b-9fef-b8d5a33c9be2 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:14.005164 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8c991-9291-448b-9fef-b8d5a33c9be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:14.005463 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8c991-9291-448b-9fef-b8d5a33c9be2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:14.006296 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8c991-9291-448b-9fef-b8d5a33c9be2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:14.008525 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8c991-9291-448b-9fef-b8d5a33c9be2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:14.016875 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 936/1845] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:27:14.020994 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a23e4e-ef1d-4c55-97a8-a7dc5efb472e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:14.030205 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:14.036058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a23e4e-ef1d-4c55-97a8-a7dc5efb472e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:14.044619 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa52096-2a39-49c8-80f6-73daeb32808a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:14.046011 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa52096-2a39-49c8-80f6-73daeb32808a admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:14.046594 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa52096-2a39-49c8-80f6-73daeb32808a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:14.047009 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa52096-2a39-49c8-80f6-73daeb32808a admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:14.048242 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa52096-2a39-49c8-80f6-73daeb32808a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:14.051751 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa52096-2a39-49c8-80f6-73daeb32808a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:14.057776 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 910/1846] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:13 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:14.062743 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8c991-9291-448b-9fef-b8d5a33c9be2 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:14.110643 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 937/1847] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:14 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:27:14.114809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa52096-2a39-49c8-80f6-73daeb32808a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:14.194824 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8c991-9291-448b-9fef-b8d5a33c9be2 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:14.200262 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa52096-2a39-49c8-80f6-73daeb32808a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:14.208204 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42b192-b819-4da5-a206-1a90cb24581f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:14.209041 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42b192-b819-4da5-a206-1a90cb24581f admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:14.210155 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42b192-b819-4da5-a206-1a90cb24581f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:14.210637 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42b192-b819-4da5-a206-1a90cb24581f admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:14.211343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee42b192-b819-4da5-a206-1a90cb24581f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:14.213955 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee42b192-b819-4da5-a206-1a90cb24581f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:14.216352 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344dad4c-1191-4581-9b9e-f5c5a6d10c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:14.220150 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dad4c-1191-4581-9b9e-f5c5a6d10c54 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:14.220519 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dad4c-1191-4581-9b9e-f5c5a6d10c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:14.221204 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dad4c-1191-4581-9b9e-f5c5a6d10c54 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:14.221976 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344dad4c-1191-4581-9b9e-f5c5a6d10c54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:14.224187 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344dad4c-1191-4581-9b9e-f5c5a6d10c54 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:14.248900 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 911/1848] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:14 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:27:14.251569 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 938/1849] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:14 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:14.255928 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344dad4c-1191-4581-9b9e-f5c5a6d10c54 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:14.256877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42b192-b819-4da5-a206-1a90cb24581f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:14.268827 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42b192-b819-4da5-a206-1a90cb24581f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:14.273594 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344dad4c-1191-4581-9b9e-f5c5a6d10c54 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:14.273739 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ae653-c74c-4cfc-8052-91bc878f329f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:14.274356 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ae653-c74c-4cfc-8052-91bc878f329f admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:14.274635 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ae653-c74c-4cfc-8052-91bc878f329f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:14.274974 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ae653-c74c-4cfc-8052-91bc878f329f admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:14.275556 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ae653-c74c-4cfc-8052-91bc878f329f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:14.277186 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ae653-c74c-4cfc-8052-91bc878f329f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:14.282839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87e7d1-6eaa-4df5-9b31-e10363a89452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:14.283541 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87e7d1-6eaa-4df5-9b31-e10363a89452 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:14.283898 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87e7d1-6eaa-4df5-9b31-e10363a89452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:14.284240 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87e7d1-6eaa-4df5-9b31-e10363a89452 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:14.285469 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87e7d1-6eaa-4df5-9b31-e10363a89452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:14.292636 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 912/1850] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:14.294410 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ae653-c74c-4cfc-8052-91bc878f329f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:14.295543 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87e7d1-6eaa-4df5-9b31-e10363a89452 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:14.307661 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ae653-c74c-4cfc-8052-91bc878f329f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:14.313329 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a16b8-e434-4009-80c0-c70dcc91b9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:14.317058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 939/1851] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:14.317761 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a16b8-e434-4009-80c0-c70dcc91b9ea admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:14.318191 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a16b8-e434-4009-80c0-c70dcc91b9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:14.319731 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87e7d1-6eaa-4df5-9b31-e10363a89452 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:14.320046 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a16b8-e434-4009-80c0-c70dcc91b9ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:14.321137 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a16b8-e434-4009-80c0-c70dcc91b9ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:14.323139 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a16b8-e434-4009-80c0-c70dcc91b9ea admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:14.332897 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87e7d1-6eaa-4df5-9b31-e10363a89452 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:14.338652 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c24eb-0162-4543-9c06-6b6079c07c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:14.340178 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c24eb-0162-4543-9c06-6b6079c07c81 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:14.341191 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c24eb-0162-4543-9c06-6b6079c07c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:14.341750 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c24eb-0162-4543-9c06-6b6079c07c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:14.342650 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 913/1852] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:14.343258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c24eb-0162-4543-9c06-6b6079c07c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:14.343640 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a16b8-e434-4009-80c0-c70dcc91b9ea admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:14.345432 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c24eb-0162-4543-9c06-6b6079c07c81 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:14.356931 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a16b8-e434-4009-80c0-c70dcc91b9ea admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:14.361568 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 940/1853] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:14.363001 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c24eb-0162-4543-9c06-6b6079c07c81 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:14.364119 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696a58c-fcbd-4d51-a9a7-cd110c0de794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:14.364822 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696a58c-fcbd-4d51-a9a7-cd110c0de794 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:14.365367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696a58c-fcbd-4d51-a9a7-cd110c0de794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:14.366040 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696a58c-fcbd-4d51-a9a7-cd110c0de794 admin admin] PATH_INFO: `/v3/projects/c012f0c1807e431f853bada3cc88f1dc/users/35889dd43ddb4c17ad773eaf3ddcb62e/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:14.378080 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c24eb-0162-4543-9c06-6b6079c07c81 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:14.384519 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5d0b2-42ba-428c-b433-438dc3bc42e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:14.385457 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5d0b2-42ba-428c-b433-438dc3bc42e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:14.385616 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2696a58c-fcbd-4d51-a9a7-cd110c0de794 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c012f0c1807e431f853bada3cc88f1dc, user_id=35889dd43ddb4c17ad773eaf3ddcb62e, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:14.386062 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5d0b2-42ba-428c-b433-438dc3bc42e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:14.389175 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2696a58c-fcbd-4d51-a9a7-cd110c0de794 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:14.389631 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5d0b2-42ba-428c-b433-438dc3bc42e1 admin admin] PATH_INFO: `/v3/projects/f0ec229ce12f43ecbeb08df98836149d/users/b71d60c5888a432abb26fafeac4dada1/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:14.407230 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5d0b2-42ba-428c-b433-438dc3bc42e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0ec229ce12f43ecbeb08df98836149d, user_id=b71d60c5888a432abb26fafeac4dada1, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:14.417461 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5d0b2-42ba-428c-b433-438dc3bc42e1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:14.418779 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 914/1854] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:14 2022] PUT /identity/v3/projects/c012f0c1807e431f853bada3cc88f1dc/users/35889dd43ddb4c17ad773eaf3ddcb62e/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:14.420472 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe5187-a101-4121-a847-15a5d51f7918 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:14.421604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe5187-a101-4121-a847-15a5d51f7918 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:14.421799 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe5187-a101-4121-a847-15a5d51f7918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:14.440909 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 941/1855] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:14 2022] PUT /identity/v3/projects/f0ec229ce12f43ecbeb08df98836149d/users/b71d60c5888a432abb26fafeac4dada1/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:14.452877 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9c9c3-aefd-4d33-9020-9f2e2835d76c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:14.453243 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9c9c3-aefd-4d33-9020-9f2e2835d76c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:14.454053 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9c9c3-aefd-4d33-9020-9f2e2835d76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:14.486102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4ee9c9c3-aefd-4d33-9020-9f2e2835d76c None None] MFA Rules not processed for user `b71d60c5888a432abb26fafeac4dada1`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:14.487659 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4ee9c9c3-aefd-4d33-9020-9f2e2835d76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:14.489264 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a1fe5187-a101-4121-a847-15a5d51f7918 None None] MFA Rules not processed for user `35889dd43ddb4c17ad773eaf3ddcb62e`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:14.491946 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a1fe5187-a101-4121-a847-15a5d51f7918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:14.593460 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 915/1856] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:14.598350 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe5187-a101-4121-a847-15a5d51f7918 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:14.608884 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:14.610452 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 942/1857] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:27:14.615722 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9c9c3-aefd-4d33-9020-9f2e2835d76c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:14.666012 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:14.740478 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9c9c3-aefd-4d33-9020-9f2e2835d76c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:14.744155 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe5187-a101-4121-a847-15a5d51f7918 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:14.745969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364a38a-ac57-48e9-899c-fe5ab62bcc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:14.746699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364a38a-ac57-48e9-899c-fe5ab62bcc10 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:14.747045 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364a38a-ac57-48e9-899c-fe5ab62bcc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:14.747393 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364a38a-ac57-48e9-899c-fe5ab62bcc10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:14.748119 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364a38a-ac57-48e9-899c-fe5ab62bcc10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:14.750530 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364a38a-ac57-48e9-899c-fe5ab62bcc10 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:14.780968 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524f102-b9f8-4a26-8df2-4a466025828f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:14.784242 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524f102-b9f8-4a26-8df2-4a466025828f admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:14.784562 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524f102-b9f8-4a26-8df2-4a466025828f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:14.784897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524f102-b9f8-4a26-8df2-4a466025828f admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:14.785594 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524f102-b9f8-4a26-8df2-4a466025828f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:14.788413 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524f102-b9f8-4a26-8df2-4a466025828f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:14.797488 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 943/1858] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:14 2022] POST /identity/v3/projects => generated 377 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:14.800782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364a38a-ac57-48e9-899c-fe5ab62bcc10 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:14.803570 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c364a38a-ac57-48e9-899c-fe5ab62bcc10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:14.841534 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 916/1859] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:14 2022] POST /identity/v3/projects => generated 385 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:14.842824 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524f102-b9f8-4a26-8df2-4a466025828f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:14.932921 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364a38a-ac57-48e9-899c-fe5ab62bcc10 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:14.941773 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc35919-7417-49bc-9724-8108b79e9021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:14.943099 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc35919-7417-49bc-9724-8108b79e9021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:14.943231 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524f102-b9f8-4a26-8df2-4a466025828f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:14.944131 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc35919-7417-49bc-9724-8108b79e9021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:14.944466 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc35919-7417-49bc-9724-8108b79e9021 admin admin] PATH_INFO: `/v3/projects/0a6abdc7cd534a56826ae03ab3abddba` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:14.945977 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc35919-7417-49bc-9724-8108b79e9021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a6abdc7cd534a56826ae03ab3abddba)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:14.952147 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60e99c-b964-47e7-8d69-df7720994274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:14.952362 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc35919-7417-49bc-9724-8108b79e9021 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:14.953150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60e99c-b964-47e7-8d69-df7720994274 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:14.953532 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60e99c-b964-47e7-8d69-df7720994274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:14.953880 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60e99c-b964-47e7-8d69-df7720994274 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:14.954896 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60e99c-b964-47e7-8d69-df7720994274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:14.957890 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60e99c-b964-47e7-8d69-df7720994274 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:14.990910 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 917/1860] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:14 2022] POST /identity/v3/users => generated 295 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:14.992068 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60e99c-b964-47e7-8d69-df7720994274 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:15.007274 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60e99c-b964-47e7-8d69-df7720994274 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:15.019769 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6cc35919-7417-49bc-9724-8108b79e9021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a6abdc7cd534a56826ae03ab3abddba', 'request_id': 'req-6cc35919-7417-49bc-9724-8108b79e9021'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:15.027594 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6cc35919-7417-49bc-9724-8108b79e9021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a6abdc7cd534a56826ae03ab3abddba', 'request_id': 'req-6cc35919-7417-49bc-9724-8108b79e9021'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:15.039775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6cc35919-7417-49bc-9724-8108b79e9021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a6abdc7cd534a56826ae03ab3abddba', 'request_id': 'req-6cc35919-7417-49bc-9724-8108b79e9021'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:15.064690 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6cc35919-7417-49bc-9724-8108b79e9021 admin admin] The token cache is being invalidate because project 0a6abdc7cd534a56826ae03ab3abddba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:15.066022 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6cc35919-7417-49bc-9724-8108b79e9021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:15.066878 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6cc35919-7417-49bc-9724-8108b79e9021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:15.068878 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 944/1861] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:14 2022] DELETE /identity/v3/projects/0a6abdc7cd534a56826ae03ab3abddba => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:15.070696 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc35919-7417-49bc-9724-8108b79e9021 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:15.072676 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6cc35919-7417-49bc-9724-8108b79e9021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:15.122394 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:15.134988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af1c40-bb96-4630-a9f5-44e4edafce44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:15.136468 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af1c40-bb96-4630-a9f5-44e4edafce44 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:15.136762 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af1c40-bb96-4630-a9f5-44e4edafce44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:15.137327 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af1c40-bb96-4630-a9f5-44e4edafce44 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:15.138012 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af1c40-bb96-4630-a9f5-44e4edafce44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:15.140198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af1c40-bb96-4630-a9f5-44e4edafce44 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:15.192565 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 918/1862] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:14 2022] POST /identity/v3/users => generated 299 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:15.197635 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af1c40-bb96-4630-a9f5-44e4edafce44 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:15.201273 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-12af1c40-bb96-4630-a9f5-44e4edafce44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:15.210336 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc35919-7417-49bc-9724-8108b79e9021 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:15.222850 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e4769-9c95-40e3-bec6-86797d9306ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:15.223680 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e4769-9c95-40e3-bec6-86797d9306ab admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:15.224054 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e4769-9c95-40e3-bec6-86797d9306ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:15.225293 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e4769-9c95-40e3-bec6-86797d9306ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:15.226254 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e4769-9c95-40e3-bec6-86797d9306ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:15.228454 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e4769-9c95-40e3-bec6-86797d9306ab admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:15.241052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 945/1863] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:15.242099 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e4769-9c95-40e3-bec6-86797d9306ab admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:15.246331 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-287e4769-9c95-40e3-bec6-86797d9306ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:15.246776 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af1c40-bb96-4630-a9f5-44e4edafce44 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:15.257605 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb3524-ae93-40ce-b34e-1f56888a1a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:15.258492 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb3524-ae93-40ce-b34e-1f56888a1a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:15.258778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb3524-ae93-40ce-b34e-1f56888a1a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:15.259055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb3524-ae93-40ce-b34e-1f56888a1a7f admin admin] PATH_INFO: `/v3/users/e0218c69e5684d24b677a9f4560feba3` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:15.262135 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb3524-ae93-40ce-b34e-1f56888a1a7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0218c69e5684d24b677a9f4560feba3)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:15.264043 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e4769-9c95-40e3-bec6-86797d9306ab admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:15.264198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb3524-ae93-40ce-b34e-1f56888a1a7f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:15.269280 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1557d4-83f7-48d1-b688-8876e2a7d984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:15.269629 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:15.270430 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1557d4-83f7-48d1-b688-8876e2a7d984 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:15.270430 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1557d4-83f7-48d1-b688-8876e2a7d984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:15.270639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1557d4-83f7-48d1-b688-8876e2a7d984 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:15.271539 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1557d4-83f7-48d1-b688-8876e2a7d984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:15.273678 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1557d4-83f7-48d1-b688-8876e2a7d984 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:15.290390 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 946/1864] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:15.290390 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1557d4-83f7-48d1-b688-8876e2a7d984 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:15.299877 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1557d4-83f7-48d1-b688-8876e2a7d984 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:15.305977 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09272941-e104-4fd3-9657-c6372448a488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:15.306739 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09272941-e104-4fd3-9657-c6372448a488 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:15.307087 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09272941-e104-4fd3-9657-c6372448a488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:15.307432 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09272941-e104-4fd3-9657-c6372448a488 admin admin] PATH_INFO: `/v3/projects/aafc7ecbe444417ba01d300e3b1a1e17/users/43daacff364247bf853b432d14f6ef0f/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:15.324878 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09272941-e104-4fd3-9657-c6372448a488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aafc7ecbe444417ba01d300e3b1a1e17, user_id=43daacff364247bf853b432d14f6ef0f, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:15.328072 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09272941-e104-4fd3-9657-c6372448a488 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:15.350056 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 947/1865] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:15 2022] PUT /identity/v3/projects/aafc7ecbe444417ba01d300e3b1a1e17/users/43daacff364247bf853b432d14f6ef0f/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:15.350056 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09272941-e104-4fd3-9657-c6372448a488 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:15.365258 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-65fb3524-ae93-40ce-b34e-1f56888a1a7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0218c69e5684d24b677a9f4560feba3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:15.366730 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-65fb3524-ae93-40ce-b34e-1f56888a1a7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0218c69e5684d24b677a9f4560feba3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:15.383888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-65fb3524-ae93-40ce-b34e-1f56888a1a7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0218c69e5684d24b677a9f4560feba3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:15.384804 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-65fb3524-ae93-40ce-b34e-1f56888a1a7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0218c69e5684d24b677a9f4560feba3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:15.397571 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-65fb3524-ae93-40ce-b34e-1f56888a1a7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0218c69e5684d24b677a9f4560feba3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:15.450988 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09272941-e104-4fd3-9657-c6372448a488 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:15.452035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 919/1866] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:15 2022] DELETE /identity/v3/users/e0218c69e5684d24b677a9f4560feba3 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:15.454953 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb3524-ae93-40ce-b34e-1f56888a1a7f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:15.458599 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-65fb3524-ae93-40ce-b34e-1f56888a1a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:15.571797 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9d93e-724b-4bd2-abda-a96278f365c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:15.572460 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9d93e-724b-4bd2-abda-a96278f365c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:15.572744 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9d93e-724b-4bd2-abda-a96278f365c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:15.573102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9d93e-724b-4bd2-abda-a96278f365c0 admin admin] PATH_INFO: `/v3/projects/dcec0f8dacd442b5959b42faf641b4ab/users/3e81248a42ef4e24ab28988a6248aca8/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:15.619407 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c9d93e-724b-4bd2-abda-a96278f365c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcec0f8dacd442b5959b42faf641b4ab, user_id=3e81248a42ef4e24ab28988a6248aca8, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:15.625236 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c9d93e-724b-4bd2-abda-a96278f365c0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:15.650321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 948/1867] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:15 2022] PUT /identity/v3/projects/dcec0f8dacd442b5959b42faf641b4ab/users/3e81248a42ef4e24ab28988a6248aca8/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:15.654685 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9d93e-724b-4bd2-abda-a96278f365c0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:15.658567 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-69c9d93e-724b-4bd2-abda-a96278f365c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:15.687416 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb3524-ae93-40ce-b34e-1f56888a1a7f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:15.702742 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:15.775779 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9d93e-724b-4bd2-abda-a96278f365c0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:15.782530 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05108c6f-6f20-4698-98f5-0373a9b211e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:15.783153 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05108c6f-6f20-4698-98f5-0373a9b211e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:15.783439 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05108c6f-6f20-4698-98f5-0373a9b211e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:15.783710 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05108c6f-6f20-4698-98f5-0373a9b211e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:15.784364 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05108c6f-6f20-4698-98f5-0373a9b211e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:15.786753 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05108c6f-6f20-4698-98f5-0373a9b211e2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:15.802726 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 949/1868] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:15.805761 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f52ecb-f774-478d-809e-9b7bcc50403a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:15.806743 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f52ecb-f774-478d-809e-9b7bcc50403a admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:15.807176 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f52ecb-f774-478d-809e-9b7bcc50403a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:15.807424 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05108c6f-6f20-4698-98f5-0373a9b211e2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:15.807753 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f52ecb-f774-478d-809e-9b7bcc50403a admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:15.808960 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f52ecb-f774-478d-809e-9b7bcc50403a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:15.811102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f52ecb-f774-478d-809e-9b7bcc50403a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:15.821586 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05108c6f-6f20-4698-98f5-0373a9b211e2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:15.828109 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 920/1869] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:15.829673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f52ecb-f774-478d-809e-9b7bcc50403a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:15.831161 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba71b0-6cd8-4ce6-ba1f-618bfac120e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:15.832055 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba71b0-6cd8-4ce6-ba1f-618bfac120e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:15.832589 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba71b0-6cd8-4ce6-ba1f-618bfac120e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:15.833157 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba71b0-6cd8-4ce6-ba1f-618bfac120e3 admin admin] PATH_INFO: `/v3/projects/dcec0f8dacd442b5959b42faf641b4ab/users/3e81248a42ef4e24ab28988a6248aca8/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:15.837656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba71b0-6cd8-4ce6-ba1f-618bfac120e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcec0f8dacd442b5959b42faf641b4ab, user_id=3e81248a42ef4e24ab28988a6248aca8, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:15.840833 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba71b0-6cd8-4ce6-ba1f-618bfac120e3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:15.843143 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f52ecb-f774-478d-809e-9b7bcc50403a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:15.848835 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d07b59-d26a-4ebc-ab2b-c01d2a2eeea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:15.850447 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d07b59-d26a-4ebc-ab2b-c01d2a2eeea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:15.850854 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d07b59-d26a-4ebc-ab2b-c01d2a2eeea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:15.851191 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d07b59-d26a-4ebc-ab2b-c01d2a2eeea9 admin admin] PATH_INFO: `/v3/projects/aafc7ecbe444417ba01d300e3b1a1e17/users/43daacff364247bf853b432d14f6ef0f/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:15.853934 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d07b59-d26a-4ebc-ab2b-c01d2a2eeea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aafc7ecbe444417ba01d300e3b1a1e17, user_id=43daacff364247bf853b432d14f6ef0f, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:15.856477 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d07b59-d26a-4ebc-ab2b-c01d2a2eeea9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:15.866568 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 950/1870] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:15 2022] PUT /identity/v3/projects/dcec0f8dacd442b5959b42faf641b4ab/users/3e81248a42ef4e24ab28988a6248aca8/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:15.868181 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b599fe-513d-4c7e-a347-b4223a5268fa None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:15.868466 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b599fe-513d-4c7e-a347-b4223a5268fa None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:15.868732 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b599fe-513d-4c7e-a347-b4223a5268fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:15.873698 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 921/1871] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:15 2022] PUT /identity/v3/projects/aafc7ecbe444417ba01d300e3b1a1e17/users/43daacff364247bf853b432d14f6ef0f/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:15.883708 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fdcad-4f9f-47df-aed3-e035bc5aec53 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:15.883923 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fdcad-4f9f-47df-aed3-e035bc5aec53 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:15.884231 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fdcad-4f9f-47df-aed3-e035bc5aec53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:15.914592 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:15.925262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a13fdcad-4f9f-47df-aed3-e035bc5aec53 None None] MFA Rules not processed for user `43daacff364247bf853b432d14f6ef0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:15.927326 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a13fdcad-4f9f-47df-aed3-e035bc5aec53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:15.928451 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-22b599fe-513d-4c7e-a347-b4223a5268fa None None] MFA Rules not processed for user `3e81248a42ef4e24ab28988a6248aca8`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:15.930480 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-22b599fe-513d-4c7e-a347-b4223a5268fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:16.046945 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 922/1872] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:16.060622 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fdcad-4f9f-47df-aed3-e035bc5aec53 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:16.062681 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a13fdcad-4f9f-47df-aed3-e035bc5aec53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:16.071507 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 951/1873] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:15 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:16.083370 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b599fe-513d-4c7e-a347-b4223a5268fa None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:16.089034 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-22b599fe-513d-4c7e-a347-b4223a5268fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:16.168128 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fdcad-4f9f-47df-aed3-e035bc5aec53 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:16.177985 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffadd0-c9d4-4388-82fc-272165a4fd27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:16.179339 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffadd0-c9d4-4388-82fc-272165a4fd27 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:16.180611 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffadd0-c9d4-4388-82fc-272165a4fd27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:16.180908 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffadd0-c9d4-4388-82fc-272165a4fd27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:16.184979 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fcffadd0-c9d4-4388-82fc-272165a4fd27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:16.200978 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b599fe-513d-4c7e-a347-b4223a5268fa None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:16.209225 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3aef56-de9c-4a91-b94d-c828fb2555bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:16.211247 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3aef56-de9c-4a91-b94d-c828fb2555bd service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:16.211542 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3aef56-de9c-4a91-b94d-c828fb2555bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:16.212079 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3aef56-de9c-4a91-b94d-c828fb2555bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:16.233647 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3aef56-de9c-4a91-b94d-c828fb2555bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:16.236646 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3aef56-de9c-4a91-b94d-c828fb2555bd service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:16.258753 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 952/1874] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:16.306799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3aef56-de9c-4a91-b94d-c828fb2555bd service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:16.343468 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcffadd0-c9d4-4388-82fc-272165a4fd27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:16.345240 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcffadd0-c9d4-4388-82fc-272165a4fd27 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:16.378723 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 923/1875] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:16.379417 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffadd0-c9d4-4388-82fc-272165a4fd27 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:16.383332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fcffadd0-c9d4-4388-82fc-272165a4fd27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:16.385621 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:16.452981 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3aef56-de9c-4a91-b94d-c828fb2555bd service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:16.465858 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01938ff-362d-4c39-904e-510d95568940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:16.465858 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01938ff-362d-4c39-904e-510d95568940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:16.466245 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01938ff-362d-4c39-904e-510d95568940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:16.466245 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01938ff-362d-4c39-904e-510d95568940 admin admin] PATH_INFO: `/v3/users/35889dd43ddb4c17ad773eaf3ddcb62e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:16.467507 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01938ff-362d-4c39-904e-510d95568940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35889dd43ddb4c17ad773eaf3ddcb62e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:16.470392 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01938ff-362d-4c39-904e-510d95568940 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:16.506913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:16.542573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffadd0-c9d4-4388-82fc-272165a4fd27 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:16.554759 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983613f5-97b0-4b05-9daf-526f6eff7c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:16.555286 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d01938ff-362d-4c39-904e-510d95568940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35889dd43ddb4c17ad773eaf3ddcb62e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:16.555582 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983613f5-97b0-4b05-9daf-526f6eff7c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:16.555958 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983613f5-97b0-4b05-9daf-526f6eff7c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:16.556215 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d01938ff-362d-4c39-904e-510d95568940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35889dd43ddb4c17ad773eaf3ddcb62e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:16.556430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983613f5-97b0-4b05-9daf-526f6eff7c40 admin admin] PATH_INFO: `/v3/projects/6e45e00c5f7f40b698b61edd0ff3bb36` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:16.559928 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983613f5-97b0-4b05-9daf-526f6eff7c40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e45e00c5f7f40b698b61edd0ff3bb36)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:16.562919 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983613f5-97b0-4b05-9daf-526f6eff7c40 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:16.581313 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d01938ff-362d-4c39-904e-510d95568940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35889dd43ddb4c17ad773eaf3ddcb62e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:16.591269 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d01938ff-362d-4c39-904e-510d95568940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35889dd43ddb4c17ad773eaf3ddcb62e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:16.605649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d01938ff-362d-4c39-904e-510d95568940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35889dd43ddb4c17ad773eaf3ddcb62e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:16.630813 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 953/1876] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:16 2022] DELETE /identity/v3/users/35889dd43ddb4c17ad773eaf3ddcb62e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:16.634466 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44533578-6200-452c-8cfa-8382f5f80325 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:16.635210 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44533578-6200-452c-8cfa-8382f5f80325 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:16.635916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44533578-6200-452c-8cfa-8382f5f80325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:16.676264 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-44533578-6200-452c-8cfa-8382f5f80325 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:16.679962 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-44533578-6200-452c-8cfa-8382f5f80325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:16.692884 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-983613f5-97b0-4b05-9daf-526f6eff7c40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e45e00c5f7f40b698b61edd0ff3bb36', 'request_id': 'req-983613f5-97b0-4b05-9daf-526f6eff7c40'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:16.709892 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-983613f5-97b0-4b05-9daf-526f6eff7c40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e45e00c5f7f40b698b61edd0ff3bb36', 'request_id': 'req-983613f5-97b0-4b05-9daf-526f6eff7c40'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:16.724172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-983613f5-97b0-4b05-9daf-526f6eff7c40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e45e00c5f7f40b698b61edd0ff3bb36', 'request_id': 'req-983613f5-97b0-4b05-9daf-526f6eff7c40'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:16.745696 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-983613f5-97b0-4b05-9daf-526f6eff7c40 admin admin] The token cache is being invalidate because project 6e45e00c5f7f40b698b61edd0ff3bb36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:16.746130 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-983613f5-97b0-4b05-9daf-526f6eff7c40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:16.747011 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-983613f5-97b0-4b05-9daf-526f6eff7c40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:16.754732 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 924/1877] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:16 2022] DELETE /identity/v3/projects/6e45e00c5f7f40b698b61edd0ff3bb36 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:16.756855 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75adc1e7-3e36-4aa3-aea2-d22f13d79cb2 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:16.757148 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75adc1e7-3e36-4aa3-aea2-d22f13d79cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:16.757436 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75adc1e7-3e36-4aa3-aea2-d22f13d79cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:16.787035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-75adc1e7-3e36-4aa3-aea2-d22f13d79cb2 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:16.788623 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-75adc1e7-3e36-4aa3-aea2-d22f13d79cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:16.832748 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 954/1878] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:16.847757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44533578-6200-452c-8cfa-8382f5f80325 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:16.853558 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-44533578-6200-452c-8cfa-8382f5f80325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:16.915333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 925/1879] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:16.933768 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e33ee-1172-4bc7-8a04-7737ce96ff97 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:16.934899 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e33ee-1172-4bc7-8a04-7737ce96ff97 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:16.935348 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e33ee-1172-4bc7-8a04-7737ce96ff97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:16.979058 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8f1e33ee-1172-4bc7-8a04-7737ce96ff97 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:16.980699 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8f1e33ee-1172-4bc7-8a04-7737ce96ff97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:16.991862 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 926/1880] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:17.009093 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e33ee-1172-4bc7-8a04-7737ce96ff97 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:17.009893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44533578-6200-452c-8cfa-8382f5f80325 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:17.021822 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa735a-f75e-4c4d-89fe-a24e9980071c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:17.022328 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e33ee-1172-4bc7-8a04-7737ce96ff97 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:17.022517 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa735a-f75e-4c4d-89fe-a24e9980071c service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:17.022804 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa735a-f75e-4c4d-89fe-a24e9980071c service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:17.023136 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa735a-f75e-4c4d-89fe-a24e9980071c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:17.028359 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5dec8e-180a-4bf4-a6f5-e6490811e442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:17.029040 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5dec8e-180a-4bf4-a6f5-e6490811e442 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:17.029542 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5dec8e-180a-4bf4-a6f5-e6490811e442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:17.029877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5dec8e-180a-4bf4-a6f5-e6490811e442 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:17.030731 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5dec8e-180a-4bf4-a6f5-e6490811e442 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:27:17.031092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5dec8e-180a-4bf4-a6f5-e6490811e442 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:17.033025 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5dec8e-180a-4bf4-a6f5-e6490811e442 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:17.051951 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:17.054670 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa735a-f75e-4c4d-89fe-a24e9980071c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:17.056691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa735a-f75e-4c4d-89fe-a24e9980071c service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:17.058402 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 927/1881] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:27:17.062331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5dec8e-180a-4bf4-a6f5-e6490811e442 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:17.078433 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5dec8e-180a-4bf4-a6f5-e6490811e442 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:17.083416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 955/1882] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:17.094228 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd55b47-4b1b-4821-8916-3600c5e18ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:17.094967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd55b47-4b1b-4821-8916-3600c5e18ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:17.095328 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd55b47-4b1b-4821-8916-3600c5e18ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:17.095672 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd55b47-4b1b-4821-8916-3600c5e18ce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:17.097073 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd55b47-4b1b-4821-8916-3600c5e18ce9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:17.099107 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd55b47-4b1b-4821-8916-3600c5e18ce9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:17.139700 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 928/1883] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:17 2022] POST /identity/v3/projects => generated 365 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:17.145136 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa735a-f75e-4c4d-89fe-a24e9980071c service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:17.160058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa735a-f75e-4c4d-89fe-a24e9980071c service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:17.245717 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf050c-dc96-4245-a736-ca9a63890fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:17.246571 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf050c-dc96-4245-a736-ca9a63890fe0 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:17.246869 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf050c-dc96-4245-a736-ca9a63890fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:17.247590 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf050c-dc96-4245-a736-ca9a63890fe0 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:17.248408 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf050c-dc96-4245-a736-ca9a63890fe0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:17.251045 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf050c-dc96-4245-a736-ca9a63890fe0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:17.281766 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 956/1884] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:17 2022] POST /identity/v3/users => generated 283 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:17.282964 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd55b47-4b1b-4821-8916-3600c5e18ce9 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:17.294779 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd55b47-4b1b-4821-8916-3600c5e18ce9 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:17.301936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1943c6-2c03-4525-ac9e-864341db9650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:17.304053 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1943c6-2c03-4525-ac9e-864341db9650 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:17.304820 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1943c6-2c03-4525-ac9e-864341db9650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:17.305191 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1943c6-2c03-4525-ac9e-864341db9650 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:17.305900 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1943c6-2c03-4525-ac9e-864341db9650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:17.308038 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1943c6-2c03-4525-ac9e-864341db9650 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:17.322413 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 929/1885] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:17.325245 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf050c-dc96-4245-a736-ca9a63890fe0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:17.337416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf050c-dc96-4245-a736-ca9a63890fe0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:17.342374 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28afb8f4-efe2-4326-9915-5672d75a7937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:17.342999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28afb8f4-efe2-4326-9915-5672d75a7937 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:17.343453 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28afb8f4-efe2-4326-9915-5672d75a7937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:17.343831 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28afb8f4-efe2-4326-9915-5672d75a7937 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:17.345866 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28afb8f4-efe2-4326-9915-5672d75a7937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:17.348143 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28afb8f4-efe2-4326-9915-5672d75a7937 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:17.364072 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 957/1886] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:17.365166 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1943c6-2c03-4525-ac9e-864341db9650 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:17.379870 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1943c6-2c03-4525-ac9e-864341db9650 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:17.386966 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9b53d-3c61-4394-a75f-d5622befdd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:17.387895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9b53d-3c61-4394-a75f-d5622befdd05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:17.388430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9b53d-3c61-4394-a75f-d5622befdd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:17.389015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9b53d-3c61-4394-a75f-d5622befdd05 admin admin] PATH_INFO: `/v3/projects/8dee3035918a44fda3dbbaf5f5bce662/users/a8b06554066e44d2bf03a7b22798e8ed/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:17.411154 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9b53d-3c61-4394-a75f-d5622befdd05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dee3035918a44fda3dbbaf5f5bce662, user_id=a8b06554066e44d2bf03a7b22798e8ed, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:17.414122 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9b53d-3c61-4394-a75f-d5622befdd05 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:17.437474 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 930/1887] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:17 2022] PUT /identity/v3/projects/8dee3035918a44fda3dbbaf5f5bce662/users/a8b06554066e44d2bf03a7b22798e8ed/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:27:17.449742 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba10fae-3f51-4dae-be77-2daa6ef69da4 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:17.450087 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba10fae-3f51-4dae-be77-2daa6ef69da4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:17.450358 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba10fae-3f51-4dae-be77-2daa6ef69da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:17.484057 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-bba10fae-3f51-4dae-be77-2daa6ef69da4 None None] MFA Rules not processed for user `a8b06554066e44d2bf03a7b22798e8ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:17.493733 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bba10fae-3f51-4dae-be77-2daa6ef69da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:17.683335 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9b53d-3c61-4394-a75f-d5622befdd05 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:17.684160 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 958/1888] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:17.691019 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:17.791983 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9b53d-3c61-4394-a75f-d5622befdd05 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:17.805183 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6fe07-1310-47c8-8806-3de1f43503a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:17.806323 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6fe07-1310-47c8-8806-3de1f43503a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:17.806675 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6fe07-1310-47c8-8806-3de1f43503a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:17.806959 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6fe07-1310-47c8-8806-3de1f43503a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:17.808170 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6fe07-1310-47c8-8806-3de1f43503a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:17.810623 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6fe07-1310-47c8-8806-3de1f43503a5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:17.861541 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 931/1889] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:17 2022] POST /identity/v3/projects => generated 367 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:17.863319 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba10fae-3f51-4dae-be77-2daa6ef69da4 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:17.875829 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba10fae-3f51-4dae-be77-2daa6ef69da4 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:17.952267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba4485-e186-4e42-8d59-e42b70991674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:17.955381 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba4485-e186-4e42-8d59-e42b70991674 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:17.955881 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba4485-e186-4e42-8d59-e42b70991674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:17.956372 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba4485-e186-4e42-8d59-e42b70991674 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:17.957426 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba4485-e186-4e42-8d59-e42b70991674 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:17.962745 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba4485-e186-4e42-8d59-e42b70991674 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:17.979393 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:18.001218 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6fe07-1310-47c8-8806-3de1f43503a5 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:18.001672 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 959/1890] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:17 2022] POST /identity/v3/users => generated 290 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:18.015713 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6fe07-1310-47c8-8806-3de1f43503a5 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:18.025331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12732085-4de9-4761-baa5-83a4748cb130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:18.025994 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12732085-4de9-4761-baa5-83a4748cb130 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:18.026272 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12732085-4de9-4761-baa5-83a4748cb130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:18.026549 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12732085-4de9-4761-baa5-83a4748cb130 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:18.027244 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12732085-4de9-4761-baa5-83a4748cb130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:18.029253 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12732085-4de9-4761-baa5-83a4748cb130 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:18.047731 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba4485-e186-4e42-8d59-e42b70991674 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:18.051195 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-13ba4485-e186-4e42-8d59-e42b70991674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:18.053631 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 932/1891] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:18.064535 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12732085-4de9-4761-baa5-83a4748cb130 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:18.076418 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12732085-4de9-4761-baa5-83a4748cb130 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:18.082464 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01917772-42ef-4465-b460-f9134677383f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:18.082959 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01917772-42ef-4465-b460-f9134677383f admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:18.083242 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01917772-42ef-4465-b460-f9134677383f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:18.083517 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01917772-42ef-4465-b460-f9134677383f admin admin] PATH_INFO: `/v3/projects/76695f55d27849dc8b92944bef5fbf5d/users/e66221f6a4c740b29744ae7b1256f4d4/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:18.092614 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba4485-e186-4e42-8d59-e42b70991674 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:18.102797 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01917772-42ef-4465-b460-f9134677383f admin admin] RBAC: Authorizing `identity:create_grant(project_id=76695f55d27849dc8b92944bef5fbf5d, user_id=e66221f6a4c740b29744ae7b1256f4d4, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:18.105561 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01917772-42ef-4465-b460-f9134677383f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:18.110095 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47979368-0929-4ee3-b721-d40c24a74c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:18.110881 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47979368-0929-4ee3-b721-d40c24a74c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:18.111223 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47979368-0929-4ee3-b721-d40c24a74c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:18.111535 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47979368-0929-4ee3-b721-d40c24a74c8e admin admin] PATH_INFO: `/v3/projects/c012f0c1807e431f853bada3cc88f1dc` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:18.113020 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47979368-0929-4ee3-b721-d40c24a74c8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c012f0c1807e431f853bada3cc88f1dc)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:18.119870 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47979368-0929-4ee3-b721-d40c24a74c8e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:18.126046 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 933/1892] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:18 2022] PUT /identity/v3/projects/76695f55d27849dc8b92944bef5fbf5d/users/e66221f6a4c740b29744ae7b1256f4d4/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:18.131963 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01917772-42ef-4465-b460-f9134677383f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:18.204609 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-47979368-0929-4ee3-b721-d40c24a74c8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c012f0c1807e431f853bada3cc88f1dc', 'request_id': 'req-47979368-0929-4ee3-b721-d40c24a74c8e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:18.213514 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-47979368-0929-4ee3-b721-d40c24a74c8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c012f0c1807e431f853bada3cc88f1dc', 'request_id': 'req-47979368-0929-4ee3-b721-d40c24a74c8e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:18.223212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-47979368-0929-4ee3-b721-d40c24a74c8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c012f0c1807e431f853bada3cc88f1dc', 'request_id': 'req-47979368-0929-4ee3-b721-d40c24a74c8e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:18.242637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-47979368-0929-4ee3-b721-d40c24a74c8e admin admin] The token cache is being invalidate because project c012f0c1807e431f853bada3cc88f1dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:18.243490 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-47979368-0929-4ee3-b721-d40c24a74c8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:18.244310 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-47979368-0929-4ee3-b721-d40c24a74c8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:18.247527 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 960/1893] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:18 2022] DELETE /identity/v3/projects/c012f0c1807e431f853bada3cc88f1dc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:27:18.248538 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47979368-0929-4ee3-b721-d40c24a74c8e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:18.250229 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-47979368-0929-4ee3-b721-d40c24a74c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:18.251715 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01917772-42ef-4465-b460-f9134677383f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:18.323729 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940cf59-71c1-44d3-820f-378f6dd18b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:18.324457 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940cf59-71c1-44d3-820f-378f6dd18b47 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:18.324924 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940cf59-71c1-44d3-820f-378f6dd18b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:18.325306 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940cf59-71c1-44d3-820f-378f6dd18b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:18.326275 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940cf59-71c1-44d3-820f-378f6dd18b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:18.328541 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940cf59-71c1-44d3-820f-378f6dd18b47 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:18.331230 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:18.347011 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 934/1894] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:27:18.348085 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940cf59-71c1-44d3-820f-378f6dd18b47 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:18.357890 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7940cf59-71c1-44d3-820f-378f6dd18b47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:18.379019 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47979368-0929-4ee3-b721-d40c24a74c8e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:18.386394 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e203cd-9bca-4cac-a420-24dc91b693bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:18.387063 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e203cd-9bca-4cac-a420-24dc91b693bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:18.387852 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e203cd-9bca-4cac-a420-24dc91b693bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:18.388304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e203cd-9bca-4cac-a420-24dc91b693bd admin admin] PATH_INFO: `/v3/users/ceddbdc4c3d04021b14b1b972470389f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:18.389853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e203cd-9bca-4cac-a420-24dc91b693bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceddbdc4c3d04021b14b1b972470389f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:18.392976 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e203cd-9bca-4cac-a420-24dc91b693bd admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:18.431666 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940cf59-71c1-44d3-820f-378f6dd18b47 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:18.436814 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7ea78-4dc2-4b0a-8155-d4881855a25a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:18.437163 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7ea78-4dc2-4b0a-8155-d4881855a25a service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:18.437611 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7ea78-4dc2-4b0a-8155-d4881855a25a service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:18.438108 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7ea78-4dc2-4b0a-8155-d4881855a25a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:18.440491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-37b7ea78-4dc2-4b0a-8155-d4881855a25a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:18.456410 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-22e203cd-9bca-4cac-a420-24dc91b693bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceddbdc4c3d04021b14b1b972470389f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:18.457361 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-22e203cd-9bca-4cac-a420-24dc91b693bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceddbdc4c3d04021b14b1b972470389f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:18.479597 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-22e203cd-9bca-4cac-a420-24dc91b693bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceddbdc4c3d04021b14b1b972470389f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:18.490187 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-22e203cd-9bca-4cac-a420-24dc91b693bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceddbdc4c3d04021b14b1b972470389f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:18.505221 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:INSERT=3,keystone:SELECT=80,keystone:DELETE=17 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:18.505221 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-22e203cd-9bca-4cac-a420-24dc91b693bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceddbdc4c3d04021b14b1b972470389f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:18.512866 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 961/1895] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:18 2022] DELETE /identity/v3/users/ceddbdc4c3d04021b14b1b972470389f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:18.513933 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e203cd-9bca-4cac-a420-24dc91b693bd admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:18.515300 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-22e203cd-9bca-4cac-a420-24dc91b693bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:18.525986 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7ea78-4dc2-4b0a-8155-d4881855a25a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:18.530904 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7ea78-4dc2-4b0a-8155-d4881855a25a service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:18.546911 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 935/1896] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:18.548153 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7ea78-4dc2-4b0a-8155-d4881855a25a service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:18.558896 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-37b7ea78-4dc2-4b0a-8155-d4881855a25a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:18.573358 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7ea78-4dc2-4b0a-8155-d4881855a25a service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:18.621675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e203cd-9bca-4cac-a420-24dc91b693bd admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:18.635770 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9879d-3d4f-4a98-bd27-dcae58a41bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:18.636439 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9879d-3d4f-4a98-bd27-dcae58a41bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:18.644030 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9879d-3d4f-4a98-bd27-dcae58a41bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:18.644527 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9879d-3d4f-4a98-bd27-dcae58a41bde admin admin] PATH_INFO: `/v3/users/3e81248a42ef4e24ab28988a6248aca8` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:18.647920 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9879d-3d4f-4a98-bd27-dcae58a41bde admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e81248a42ef4e24ab28988a6248aca8)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:18.654059 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9879d-3d4f-4a98-bd27-dcae58a41bde admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:18.751575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b73a0f4-c2a6-4754-a9a3-68a9ef99febf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:18.752182 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73a0f4-c2a6-4754-a9a3-68a9ef99febf admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:18.752463 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73a0f4-c2a6-4754-a9a3-68a9ef99febf admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:18.755752 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73a0f4-c2a6-4754-a9a3-68a9ef99febf admin admin] PATH_INFO: `/v3/projects/76695f55d27849dc8b92944bef5fbf5d/users/e66221f6a4c740b29744ae7b1256f4d4/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:18.770470 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b73a0f4-c2a6-4754-a9a3-68a9ef99febf admin admin] RBAC: Authorizing `identity:create_grant(project_id=76695f55d27849dc8b92944bef5fbf5d, user_id=e66221f6a4c740b29744ae7b1256f4d4, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:18.775712 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b73a0f4-c2a6-4754-a9a3-68a9ef99febf admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:18.790800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 936/1897] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:18 2022] PUT /identity/v3/projects/76695f55d27849dc8b92944bef5fbf5d/users/e66221f6a4c740b29744ae7b1256f4d4/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:18.792740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24def7-3e00-40ae-bdd3-1f9df0e330c5 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:18.793027 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24def7-3e00-40ae-bdd3-1f9df0e330c5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:18.793300 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24def7-3e00-40ae-bdd3-1f9df0e330c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:18.798225 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-44d9879d-3d4f-4a98-bd27-dcae58a41bde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e81248a42ef4e24ab28988a6248aca8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:18.800306 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-44d9879d-3d4f-4a98-bd27-dcae58a41bde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e81248a42ef4e24ab28988a6248aca8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:18.837474 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-44d9879d-3d4f-4a98-bd27-dcae58a41bde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e81248a42ef4e24ab28988a6248aca8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:18.844667 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9c24def7-3e00-40ae-bdd3-1f9df0e330c5 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:18.847833 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9c24def7-3e00-40ae-bdd3-1f9df0e330c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:18.855739 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-44d9879d-3d4f-4a98-bd27-dcae58a41bde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e81248a42ef4e24ab28988a6248aca8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:18.875401 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-44d9879d-3d4f-4a98-bd27-dcae58a41bde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e81248a42ef4e24ab28988a6248aca8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:18.884061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 962/1898] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:18 2022] DELETE /identity/v3/users/3e81248a42ef4e24ab28988a6248aca8 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:18.886381 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1537e-23ad-41f0-a4df-352b038e4c55 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:18.887049 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1537e-23ad-41f0-a4df-352b038e4c55 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:18.887903 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1537e-23ad-41f0-a4df-352b038e4c55 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:18.890091 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 963/1899] 10.222.0.94 () {54 vars in 921 bytes} [Thu Sep 1 17:27:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:27:18.892085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158dd347-bc65-44a9-baed-ad33f59a8db8 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:18.892645 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158dd347-bc65-44a9-baed-ad33f59a8db8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:18.893119 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158dd347-bc65-44a9-baed-ad33f59a8db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:18.929828 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-158dd347-bc65-44a9-baed-ad33f59a8db8 None None] MFA Rules not processed for user `e66221f6a4c740b29744ae7b1256f4d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:18.931224 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-158dd347-bc65-44a9-baed-ad33f59a8db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:18.959794 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:18.991665 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 937/1900] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:18.992965 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f493c20-30c0-41a6-96ce-67b4f5f0d552 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:18.993258 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f493c20-30c0-41a6-96ce-67b4f5f0d552 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:18.993611 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f493c20-30c0-41a6-96ce-67b4f5f0d552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:19.032542 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8f493c20-30c0-41a6-96ce-67b4f5f0d552 None None] MFA Rules not processed for user `8b7fa3c4c5d94b3c9b7f17dde35d39a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:19.034427 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8f493c20-30c0-41a6-96ce-67b4f5f0d552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:19.080862 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:19.093950 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 964/1901] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:19.094953 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158dd347-bc65-44a9-baed-ad33f59a8db8 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:19.096282 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-158dd347-bc65-44a9-baed-ad33f59a8db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:19.145265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 938/1902] 10.222.0.94 () {58 vars in 1018 bytes} [Thu Sep 1 17:27:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:19.147186 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f493c20-30c0-41a6-96ce-67b4f5f0d552 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:19.148798 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8f493c20-30c0-41a6-96ce-67b4f5f0d552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:19.211323 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158dd347-bc65-44a9-baed-ad33f59a8db8 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:19.215010 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa6393-257e-4826-adbb-aff6850abfd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:19.215634 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa6393-257e-4826-adbb-aff6850abfd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:19.215911 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa6393-257e-4826-adbb-aff6850abfd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:19.216598 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa6393-257e-4826-adbb-aff6850abfd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:19.248447 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f493c20-30c0-41a6-96ce-67b4f5f0d552 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:19.253099 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02aeb1d-5f22-4f59-b81d-825d643460fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:19.254421 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02aeb1d-5f22-4f59-b81d-825d643460fd service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:19.254853 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02aeb1d-5f22-4f59-b81d-825d643460fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:19.255321 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02aeb1d-5f22-4f59-b81d-825d643460fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:19.268336 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02aeb1d-5f22-4f59-b81d-825d643460fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:19.271528 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02aeb1d-5f22-4f59-b81d-825d643460fd service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:19.299544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa6393-257e-4826-adbb-aff6850abfd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:19.301292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa6393-257e-4826-adbb-aff6850abfd3 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:19.302272 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 939/1903] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:19.304982 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02aeb1d-5f22-4f59-b81d-825d643460fd service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:19.315563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 965/1904] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:19.316662 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c02aeb1d-5f22-4f59-b81d-825d643460fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:19.342466 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02aeb1d-5f22-4f59-b81d-825d643460fd service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:19.352814 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b3423-b2aa-40bd-8b2e-b7376a705ea7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:19.368555 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b3423-b2aa-40bd-8b2e-b7376a705ea7 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:19.368555 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b3423-b2aa-40bd-8b2e-b7376a705ea7 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:19.368555 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b3423-b2aa-40bd-8b2e-b7376a705ea7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:19.392197 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b3423-b2aa-40bd-8b2e-b7376a705ea7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:19.393854 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b3423-b2aa-40bd-8b2e-b7376a705ea7 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:19.405161 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 940/1905] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:19.407536 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa6393-257e-4826-adbb-aff6850abfd3 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:19.422484 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa6393-257e-4826-adbb-aff6850abfd3 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:19.432152 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54fb6a-8b93-4706-99a2-c8f694bbdca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:19.433068 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54fb6a-8b93-4706-99a2-c8f694bbdca4 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:19.433871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54fb6a-8b93-4706-99a2-c8f694bbdca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:19.434257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54fb6a-8b93-4706-99a2-c8f694bbdca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:19.437051 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0e54fb6a-8b93-4706-99a2-c8f694bbdca4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:19.546326 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54fb6a-8b93-4706-99a2-c8f694bbdca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:19.548741 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54fb6a-8b93-4706-99a2-c8f694bbdca4 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:19.577602 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 966/1906] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:19.637248 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b3423-b2aa-40bd-8b2e-b7376a705ea7 service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:19.638747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1d4b3423-b2aa-40bd-8b2e-b7376a705ea7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:19.660514 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b3423-b2aa-40bd-8b2e-b7376a705ea7 service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:19.671679 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adecc4a7-4455-43be-909c-1e3b8abd88b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:19.672338 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecc4a7-4455-43be-909c-1e3b8abd88b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:19.672622 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecc4a7-4455-43be-909c-1e3b8abd88b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:19.672893 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecc4a7-4455-43be-909c-1e3b8abd88b5 admin admin] PATH_INFO: `/v3/projects/dcec0f8dacd442b5959b42faf641b4ab` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:19.674077 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adecc4a7-4455-43be-909c-1e3b8abd88b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcec0f8dacd442b5959b42faf641b4ab)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:19.676200 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adecc4a7-4455-43be-909c-1e3b8abd88b5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:19.746154 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54fb6a-8b93-4706-99a2-c8f694bbdca4 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:19.747663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0e54fb6a-8b93-4706-99a2-c8f694bbdca4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:19.773978 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54fb6a-8b93-4706-99a2-c8f694bbdca4 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:19.785461 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-adecc4a7-4455-43be-909c-1e3b8abd88b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcec0f8dacd442b5959b42faf641b4ab', 'request_id': 'req-adecc4a7-4455-43be-909c-1e3b8abd88b5'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:19.805387 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-adecc4a7-4455-43be-909c-1e3b8abd88b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcec0f8dacd442b5959b42faf641b4ab', 'request_id': 'req-adecc4a7-4455-43be-909c-1e3b8abd88b5'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:19.806804 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:19.821763 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-adecc4a7-4455-43be-909c-1e3b8abd88b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcec0f8dacd442b5959b42faf641b4ab', 'request_id': 'req-adecc4a7-4455-43be-909c-1e3b8abd88b5'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:19.845884 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-adecc4a7-4455-43be-909c-1e3b8abd88b5 admin admin] The token cache is being invalidate because project dcec0f8dacd442b5959b42faf641b4ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:19.846289 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-adecc4a7-4455-43be-909c-1e3b8abd88b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:19.847190 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-adecc4a7-4455-43be-909c-1e3b8abd88b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:19.851832 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 941/1907] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:19 2022] DELETE /identity/v3/projects/dcec0f8dacd442b5959b42faf641b4ab => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:19.856964 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc588bd7-8b8d-40aa-a4c5-d012233c46d3 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:19.857164 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc588bd7-8b8d-40aa-a4c5-d012233c46d3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:19.857476 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc588bd7-8b8d-40aa-a4c5-d012233c46d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:19.858308 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:19.874615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8e7fb-599c-4641-962c-3cd598cdadad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:19.875936 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8e7fb-599c-4641-962c-3cd598cdadad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:19.876427 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8e7fb-599c-4641-962c-3cd598cdadad admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:19.876774 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8e7fb-599c-4641-962c-3cd598cdadad admin admin] PATH_INFO: `/v3/projects/5cf935f125db4f9a9580ee6f441aac21` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:19.878700 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8e7fb-599c-4641-962c-3cd598cdadad admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cf935f125db4f9a9580ee6f441aac21)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:19.881986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8e7fb-599c-4641-962c-3cd598cdadad admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:19.908507 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-fc588bd7-8b8d-40aa-a4c5-d012233c46d3 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:19.909768 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fc588bd7-8b8d-40aa-a4c5-d012233c46d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:19.921454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 942/1908] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:27:19.929354 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35028db3-30fa-4c9b-b3d1-bb11299c644f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:19.929821 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35028db3-30fa-4c9b-b3d1-bb11299c644f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:19.930168 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35028db3-30fa-4c9b-b3d1-bb11299c644f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:19.951600 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-35028db3-30fa-4c9b-b3d1-bb11299c644f None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:19.952811 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-35028db3-30fa-4c9b-b3d1-bb11299c644f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:19.966680 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 943/1909] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:19.974449 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35028db3-30fa-4c9b-b3d1-bb11299c644f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:19.986455 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35028db3-30fa-4c9b-b3d1-bb11299c644f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:19.999306 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-67e8e7fb-599c-4641-962c-3cd598cdadad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cf935f125db4f9a9580ee6f441aac21', 'request_id': 'req-67e8e7fb-599c-4641-962c-3cd598cdadad'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:20.012626 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-67e8e7fb-599c-4641-962c-3cd598cdadad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cf935f125db4f9a9580ee6f441aac21', 'request_id': 'req-67e8e7fb-599c-4641-962c-3cd598cdadad'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:20.031154 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-67e8e7fb-599c-4641-962c-3cd598cdadad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cf935f125db4f9a9580ee6f441aac21', 'request_id': 'req-67e8e7fb-599c-4641-962c-3cd598cdadad'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:20.049847 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-67e8e7fb-599c-4641-962c-3cd598cdadad admin admin] The token cache is being invalidate because project 5cf935f125db4f9a9580ee6f441aac21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:20.050123 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-67e8e7fb-599c-4641-962c-3cd598cdadad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:20.050820 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-67e8e7fb-599c-4641-962c-3cd598cdadad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:20.053479 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 967/1910] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:19 2022] DELETE /identity/v3/projects/5cf935f125db4f9a9580ee6f441aac21 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:27:20.056800 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8e7fb-599c-4641-962c-3cd598cdadad admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:20.058237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-67e8e7fb-599c-4641-962c-3cd598cdadad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:20.073076 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a577f0-d8f3-4b8b-80d4-d414d45a2b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:20.073832 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a577f0-d8f3-4b8b-80d4-d414d45a2b0f admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:20.074219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a577f0-d8f3-4b8b-80d4-d414d45a2b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:20.074560 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a577f0-d8f3-4b8b-80d4-d414d45a2b0f admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:20.075424 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a577f0-d8f3-4b8b-80d4-d414d45a2b0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:27:20.075799 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a577f0-d8f3-4b8b-80d4-d414d45a2b0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:20.077692 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a577f0-d8f3-4b8b-80d4-d414d45a2b0f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:20.091120 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 944/1911] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:27:20.095155 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a577f0-d8f3-4b8b-80d4-d414d45a2b0f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:20.096928 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-51a577f0-d8f3-4b8b-80d4-d414d45a2b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:20.112175 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a577f0-d8f3-4b8b-80d4-d414d45a2b0f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:20.120556 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886832d-1ec4-4808-a277-2719dfa584ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:20.121590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886832d-1ec4-4808-a277-2719dfa584ad admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:20.122014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886832d-1ec4-4808-a277-2719dfa584ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:20.122372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886832d-1ec4-4808-a277-2719dfa584ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:20.123138 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886832d-1ec4-4808-a277-2719dfa584ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:20.125303 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886832d-1ec4-4808-a277-2719dfa584ad admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:20.141194 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8e7fb-599c-4641-962c-3cd598cdadad admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:20.148205 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bac21-06b6-4ed0-8e3a-fb8e0b0dbf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:20.148865 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bac21-06b6-4ed0-8e3a-fb8e0b0dbf7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:20.149236 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bac21-06b6-4ed0-8e3a-fb8e0b0dbf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:20.149593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bac21-06b6-4ed0-8e3a-fb8e0b0dbf7d admin admin] PATH_INFO: `/v3/users/a2917336f3824dbfbb9a00b08d4435e8` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:20.151903 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804bac21-06b6-4ed0-8e3a-fb8e0b0dbf7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2917336f3824dbfbb9a00b08d4435e8)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:20.154771 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804bac21-06b6-4ed0-8e3a-fb8e0b0dbf7d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:20.172337 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 945/1912] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:20 2022] POST /identity/v3/projects => generated 381 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:27:20.173928 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886832d-1ec4-4808-a277-2719dfa584ad admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:20.243094 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-804bac21-06b6-4ed0-8e3a-fb8e0b0dbf7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2917336f3824dbfbb9a00b08d4435e8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:20.246615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-804bac21-06b6-4ed0-8e3a-fb8e0b0dbf7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2917336f3824dbfbb9a00b08d4435e8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:20.301664 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-804bac21-06b6-4ed0-8e3a-fb8e0b0dbf7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2917336f3824dbfbb9a00b08d4435e8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:20.306575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886832d-1ec4-4808-a277-2719dfa584ad admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:20.312660 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f90d3-7294-4ba0-b550-c93e969232a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:20.313583 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f90d3-7294-4ba0-b550-c93e969232a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:20.314071 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f90d3-7294-4ba0-b550-c93e969232a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:20.314705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f90d3-7294-4ba0-b550-c93e969232a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:20.315980 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f90d3-7294-4ba0-b550-c93e969232a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:20.318140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-804bac21-06b6-4ed0-8e3a-fb8e0b0dbf7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2917336f3824dbfbb9a00b08d4435e8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:20.320781 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f90d3-7294-4ba0-b550-c93e969232a4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:20.344614 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-804bac21-06b6-4ed0-8e3a-fb8e0b0dbf7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2917336f3824dbfbb9a00b08d4435e8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:20.346574 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:20.356084 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 968/1913] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:20 2022] DELETE /identity/v3/users/a2917336f3824dbfbb9a00b08d4435e8 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:27:20.358427 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 946/1914] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:20 2022] POST /identity/v3/users => generated 291 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:20.359243 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bac21-06b6-4ed0-8e3a-fb8e0b0dbf7d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:20.361855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-804bac21-06b6-4ed0-8e3a-fb8e0b0dbf7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:20.450879 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bac21-06b6-4ed0-8e3a-fb8e0b0dbf7d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:20.456039 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47afa18-6ad3-454e-a9bb-2a2d7a6d960d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:20.456661 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47afa18-6ad3-454e-a9bb-2a2d7a6d960d admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:20.456939 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47afa18-6ad3-454e-a9bb-2a2d7a6d960d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:20.457211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47afa18-6ad3-454e-a9bb-2a2d7a6d960d admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:20.457931 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47afa18-6ad3-454e-a9bb-2a2d7a6d960d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:20.459603 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47afa18-6ad3-454e-a9bb-2a2d7a6d960d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:20.474931 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f90d3-7294-4ba0-b550-c93e969232a4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:20.486244 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f90d3-7294-4ba0-b550-c93e969232a4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:20.487302 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 969/1915] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:27:20.492704 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac337d2-7d89-4ea7-9125-f0f791b1310b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:20.493386 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac337d2-7d89-4ea7-9125-f0f791b1310b admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:20.493650 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac337d2-7d89-4ea7-9125-f0f791b1310b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:20.494040 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac337d2-7d89-4ea7-9125-f0f791b1310b admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:20.494828 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac337d2-7d89-4ea7-9125-f0f791b1310b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:20.497254 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac337d2-7d89-4ea7-9125-f0f791b1310b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:20.517765 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47afa18-6ad3-454e-a9bb-2a2d7a6d960d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:20.530783 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 947/1916] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:27:20.534175 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47afa18-6ad3-454e-a9bb-2a2d7a6d960d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:20.540968 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026c54a-ae39-4e67-b1f3-da8f34acac53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:20.541810 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026c54a-ae39-4e67-b1f3-da8f34acac53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:20.542462 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026c54a-ae39-4e67-b1f3-da8f34acac53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:20.542625 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026c54a-ae39-4e67-b1f3-da8f34acac53 admin admin] PATH_INFO: `/v3/projects/1a7ee756c07a49b380d308a77afd181d/users/be42ce89afca48aa88910f2f8dcd157a/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:20.566709 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026c54a-ae39-4e67-b1f3-da8f34acac53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a7ee756c07a49b380d308a77afd181d, user_id=be42ce89afca48aa88910f2f8dcd157a, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:20.570694 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026c54a-ae39-4e67-b1f3-da8f34acac53 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:20.595264 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 970/1917] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:20 2022] PUT /identity/v3/projects/1a7ee756c07a49b380d308a77afd181d/users/be42ce89afca48aa88910f2f8dcd157a/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:20.607453 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23c03e-f2b6-4ab9-8caa-18fb28a50703 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:20.607748 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23c03e-f2b6-4ab9-8caa-18fb28a50703 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:20.608029 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23c03e-f2b6-4ab9-8caa-18fb28a50703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:20.655800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-dd23c03e-f2b6-4ab9-8caa-18fb28a50703 None None] MFA Rules not processed for user `be42ce89afca48aa88910f2f8dcd157a`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:20.656944 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dd23c03e-f2b6-4ab9-8caa-18fb28a50703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:20.679078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:20.795170 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 948/1918] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:20.799934 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026c54a-ae39-4e67-b1f3-da8f34acac53 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:20.880622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026c54a-ae39-4e67-b1f3-da8f34acac53 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:20.887113 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748751b-178b-4be1-88d1-3c0e05ee9cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:20.887749 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748751b-178b-4be1-88d1-3c0e05ee9cad admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:20.888031 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748751b-178b-4be1-88d1-3c0e05ee9cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:20.888330 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748751b-178b-4be1-88d1-3c0e05ee9cad admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:20.889008 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748751b-178b-4be1-88d1-3c0e05ee9cad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:20.891323 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748751b-178b-4be1-88d1-3c0e05ee9cad admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:20.942610 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 971/1919] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:20 2022] POST /identity/v3/projects => generated 381 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:20.946828 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23c03e-f2b6-4ab9-8caa-18fb28a50703 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:20.958699 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23c03e-f2b6-4ab9-8caa-18fb28a50703 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:21.026746 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748751b-178b-4be1-88d1-3c0e05ee9cad admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:21.029137 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6748751b-178b-4be1-88d1-3c0e05ee9cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:21.083548 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744ff59-a60e-4a06-b7c2-dda4d1305c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:21.085131 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744ff59-a60e-4a06-b7c2-dda4d1305c05 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:21.085311 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744ff59-a60e-4a06-b7c2-dda4d1305c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:21.085603 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744ff59-a60e-4a06-b7c2-dda4d1305c05 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:21.086256 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744ff59-a60e-4a06-b7c2-dda4d1305c05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:21.089298 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744ff59-a60e-4a06-b7c2-dda4d1305c05 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:21.129549 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 949/1920] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:20 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:27:21.130809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:21.132161 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744ff59-a60e-4a06-b7c2-dda4d1305c05 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:21.135028 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748751b-178b-4be1-88d1-3c0e05ee9cad admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:21.152391 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744ff59-a60e-4a06-b7c2-dda4d1305c05 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:21.155078 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4058f55-8d50-4cbe-bd27-705dd9f29b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:21.155805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4058f55-8d50-4cbe-bd27-705dd9f29b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:21.156094 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4058f55-8d50-4cbe-bd27-705dd9f29b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:21.156368 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4058f55-8d50-4cbe-bd27-705dd9f29b89 admin admin] PATH_INFO: `/v3/projects/325b91abc57e4727b592ea8d21447204` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:21.160389 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b0a57-8cfb-420e-80b9-ea55543b3280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:21.161167 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b0a57-8cfb-420e-80b9-ea55543b3280 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:21.161471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b0a57-8cfb-420e-80b9-ea55543b3280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:21.161748 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b0a57-8cfb-420e-80b9-ea55543b3280 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:21.164475 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b0a57-8cfb-420e-80b9-ea55543b3280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:21.164872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4058f55-8d50-4cbe-bd27-705dd9f29b89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=325b91abc57e4727b592ea8d21447204)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:21.166892 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b0a57-8cfb-420e-80b9-ea55543b3280 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:21.167009 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4058f55-8d50-4cbe-bd27-705dd9f29b89 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:21.204304 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 950/1921] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:21.205769 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b0a57-8cfb-420e-80b9-ea55543b3280 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:21.228557 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b0a57-8cfb-420e-80b9-ea55543b3280 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:21.246103 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f4058f55-8d50-4cbe-bd27-705dd9f29b89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '325b91abc57e4727b592ea8d21447204', 'request_id': 'req-f4058f55-8d50-4cbe-bd27-705dd9f29b89'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:21.256763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f4058f55-8d50-4cbe-bd27-705dd9f29b89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '325b91abc57e4727b592ea8d21447204', 'request_id': 'req-f4058f55-8d50-4cbe-bd27-705dd9f29b89'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:21.267910 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f4058f55-8d50-4cbe-bd27-705dd9f29b89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '325b91abc57e4727b592ea8d21447204', 'request_id': 'req-f4058f55-8d50-4cbe-bd27-705dd9f29b89'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:21.288260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f4058f55-8d50-4cbe-bd27-705dd9f29b89 admin admin] The token cache is being invalidate because project 325b91abc57e4727b592ea8d21447204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:21.288550 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f4058f55-8d50-4cbe-bd27-705dd9f29b89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:21.289196 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f4058f55-8d50-4cbe-bd27-705dd9f29b89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:21.291198 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 972/1922] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:21 2022] DELETE /identity/v3/projects/325b91abc57e4727b592ea8d21447204 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:21.295660 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17bff3-0dec-42c3-b0c4-3931624cc51a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:21.295940 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17bff3-0dec-42c3-b0c4-3931624cc51a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:21.296215 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17bff3-0dec-42c3-b0c4-3931624cc51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:21.313026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfbfaf-1854-4421-9463-c1e4abfb71e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:21.313766 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfbfaf-1854-4421-9463-c1e4abfb71e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:21.314062 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfbfaf-1854-4421-9463-c1e4abfb71e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:21.314619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfbfaf-1854-4421-9463-c1e4abfb71e1 admin admin] PATH_INFO: `/v3/projects/e4537115b61d4810894bfde2f275d808/users/a2fd61fa86b7401da9a3e2d1cac0f1cc/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:21.318119 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8a17bff3-0dec-42c3-b0c4-3931624cc51a None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:21.319238 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8a17bff3-0dec-42c3-b0c4-3931624cc51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:21.328550 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 973/1923] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:27:21.332235 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfbfaf-1854-4421-9463-c1e4abfb71e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4537115b61d4810894bfde2f275d808, user_id=a2fd61fa86b7401da9a3e2d1cac0f1cc, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:21.336995 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32b26d-fe58-4f13-9fb5-e2cbc81d3960 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:21.337282 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32b26d-fe58-4f13-9fb5-e2cbc81d3960 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:21.337585 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfbfaf-1854-4421-9463-c1e4abfb71e1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:21.337686 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32b26d-fe58-4f13-9fb5-e2cbc81d3960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:21.353933 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 951/1924] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:21 2022] PUT /identity/v3/projects/e4537115b61d4810894bfde2f275d808/users/a2fd61fa86b7401da9a3e2d1cac0f1cc/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:21.357731 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfbfaf-1854-4421-9463-c1e4abfb71e1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:21.359479 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e4cfbfaf-1854-4421-9463-c1e4abfb71e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:21.360605 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6e32b26d-fe58-4f13-9fb5-e2cbc81d3960 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:21.361890 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6e32b26d-fe58-4f13-9fb5-e2cbc81d3960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:21.380509 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:21.431691 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfbfaf-1854-4421-9463-c1e4abfb71e1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:21.438153 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53185fa7-ce40-4fe2-a97e-a10cd1793a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:21.438901 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53185fa7-ce40-4fe2-a97e-a10cd1793a32 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:21.439439 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53185fa7-ce40-4fe2-a97e-a10cd1793a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:21.439710 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53185fa7-ce40-4fe2-a97e-a10cd1793a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:21.440385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53185fa7-ce40-4fe2-a97e-a10cd1793a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:21.442019 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53185fa7-ce40-4fe2-a97e-a10cd1793a32 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:21.466382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 952/1925] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:21.470144 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53185fa7-ce40-4fe2-a97e-a10cd1793a32 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:21.470715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 974/1926] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:27:21.474786 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32b26d-fe58-4f13-9fb5-e2cbc81d3960 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:21.486456 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32b26d-fe58-4f13-9fb5-e2cbc81d3960 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:21.487295 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53185fa7-ce40-4fe2-a97e-a10cd1793a32 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:21.492079 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0417a-76a3-469c-8c89-8f9912b56e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:21.492683 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0417a-76a3-469c-8c89-8f9912b56e18 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:21.493113 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0417a-76a3-469c-8c89-8f9912b56e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:21.493535 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0417a-76a3-469c-8c89-8f9912b56e18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:21.494227 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0417a-76a3-469c-8c89-8f9912b56e18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:27:21.494527 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0417a-76a3-469c-8c89-8f9912b56e18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:21.496342 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0417a-76a3-469c-8c89-8f9912b56e18 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:21.503700 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e397fd-9fc3-4d20-95e1-a39ab5261fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:21.504433 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e397fd-9fc3-4d20-95e1-a39ab5261fca admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:21.504804 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e397fd-9fc3-4d20-95e1-a39ab5261fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:21.505055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e397fd-9fc3-4d20-95e1-a39ab5261fca admin admin] PATH_INFO: `/v3/projects/e4537115b61d4810894bfde2f275d808/users/a2fd61fa86b7401da9a3e2d1cac0f1cc/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:21.509533 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e397fd-9fc3-4d20-95e1-a39ab5261fca admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4537115b61d4810894bfde2f275d808, user_id=a2fd61fa86b7401da9a3e2d1cac0f1cc, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:21.516637 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e397fd-9fc3-4d20-95e1-a39ab5261fca admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:21.517649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 975/1927] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:27:21.519275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0417a-76a3-469c-8c89-8f9912b56e18 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:21.533859 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 953/1928] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:21 2022] PUT /identity/v3/projects/e4537115b61d4810894bfde2f275d808/users/a2fd61fa86b7401da9a3e2d1cac0f1cc/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:27:21.545761 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9a6fa-2400-472a-808d-d605ec226031 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:21.546337 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9a6fa-2400-472a-808d-d605ec226031 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:21.546618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9a6fa-2400-472a-808d-d605ec226031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:21.549769 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0417a-76a3-469c-8c89-8f9912b56e18 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:21.584982 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-15f9a6fa-2400-472a-808d-d605ec226031 None None] MFA Rules not processed for user `a2fd61fa86b7401da9a3e2d1cac0f1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:21.586540 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-15f9a6fa-2400-472a-808d-d605ec226031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:21.681476 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69556f-59ba-43a5-abf7-d30cdd8d6d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:21.682227 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69556f-59ba-43a5-abf7-d30cdd8d6d5d admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:21.682497 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69556f-59ba-43a5-abf7-d30cdd8d6d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:21.682769 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69556f-59ba-43a5-abf7-d30cdd8d6d5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:21.683407 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69556f-59ba-43a5-abf7-d30cdd8d6d5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:21.685502 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69556f-59ba-43a5-abf7-d30cdd8d6d5d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:21.703640 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:21.726894 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 954/1929] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:21 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:27:21.744511 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9a6fa-2400-472a-808d-d605ec226031 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:21.746148 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-15f9a6fa-2400-472a-808d-d605ec226031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:21.757495 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 976/1930] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:21 2022] POST /identity/v3/projects => generated 387 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:21.758753 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69556f-59ba-43a5-abf7-d30cdd8d6d5d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:21.828038 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9a6fa-2400-472a-808d-d605ec226031 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:21.877536 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:21.890846 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eaf04b-2c41-493d-8dfc-89ab26d2c631 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:21.891473 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eaf04b-2c41-493d-8dfc-89ab26d2c631 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:21.891754 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eaf04b-2c41-493d-8dfc-89ab26d2c631 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:21.892029 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eaf04b-2c41-493d-8dfc-89ab26d2c631 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:21.894312 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69556f-59ba-43a5-abf7-d30cdd8d6d5d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:21.900195 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1652b00-87a4-48c5-b51e-56cb3df5d1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:21.901200 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1652b00-87a4-48c5-b51e-56cb3df5d1a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:21.901534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1652b00-87a4-48c5-b51e-56cb3df5d1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:21.901918 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1652b00-87a4-48c5-b51e-56cb3df5d1a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:21.902562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1652b00-87a4-48c5-b51e-56cb3df5d1a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:21.904895 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1652b00-87a4-48c5-b51e-56cb3df5d1a2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:21.934359 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 977/1931] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:21 2022] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:21.939049 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1652b00-87a4-48c5-b51e-56cb3df5d1a2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:21.950173 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1652b00-87a4-48c5-b51e-56cb3df5d1a2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:21.956294 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e165ae7-fae5-46e0-825e-8ba504d851b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:21.957623 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e165ae7-fae5-46e0-825e-8ba504d851b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:21.957623 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e165ae7-fae5-46e0-825e-8ba504d851b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:21.958030 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e165ae7-fae5-46e0-825e-8ba504d851b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:21.959536 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e165ae7-fae5-46e0-825e-8ba504d851b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:21.961276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e165ae7-fae5-46e0-825e-8ba504d851b4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:21.968898 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eaf04b-2c41-493d-8dfc-89ab26d2c631 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:21.971386 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eaf04b-2c41-493d-8dfc-89ab26d2c631 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:21.974305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 978/1932] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:27:21.978835 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e165ae7-fae5-46e0-825e-8ba504d851b4 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:21.983332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 955/1933] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:21 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:21.989023 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e165ae7-fae5-46e0-825e-8ba504d851b4 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:21.993756 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a0171-3cdd-427d-81eb-c12ef16749a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:21.994354 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a0171-3cdd-427d-81eb-c12ef16749a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:21.994634 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a0171-3cdd-427d-81eb-c12ef16749a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:21.994908 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a0171-3cdd-427d-81eb-c12ef16749a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:21.995543 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a0171-3cdd-427d-81eb-c12ef16749a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:21.997164 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a0171-3cdd-427d-81eb-c12ef16749a0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:22.007784 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 979/1934] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:27:22.012053 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eaf04b-2c41-493d-8dfc-89ab26d2c631 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:22.022964 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eaf04b-2c41-493d-8dfc-89ab26d2c631 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:22.028213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef631b-6226-4aec-8693-d0dba0b14123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:22.028880 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef631b-6226-4aec-8693-d0dba0b14123 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:22.029160 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef631b-6226-4aec-8693-d0dba0b14123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:22.029531 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef631b-6226-4aec-8693-d0dba0b14123 admin admin] PATH_INFO: `/v3/projects/e55557b7faa74fbdb5a5a239db6d9c86/users/0ce843db1cd14905936226a938039637/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:22.048510 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef631b-6226-4aec-8693-d0dba0b14123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e55557b7faa74fbdb5a5a239db6d9c86, user_id=0ce843db1cd14905936226a938039637, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:22.051536 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef631b-6226-4aec-8693-d0dba0b14123 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:22.068590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 956/1935] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:22 2022] PUT /identity/v3/projects/e55557b7faa74fbdb5a5a239db6d9c86/users/0ce843db1cd14905936226a938039637/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:22.076123 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a0171-3cdd-427d-81eb-c12ef16749a0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:22.079074 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aad88e-40ec-4e5f-979b-5d3b90ac7dc0 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:22.079480 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aad88e-40ec-4e5f-979b-5d3b90ac7dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:22.079826 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aad88e-40ec-4e5f-979b-5d3b90ac7dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:22.086532 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a0171-3cdd-427d-81eb-c12ef16749a0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:22.112870 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-75aad88e-40ec-4e5f-979b-5d3b90ac7dc0 None None] MFA Rules not processed for user `0ce843db1cd14905936226a938039637`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:22.114589 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-75aad88e-40ec-4e5f-979b-5d3b90ac7dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:22.149146 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218151a-d9d9-43b8-8f7e-64b153766d4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:22.149866 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218151a-d9d9-43b8-8f7e-64b153766d4c service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:22.150361 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218151a-d9d9-43b8-8f7e-64b153766d4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:22.150849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218151a-d9d9-43b8-8f7e-64b153766d4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:22.152720 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4218151a-d9d9-43b8-8f7e-64b153766d4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:22.192396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 957/1936] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:22.196425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aad88e-40ec-4e5f-979b-5d3b90ac7dc0 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:22.227418 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218151a-d9d9-43b8-8f7e-64b153766d4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:22.228924 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218151a-d9d9-43b8-8f7e-64b153766d4c service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:22.239508 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 980/1937] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:22.258564 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:22.270528 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aad88e-40ec-4e5f-979b-5d3b90ac7dc0 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:22.277605 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4046f-9f36-4a9e-81b6-ac1f5a97abc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:22.278343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4046f-9f36-4a9e-81b6-ac1f5a97abc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:22.278716 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4046f-9f36-4a9e-81b6-ac1f5a97abc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:22.279085 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4046f-9f36-4a9e-81b6-ac1f5a97abc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:22.279853 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4046f-9f36-4a9e-81b6-ac1f5a97abc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:22.282311 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4046f-9f36-4a9e-81b6-ac1f5a97abc5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:22.320732 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 958/1938] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:22 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:27:22.324574 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218151a-d9d9-43b8-8f7e-64b153766d4c service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:22.348822 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218151a-d9d9-43b8-8f7e-64b153766d4c service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:22.368675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:22.482325 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95bb5b-e6a7-48e1-a35c-144c7b112ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:22.482969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95bb5b-e6a7-48e1-a35c-144c7b112ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:22.483249 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95bb5b-e6a7-48e1-a35c-144c7b112ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:22.483517 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95bb5b-e6a7-48e1-a35c-144c7b112ca8 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:22.486088 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95bb5b-e6a7-48e1-a35c-144c7b112ca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:22.490762 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95bb5b-e6a7-48e1-a35c-144c7b112ca8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:22.523617 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 981/1939] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:22 2022] POST /identity/v3/users => generated 300 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:22.528537 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4046f-9f36-4a9e-81b6-ac1f5a97abc5 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:22.554453 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4046f-9f36-4a9e-81b6-ac1f5a97abc5 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:22.560285 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b91d3-ba80-4d69-9cfa-dd6e98270d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:22.561229 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b91d3-ba80-4d69-9cfa-dd6e98270d73 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:22.561768 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b91d3-ba80-4d69-9cfa-dd6e98270d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:22.562215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b91d3-ba80-4d69-9cfa-dd6e98270d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:22.563123 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b91d3-ba80-4d69-9cfa-dd6e98270d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:22.565166 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b91d3-ba80-4d69-9cfa-dd6e98270d73 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:22.577982 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 959/1940] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:22.581957 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95bb5b-e6a7-48e1-a35c-144c7b112ca8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:22.598027 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95bb5b-e6a7-48e1-a35c-144c7b112ca8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:22.603074 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4a7bf-06c0-439e-8154-77e328c8312f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:22.603745 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4a7bf-06c0-439e-8154-77e328c8312f admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:22.604188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4a7bf-06c0-439e-8154-77e328c8312f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:22.604530 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4a7bf-06c0-439e-8154-77e328c8312f admin admin] PATH_INFO: `/v3/projects/44c29fc47ec54d88b64fc7fe6d827af3/users/dd6e1ab1740f459ba9ffef0f0e906dbd/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:22.635703 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4a7bf-06c0-439e-8154-77e328c8312f admin admin] RBAC: Authorizing `identity:create_grant(project_id=44c29fc47ec54d88b64fc7fe6d827af3, user_id=dd6e1ab1740f459ba9ffef0f0e906dbd, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:22.641507 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4a7bf-06c0-439e-8154-77e328c8312f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:22.662453 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b91d3-ba80-4d69-9cfa-dd6e98270d73 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:22.671692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 982/1941] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:22 2022] PUT /identity/v3/projects/44c29fc47ec54d88b64fc7fe6d827af3/users/dd6e1ab1740f459ba9ffef0f0e906dbd/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:22.675444 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4a7bf-06c0-439e-8154-77e328c8312f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:22.676381 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b91d3-ba80-4d69-9cfa-dd6e98270d73 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:22.758208 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba065c4-8e67-4342-aa35-56d143eea93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:22.759274 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba065c4-8e67-4342-aa35-56d143eea93c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:22.759784 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba065c4-8e67-4342-aa35-56d143eea93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:22.760130 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba065c4-8e67-4342-aa35-56d143eea93c admin admin] PATH_INFO: `/v3/users/be42ce89afca48aa88910f2f8dcd157a` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:22.762229 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba065c4-8e67-4342-aa35-56d143eea93c admin admin] RBAC: Authorizing `identity:delete_user(user_id=be42ce89afca48aa88910f2f8dcd157a)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:22.765378 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba065c4-8e67-4342-aa35-56d143eea93c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:22.777683 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4a7bf-06c0-439e-8154-77e328c8312f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:22.784221 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee671b37-02f1-4341-bb95-a7eb69cf0f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:22.785676 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee671b37-02f1-4341-bb95-a7eb69cf0f16 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:22.785874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee671b37-02f1-4341-bb95-a7eb69cf0f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:22.787766 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee671b37-02f1-4341-bb95-a7eb69cf0f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:22.789354 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee671b37-02f1-4341-bb95-a7eb69cf0f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:22.792251 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee671b37-02f1-4341-bb95-a7eb69cf0f16 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:22.808550 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 983/1942] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:27:22.809386 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee671b37-02f1-4341-bb95-a7eb69cf0f16 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:22.811779 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ee671b37-02f1-4341-bb95-a7eb69cf0f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:22.830395 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee671b37-02f1-4341-bb95-a7eb69cf0f16 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:22.836631 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413a054-b296-4669-8465-08937fbdb4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:22.837656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413a054-b296-4669-8465-08937fbdb4d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:22.838065 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413a054-b296-4669-8465-08937fbdb4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:22.838424 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413a054-b296-4669-8465-08937fbdb4d8 admin admin] PATH_INFO: `/v3/users/b71d60c5888a432abb26fafeac4dada1` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:22.839888 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413a054-b296-4669-8465-08937fbdb4d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b71d60c5888a432abb26fafeac4dada1)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:22.842356 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413a054-b296-4669-8465-08937fbdb4d8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:22.866736 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fba065c4-8e67-4342-aa35-56d143eea93c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be42ce89afca48aa88910f2f8dcd157a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:22.870871 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fba065c4-8e67-4342-aa35-56d143eea93c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be42ce89afca48aa88910f2f8dcd157a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:22.886718 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fba065c4-8e67-4342-aa35-56d143eea93c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be42ce89afca48aa88910f2f8dcd157a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:22.887618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fba065c4-8e67-4342-aa35-56d143eea93c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be42ce89afca48aa88910f2f8dcd157a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:22.909277 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fba065c4-8e67-4342-aa35-56d143eea93c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be42ce89afca48aa88910f2f8dcd157a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:22.945935 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b413a054-b296-4669-8465-08937fbdb4d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b71d60c5888a432abb26fafeac4dada1'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:22.946724 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b413a054-b296-4669-8465-08937fbdb4d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b71d60c5888a432abb26fafeac4dada1'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:22.961443 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 960/1943] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:22 2022] DELETE /identity/v3/users/be42ce89afca48aa88910f2f8dcd157a => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:22.961443 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba065c4-8e67-4342-aa35-56d143eea93c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:22.961443 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fba065c4-8e67-4342-aa35-56d143eea93c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:22.972518 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b413a054-b296-4669-8465-08937fbdb4d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b71d60c5888a432abb26fafeac4dada1'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:22.983388 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:22.992776 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b413a054-b296-4669-8465-08937fbdb4d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b71d60c5888a432abb26fafeac4dada1'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:23.009489 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b413a054-b296-4669-8465-08937fbdb4d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b71d60c5888a432abb26fafeac4dada1'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:23.025113 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 984/1944] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:22 2022] DELETE /identity/v3/users/b71d60c5888a432abb26fafeac4dada1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:23.026447 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cb349-340e-4931-b8a2-7c158547b33e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:23.026738 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cb349-340e-4931-b8a2-7c158547b33e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:23.027018 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cb349-340e-4931-b8a2-7c158547b33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:23.047804 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:23.062212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b68cb349-340e-4931-b8a2-7c158547b33e None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:23.063755 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b68cb349-340e-4931-b8a2-7c158547b33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:23.078154 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba065c4-8e67-4342-aa35-56d143eea93c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:23.169386 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 985/1945] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:23.169386 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e0e1e-fb8d-46f5-b14a-fc65cb0035b3 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:23.169386 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e0e1e-fb8d-46f5-b14a-fc65cb0035b3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:23.169386 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e0e1e-fb8d-46f5-b14a-fc65cb0035b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:23.199944 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71d1ef-8a08-4efe-92ba-561dd54860e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:23.200756 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71d1ef-8a08-4efe-92ba-561dd54860e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:23.201089 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71d1ef-8a08-4efe-92ba-561dd54860e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:23.201368 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71d1ef-8a08-4efe-92ba-561dd54860e8 admin admin] PATH_INFO: `/v3/projects/44c29fc47ec54d88b64fc7fe6d827af3/users/dd6e1ab1740f459ba9ffef0f0e906dbd/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:23.203643 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71d1ef-8a08-4efe-92ba-561dd54860e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44c29fc47ec54d88b64fc7fe6d827af3, user_id=dd6e1ab1740f459ba9ffef0f0e906dbd, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:23.207035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71d1ef-8a08-4efe-92ba-561dd54860e8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:23.210580 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-aa4e0e1e-fb8d-46f5-b14a-fc65cb0035b3 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:23.212202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-aa4e0e1e-fb8d-46f5-b14a-fc65cb0035b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:23.221614 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 986/1946] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:23.222354 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e0e1e-fb8d-46f5-b14a-fc65cb0035b3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:23.223615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-aa4e0e1e-fb8d-46f5-b14a-fc65cb0035b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:23.228695 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 961/1947] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:22 2022] PUT /identity/v3/projects/44c29fc47ec54d88b64fc7fe6d827af3/users/dd6e1ab1740f459ba9ffef0f0e906dbd/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:23.234608 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71d1ef-8a08-4efe-92ba-561dd54860e8 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:23.244100 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0c71d1ef-8a08-4efe-92ba-561dd54860e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:23.319459 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e0e1e-fb8d-46f5-b14a-fc65cb0035b3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:23.374506 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71d1ef-8a08-4efe-92ba-561dd54860e8 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:23.378953 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532047e-54b5-4b58-9d8a-958270a3ffe8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:23.379851 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532047e-54b5-4b58-9d8a-958270a3ffe8 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:23.381206 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532047e-54b5-4b58-9d8a-958270a3ffe8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:23.381722 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532047e-54b5-4b58-9d8a-958270a3ffe8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:23.427982 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3756fc-2ec5-482e-87b3-dff0a21edac9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:23.428967 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3756fc-2ec5-482e-87b3-dff0a21edac9 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:23.429523 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3756fc-2ec5-482e-87b3-dff0a21edac9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:23.430014 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3756fc-2ec5-482e-87b3-dff0a21edac9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:23.572671 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:23.590311 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532047e-54b5-4b58-9d8a-958270a3ffe8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:23.593687 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532047e-54b5-4b58-9d8a-958270a3ffe8 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:23.610739 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3756fc-2ec5-482e-87b3-dff0a21edac9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:23.612518 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3756fc-2ec5-482e-87b3-dff0a21edac9 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:23.617861 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 962/1948] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:23.628605 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 987/1949] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:23.635600 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d18f2c-ffb7-4162-aa74-5371ef583071 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:23.635899 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d18f2c-ffb7-4162-aa74-5371ef583071 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:23.636178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d18f2c-ffb7-4162-aa74-5371ef583071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:23.699038 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e2d18f2c-ffb7-4162-aa74-5371ef583071 None None] MFA Rules not processed for user `dd6e1ab1740f459ba9ffef0f0e906dbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:23.700468 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e2d18f2c-ffb7-4162-aa74-5371ef583071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:23.783601 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:23.855428 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 963/1950] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:23 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:23.866359 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3756fc-2ec5-482e-87b3-dff0a21edac9 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:23.868413 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2a3756fc-2ec5-482e-87b3-dff0a21edac9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:23.961284 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3756fc-2ec5-482e-87b3-dff0a21edac9 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:23.965574 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c58d7-454c-4945-9f77-04f3b4d499d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:23.966254 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c58d7-454c-4945-9f77-04f3b4d499d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:23.966541 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c58d7-454c-4945-9f77-04f3b4d499d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:23.966813 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c58d7-454c-4945-9f77-04f3b4d499d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:23.979551 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c58d7-454c-4945-9f77-04f3b4d499d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:23.981370 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c58d7-454c-4945-9f77-04f3b4d499d1 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:23.996516 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 988/1951] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:23 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:24.166546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d18f2c-ffb7-4162-aa74-5371ef583071 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:24.168058 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e2d18f2c-ffb7-4162-aa74-5371ef583071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:24.201446 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d18f2c-ffb7-4162-aa74-5371ef583071 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:24.226787 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aeddd7-6740-4075-9407-917a986bb9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:24.237114 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aeddd7-6740-4075-9407-917a986bb9f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:24.238891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aeddd7-6740-4075-9407-917a986bb9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:24.241638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aeddd7-6740-4075-9407-917a986bb9f0 admin admin] PATH_INFO: `/v3/projects/1a7ee756c07a49b380d308a77afd181d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:24.244455 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aeddd7-6740-4075-9407-917a986bb9f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a7ee756c07a49b380d308a77afd181d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:24.248913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aeddd7-6740-4075-9407-917a986bb9f0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:24.293913 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c58d7-454c-4945-9f77-04f3b4d499d1 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:24.300218 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a92c58d7-454c-4945-9f77-04f3b4d499d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:24.346444 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c58d7-454c-4945-9f77-04f3b4d499d1 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:24.396911 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-14aeddd7-6740-4075-9407-917a986bb9f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a7ee756c07a49b380d308a77afd181d', 'request_id': 'req-14aeddd7-6740-4075-9407-917a986bb9f0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:24.409188 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-14aeddd7-6740-4075-9407-917a986bb9f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a7ee756c07a49b380d308a77afd181d', 'request_id': 'req-14aeddd7-6740-4075-9407-917a986bb9f0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:24.443663 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-14aeddd7-6740-4075-9407-917a986bb9f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a7ee756c07a49b380d308a77afd181d', 'request_id': 'req-14aeddd7-6740-4075-9407-917a986bb9f0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:24.473037 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-14aeddd7-6740-4075-9407-917a986bb9f0 admin admin] The token cache is being invalidate because project 1a7ee756c07a49b380d308a77afd181d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:24.473340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-14aeddd7-6740-4075-9407-917a986bb9f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:24.474043 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-14aeddd7-6740-4075-9407-917a986bb9f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:24.476632 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 964/1952] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:24 2022] DELETE /identity/v3/projects/1a7ee756c07a49b380d308a77afd181d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:24.480159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aeddd7-6740-4075-9407-917a986bb9f0 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:24.483591 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485076fa-148d-42a8-8b9a-bb5770c95e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:24.484631 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485076fa-148d-42a8-8b9a-bb5770c95e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:24.485045 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485076fa-148d-42a8-8b9a-bb5770c95e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:24.485306 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485076fa-148d-42a8-8b9a-bb5770c95e96 admin admin] PATH_INFO: `/v3/projects/f0ec229ce12f43ecbeb08df98836149d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:24.485453 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-14aeddd7-6740-4075-9407-917a986bb9f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:24.486766 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485076fa-148d-42a8-8b9a-bb5770c95e96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0ec229ce12f43ecbeb08df98836149d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:24.488923 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485076fa-148d-42a8-8b9a-bb5770c95e96 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:24.519212 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aeddd7-6740-4075-9407-917a986bb9f0 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:24.532367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f353c1-60e1-4834-aa51-962661f8e836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:24.532950 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f353c1-60e1-4834-aa51-962661f8e836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:24.533522 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f353c1-60e1-4834-aa51-962661f8e836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:24.533805 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f353c1-60e1-4834-aa51-962661f8e836 admin admin] PATH_INFO: `/v3/users/a2fd61fa86b7401da9a3e2d1cac0f1cc` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:24.554530 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f353c1-60e1-4834-aa51-962661f8e836 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2fd61fa86b7401da9a3e2d1cac0f1cc)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:24.558828 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-485076fa-148d-42a8-8b9a-bb5770c95e96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0ec229ce12f43ecbeb08df98836149d', 'request_id': 'req-485076fa-148d-42a8-8b9a-bb5770c95e96'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:24.559347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f353c1-60e1-4834-aa51-962661f8e836 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:24.571314 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-485076fa-148d-42a8-8b9a-bb5770c95e96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0ec229ce12f43ecbeb08df98836149d', 'request_id': 'req-485076fa-148d-42a8-8b9a-bb5770c95e96'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:24.590107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-485076fa-148d-42a8-8b9a-bb5770c95e96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0ec229ce12f43ecbeb08df98836149d', 'request_id': 'req-485076fa-148d-42a8-8b9a-bb5770c95e96'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:24.614682 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-485076fa-148d-42a8-8b9a-bb5770c95e96 admin admin] The token cache is being invalidate because project f0ec229ce12f43ecbeb08df98836149d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:24.614917 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-485076fa-148d-42a8-8b9a-bb5770c95e96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:24.616378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-485076fa-148d-42a8-8b9a-bb5770c95e96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:24.623892 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 989/1953] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:24 2022] DELETE /identity/v3/projects/f0ec229ce12f43ecbeb08df98836149d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:24.623892 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485076fa-148d-42a8-8b9a-bb5770c95e96 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:24.625036 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-485076fa-148d-42a8-8b9a-bb5770c95e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:24.660770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-77f353c1-60e1-4834-aa51-962661f8e836 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2fd61fa86b7401da9a3e2d1cac0f1cc'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:24.663456 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-77f353c1-60e1-4834-aa51-962661f8e836 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2fd61fa86b7401da9a3e2d1cac0f1cc'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:24.675569 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-77f353c1-60e1-4834-aa51-962661f8e836 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2fd61fa86b7401da9a3e2d1cac0f1cc'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:24.678726 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:24.680051 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-77f353c1-60e1-4834-aa51-962661f8e836 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2fd61fa86b7401da9a3e2d1cac0f1cc'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:24.703142 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-77f353c1-60e1-4834-aa51-962661f8e836 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2fd61fa86b7401da9a3e2d1cac0f1cc'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:24.750647 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 965/1954] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:24 2022] DELETE /identity/v3/users/a2fd61fa86b7401da9a3e2d1cac0f1cc => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:24.766101 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485076fa-148d-42a8-8b9a-bb5770c95e96 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:24.858592 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3877a-03f7-4739-9f9d-27b79693f0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:24.859607 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3877a-03f7-4739-9f9d-27b79693f0b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:24.859942 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3877a-03f7-4739-9f9d-27b79693f0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:24.860297 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3877a-03f7-4739-9f9d-27b79693f0b6 admin admin] PATH_INFO: `/v3/users/43daacff364247bf853b432d14f6ef0f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:24.861913 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3877a-03f7-4739-9f9d-27b79693f0b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43daacff364247bf853b432d14f6ef0f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:24.864536 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3877a-03f7-4739-9f9d-27b79693f0b6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:24.949601 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3bd3877a-03f7-4739-9f9d-27b79693f0b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43daacff364247bf853b432d14f6ef0f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:24.952813 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3bd3877a-03f7-4739-9f9d-27b79693f0b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43daacff364247bf853b432d14f6ef0f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:24.979904 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3bd3877a-03f7-4739-9f9d-27b79693f0b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43daacff364247bf853b432d14f6ef0f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:25.007430 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3bd3877a-03f7-4739-9f9d-27b79693f0b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43daacff364247bf853b432d14f6ef0f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:25.017139 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3bd3877a-03f7-4739-9f9d-27b79693f0b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43daacff364247bf853b432d14f6ef0f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:25.024961 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 990/1955] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:24 2022] DELETE /identity/v3/users/43daacff364247bf853b432d14f6ef0f => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:27:25.082948 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f353c1-60e1-4834-aa51-962661f8e836 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:25.086502 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-77f353c1-60e1-4834-aa51-962661f8e836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:25.115727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f353c1-60e1-4834-aa51-962661f8e836 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:25.136350 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:25.207224 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428a4a4-9dd1-479a-8364-2382b29f4e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:25.207687 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428a4a4-9dd1-479a-8364-2382b29f4e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:25.208033 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428a4a4-9dd1-479a-8364-2382b29f4e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:25.208416 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428a4a4-9dd1-479a-8364-2382b29f4e35 admin admin] PATH_INFO: `/v3/users/0ce843db1cd14905936226a938039637` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:25.209740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428a4a4-9dd1-479a-8364-2382b29f4e35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ce843db1cd14905936226a938039637)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:25.211937 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428a4a4-9dd1-479a-8364-2382b29f4e35 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:25.282375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2428a4a4-9dd1-479a-8364-2382b29f4e35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ce843db1cd14905936226a938039637'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:25.283061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2428a4a4-9dd1-479a-8364-2382b29f4e35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ce843db1cd14905936226a938039637'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:25.292990 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2428a4a4-9dd1-479a-8364-2382b29f4e35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ce843db1cd14905936226a938039637'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:25.293644 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2428a4a4-9dd1-479a-8364-2382b29f4e35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ce843db1cd14905936226a938039637'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:25.303210 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2428a4a4-9dd1-479a-8364-2382b29f4e35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ce843db1cd14905936226a938039637'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:25.323638 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3877a-03f7-4739-9f9d-27b79693f0b6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:25.325034 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3bd3877a-03f7-4739-9f9d-27b79693f0b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:25.329119 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 966/1956] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:25 2022] DELETE /identity/v3/users/0ce843db1cd14905936226a938039637 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:25.334115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0435f9d-6eb8-476d-99ab-0076bd96b788 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:25.334730 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0435f9d-6eb8-476d-99ab-0076bd96b788 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:25.335183 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0435f9d-6eb8-476d-99ab-0076bd96b788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:25.346427 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3877a-03f7-4739-9f9d-27b79693f0b6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:25.366062 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a0435f9d-6eb8-476d-99ab-0076bd96b788 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:25.375776 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a0435f9d-6eb8-476d-99ab-0076bd96b788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:25.408667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:25.434044 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca471a1-f43f-4a4c-8af9-393c8efa8c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:25.434803 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca471a1-f43f-4a4c-8af9-393c8efa8c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:25.435183 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca471a1-f43f-4a4c-8af9-393c8efa8c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:25.435570 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca471a1-f43f-4a4c-8af9-393c8efa8c27 admin admin] PATH_INFO: `/v3/projects/e4537115b61d4810894bfde2f275d808` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:25.437055 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca471a1-f43f-4a4c-8af9-393c8efa8c27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4537115b61d4810894bfde2f275d808)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:25.439699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca471a1-f43f-4a4c-8af9-393c8efa8c27 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:25.499454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 967/1957] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:27:25.499454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0435f9d-6eb8-476d-99ab-0076bd96b788 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:25.499454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a0435f9d-6eb8-476d-99ab-0076bd96b788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:25.512368 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4ca471a1-f43f-4a4c-8af9-393c8efa8c27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4537115b61d4810894bfde2f275d808', 'request_id': 'req-4ca471a1-f43f-4a4c-8af9-393c8efa8c27'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:25.512554 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0435f9d-6eb8-476d-99ab-0076bd96b788 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:25.521548 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4ca471a1-f43f-4a4c-8af9-393c8efa8c27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4537115b61d4810894bfde2f275d808', 'request_id': 'req-4ca471a1-f43f-4a4c-8af9-393c8efa8c27'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:25.548160 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4ca471a1-f43f-4a4c-8af9-393c8efa8c27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4537115b61d4810894bfde2f275d808', 'request_id': 'req-4ca471a1-f43f-4a4c-8af9-393c8efa8c27'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:25.568783 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4ca471a1-f43f-4a4c-8af9-393c8efa8c27 admin admin] The token cache is being invalidate because project e4537115b61d4810894bfde2f275d808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:25.569094 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4ca471a1-f43f-4a4c-8af9-393c8efa8c27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:25.570416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4ca471a1-f43f-4a4c-8af9-393c8efa8c27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:25.571957 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 991/1958] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:25 2022] DELETE /identity/v3/projects/e4537115b61d4810894bfde2f275d808 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:27:25.572802 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca471a1-f43f-4a4c-8af9-393c8efa8c27 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:25.574140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4ca471a1-f43f-4a4c-8af9-393c8efa8c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:25.584434 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:25.604887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cc68d-2966-423b-b1cf-128501897abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:25.605690 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cc68d-2966-423b-b1cf-128501897abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:25.606060 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cc68d-2966-423b-b1cf-128501897abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:25.606329 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cc68d-2966-423b-b1cf-128501897abc admin admin] PATH_INFO: `/v3/users/a8b06554066e44d2bf03a7b22798e8ed` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:25.607454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cc68d-2966-423b-b1cf-128501897abc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8b06554066e44d2bf03a7b22798e8ed)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:25.609368 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cc68d-2966-423b-b1cf-128501897abc admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:25.645036 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca471a1-f43f-4a4c-8af9-393c8efa8c27 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:25.651349 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e1bf8-2453-4d86-9264-02608956de76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:25.652156 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e1bf8-2453-4d86-9264-02608956de76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:25.652420 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e1bf8-2453-4d86-9264-02608956de76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:25.652911 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e1bf8-2453-4d86-9264-02608956de76 admin admin] PATH_INFO: `/v3/projects/aafc7ecbe444417ba01d300e3b1a1e17` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:25.653925 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e1bf8-2453-4d86-9264-02608956de76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aafc7ecbe444417ba01d300e3b1a1e17)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:25.655847 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e1bf8-2453-4d86-9264-02608956de76 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:25.659421 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-371cc68d-2966-423b-b1cf-128501897abc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8b06554066e44d2bf03a7b22798e8ed'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:25.660218 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-371cc68d-2966-423b-b1cf-128501897abc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8b06554066e44d2bf03a7b22798e8ed'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:25.670579 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-371cc68d-2966-423b-b1cf-128501897abc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8b06554066e44d2bf03a7b22798e8ed'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:25.671381 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-371cc68d-2966-423b-b1cf-128501897abc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8b06554066e44d2bf03a7b22798e8ed'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:25.680452 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-371cc68d-2966-423b-b1cf-128501897abc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8b06554066e44d2bf03a7b22798e8ed'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:25.698300 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 968/1959] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:25 2022] DELETE /identity/v3/users/a8b06554066e44d2bf03a7b22798e8ed => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:25.701998 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cc68d-2966-423b-b1cf-128501897abc admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:25.703343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-371cc68d-2966-423b-b1cf-128501897abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:25.705775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d86e1bf8-2453-4d86-9264-02608956de76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aafc7ecbe444417ba01d300e3b1a1e17', 'request_id': 'req-d86e1bf8-2453-4d86-9264-02608956de76'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:25.712061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d86e1bf8-2453-4d86-9264-02608956de76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aafc7ecbe444417ba01d300e3b1a1e17', 'request_id': 'req-d86e1bf8-2453-4d86-9264-02608956de76'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:25.718316 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d86e1bf8-2453-4d86-9264-02608956de76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aafc7ecbe444417ba01d300e3b1a1e17', 'request_id': 'req-d86e1bf8-2453-4d86-9264-02608956de76'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:25.731820 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d86e1bf8-2453-4d86-9264-02608956de76 admin admin] The token cache is being invalidate because project aafc7ecbe444417ba01d300e3b1a1e17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:25.732110 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d86e1bf8-2453-4d86-9264-02608956de76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:25.732744 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d86e1bf8-2453-4d86-9264-02608956de76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:25.734279 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 992/1960] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:25 2022] DELETE /identity/v3/projects/aafc7ecbe444417ba01d300e3b1a1e17 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:25.735532 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d412d-cae4-4f69-b120-937517fd3ff0 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:25.735816 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d412d-cae4-4f69-b120-937517fd3ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:25.736088 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d412d-cae4-4f69-b120-937517fd3ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:25.751662 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:25.757522 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ca4d412d-cae4-4f69-b120-937517fd3ff0 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:25.759290 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ca4d412d-cae4-4f69-b120-937517fd3ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:25.764426 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cc68d-2966-423b-b1cf-128501897abc admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:25.770063 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57c272-4876-4dbd-8b4e-5eebfca93728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:25.770956 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57c272-4876-4dbd-8b4e-5eebfca93728 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:25.771770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57c272-4876-4dbd-8b4e-5eebfca93728 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:25.772091 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57c272-4876-4dbd-8b4e-5eebfca93728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:25.774558 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bd57c272-4876-4dbd-8b4e-5eebfca93728 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:25.827679 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 993/1961] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:25.835434 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01676e-e513-4c87-a795-98235acb0853 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:25.835723 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01676e-e513-4c87-a795-98235acb0853 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:25.835995 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01676e-e513-4c87-a795-98235acb0853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:25.854558 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57c272-4876-4dbd-8b4e-5eebfca93728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:25.857897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57c272-4876-4dbd-8b4e-5eebfca93728 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:25.858054 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-7d01676e-e513-4c87-a795-98235acb0853 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:25.858054 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7d01676e-e513-4c87-a795-98235acb0853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:25.868022 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 994/1962] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:25.868022 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcd1da-9e50-4496-903a-d3c7c2bdeaa9 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:25.868022 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcd1da-9e50-4496-903a-d3c7c2bdeaa9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:25.868022 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcd1da-9e50-4496-903a-d3c7c2bdeaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:25.873874 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 969/1963] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:25.875797 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b27b8-7a8d-4b60-bc33-f7fe34e47ab0 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:25.876088 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b27b8-7a8d-4b60-bc33-f7fe34e47ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:25.876367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b27b8-7a8d-4b60-bc33-f7fe34e47ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:25.888402 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c5dcd1da-9e50-4496-903a-d3c7c2bdeaa9 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:25.889868 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c5dcd1da-9e50-4496-903a-d3c7c2bdeaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:25.899798 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 995/1964] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:25.900879 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcd1da-9e50-4496-903a-d3c7c2bdeaa9 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:25.908653 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c5dcd1da-9e50-4496-903a-d3c7c2bdeaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:25.914471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5f3b27b8-7a8d-4b60-bc33-f7fe34e47ab0 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:25.915667 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5f3b27b8-7a8d-4b60-bc33-f7fe34e47ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:25.927720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 970/1965] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:25.927720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afdbce-aa8f-42f9-b184-a6e495de3a34 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:25.927720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afdbce-aa8f-42f9-b184-a6e495de3a34 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:25.927720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afdbce-aa8f-42f9-b184-a6e495de3a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:25.928198 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcd1da-9e50-4496-903a-d3c7c2bdeaa9 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:25.931992 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdcc75d-29f8-45ce-95bd-37dffbfa5ebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:25.932677 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcc75d-29f8-45ce-95bd-37dffbfa5ebc service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:25.933087 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcc75d-29f8-45ce-95bd-37dffbfa5ebc service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:25.933455 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcc75d-29f8-45ce-95bd-37dffbfa5ebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:25.935518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:25.951288 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdcc75d-29f8-45ce-95bd-37dffbfa5ebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:25.952183 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d2afdbce-aa8f-42f9-b184-a6e495de3a34 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:25.953634 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d2afdbce-aa8f-42f9-b184-a6e495de3a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:25.962011 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdcc75d-29f8-45ce-95bd-37dffbfa5ebc service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:25.964623 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 971/1966] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:25.965737 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afdbce-aa8f-42f9-b184-a6e495de3a34 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:25.986831 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 996/1967] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:25.987554 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdcc75d-29f8-45ce-95bd-37dffbfa5ebc service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:25.993204 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afdbce-aa8f-42f9-b184-a6e495de3a34 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:26.000095 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7704b93-665e-4bd3-9c7d-386b65b6eca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:26.001755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7704b93-665e-4bd3-9c7d-386b65b6eca4 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:26.002140 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7704b93-665e-4bd3-9c7d-386b65b6eca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:26.002296 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7704b93-665e-4bd3-9c7d-386b65b6eca4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:26.002945 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7704b93-665e-4bd3-9c7d-386b65b6eca4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:27:26.003248 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7704b93-665e-4bd3-9c7d-386b65b6eca4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:26.004867 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7704b93-665e-4bd3-9c7d-386b65b6eca4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:26.006417 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdcc75d-29f8-45ce-95bd-37dffbfa5ebc service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:26.017201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da5f74-60fe-44b7-8d63-4b82f88f7ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:26.018313 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da5f74-60fe-44b7-8d63-4b82f88f7ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:26.018734 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da5f74-60fe-44b7-8d63-4b82f88f7ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:26.019942 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da5f74-60fe-44b7-8d63-4b82f88f7ae2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:26.020061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 972/1968] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:27:26.025007 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7704b93-665e-4bd3-9c7d-386b65b6eca4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:26.026091 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da5f74-60fe-44b7-8d63-4b82f88f7ae2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:27:26.026413 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da5f74-60fe-44b7-8d63-4b82f88f7ae2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:26.030698 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da5f74-60fe-44b7-8d63-4b82f88f7ae2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:26.039219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7704b93-665e-4bd3-9c7d-386b65b6eca4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:26.047858 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85cec7-ede0-42f0-8f56-e602a1d50f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:26.049027 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85cec7-ede0-42f0-8f56-e602a1d50f31 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:26.050234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85cec7-ede0-42f0-8f56-e602a1d50f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:26.050852 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85cec7-ede0-42f0-8f56-e602a1d50f31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:26.052601 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85cec7-ede0-42f0-8f56-e602a1d50f31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:26.055575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85cec7-ede0-42f0-8f56-e602a1d50f31 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:26.097805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 997/1969] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:27:26.100061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da5f74-60fe-44b7-8d63-4b82f88f7ae2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:26.126450 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da5f74-60fe-44b7-8d63-4b82f88f7ae2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:26.132446 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 973/1970] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:26 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:27:26.137484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85cec7-ede0-42f0-8f56-e602a1d50f31 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:26.138754 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49ac61-7947-4210-a4e5-f63d54a9287a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:26.139393 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49ac61-7947-4210-a4e5-f63d54a9287a admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:26.139681 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49ac61-7947-4210-a4e5-f63d54a9287a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:26.139955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49ac61-7947-4210-a4e5-f63d54a9287a admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:26.140605 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49ac61-7947-4210-a4e5-f63d54a9287a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:26.152937 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49ac61-7947-4210-a4e5-f63d54a9287a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:26.236587 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 998/1971] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:26 2022] POST /identity/v3/projects => generated 389 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:26.244770 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49ac61-7947-4210-a4e5-f63d54a9287a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:26.328919 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85cec7-ede0-42f0-8f56-e602a1d50f31 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:26.439584 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49ac61-7947-4210-a4e5-f63d54a9287a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:26.448138 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f697f6a-a854-430c-b18f-6879082d6e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:26.449096 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f697f6a-a854-430c-b18f-6879082d6e60 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:26.449381 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f697f6a-a854-430c-b18f-6879082d6e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:26.449708 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f697f6a-a854-430c-b18f-6879082d6e60 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:26.450612 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f697f6a-a854-430c-b18f-6879082d6e60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:26.454468 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f697f6a-a854-430c-b18f-6879082d6e60 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:26.490291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 999/1972] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:26 2022] POST /identity/v3/users => generated 295 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:26.491749 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f697f6a-a854-430c-b18f-6879082d6e60 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:26.499089 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d908f-d42f-464d-befc-546a777bf707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:26.499890 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d908f-d42f-464d-befc-546a777bf707 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:26.500171 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d908f-d42f-464d-befc-546a777bf707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:26.501481 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d908f-d42f-464d-befc-546a777bf707 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:26.502149 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d908f-d42f-464d-befc-546a777bf707 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:26.503945 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f697f6a-a854-430c-b18f-6879082d6e60 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:26.504581 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d908f-d42f-464d-befc-546a777bf707 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:26.510687 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfa2e5-df67-4f00-8dd8-a27f1804cfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:26.511719 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfa2e5-df67-4f00-8dd8-a27f1804cfef admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:26.512148 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfa2e5-df67-4f00-8dd8-a27f1804cfef admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:26.512569 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfa2e5-df67-4f00-8dd8-a27f1804cfef admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:26.514152 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcfa2e5-df67-4f00-8dd8-a27f1804cfef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:26.516495 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcfa2e5-df67-4f00-8dd8-a27f1804cfef admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:26.541108 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1000/1973] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:26.542959 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfa2e5-df67-4f00-8dd8-a27f1804cfef admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:26.546772 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 974/1974] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:26 2022] POST /identity/v3/users => generated 292 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:26.553333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d908f-d42f-464d-befc-546a777bf707 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:26.556737 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfa2e5-df67-4f00-8dd8-a27f1804cfef admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:26.564849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29456c72-8c55-47dc-b457-0cc56f57770f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:26.565647 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29456c72-8c55-47dc-b457-0cc56f57770f admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:26.566513 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29456c72-8c55-47dc-b457-0cc56f57770f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:26.566812 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29456c72-8c55-47dc-b457-0cc56f57770f admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:26.567657 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29456c72-8c55-47dc-b457-0cc56f57770f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:26.570005 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29456c72-8c55-47dc-b457-0cc56f57770f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:26.570759 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d908f-d42f-464d-befc-546a777bf707 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:26.582079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4dba5-a00a-4394-ac42-617c9689cafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:26.582703 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4dba5-a00a-4394-ac42-617c9689cafa admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:26.585873 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1001/1975] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:26.589322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4dba5-a00a-4394-ac42-617c9689cafa admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:26.589636 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4dba5-a00a-4394-ac42-617c9689cafa admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:26.590328 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4dba5-a00a-4394-ac42-617c9689cafa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:26.592096 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4dba5-a00a-4394-ac42-617c9689cafa admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:26.594180 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29456c72-8c55-47dc-b457-0cc56f57770f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:26.606019 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29456c72-8c55-47dc-b457-0cc56f57770f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:26.612116 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee78902-c1cc-4bfb-9ffd-1c6987e54078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:26.612688 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee78902-c1cc-4bfb-9ffd-1c6987e54078 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:26.612973 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee78902-c1cc-4bfb-9ffd-1c6987e54078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:26.613253 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee78902-c1cc-4bfb-9ffd-1c6987e54078 admin admin] PATH_INFO: `/v3/projects/5ac9bd2e837145aaa8ba36a1d48ebbd4/users/cd2de64c0d7a4337bc9a98a275426f89/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:26.617945 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 975/1976] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:26.620381 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4dba5-a00a-4394-ac42-617c9689cafa admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:26.635862 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4dba5-a00a-4394-ac42-617c9689cafa admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:26.638324 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:26.644209 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee78902-c1cc-4bfb-9ffd-1c6987e54078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ac9bd2e837145aaa8ba36a1d48ebbd4, user_id=cd2de64c0d7a4337bc9a98a275426f89, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:26.647870 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee78902-c1cc-4bfb-9ffd-1c6987e54078 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:26.649971 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfcf11-b0b8-4a6a-acc8-21ba43ea3f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:26.650611 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfcf11-b0b8-4a6a-acc8-21ba43ea3f92 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:26.650891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfcf11-b0b8-4a6a-acc8-21ba43ea3f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:26.651158 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfcf11-b0b8-4a6a-acc8-21ba43ea3f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:26.651812 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cfcf11-b0b8-4a6a-acc8-21ba43ea3f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:26.653428 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cfcf11-b0b8-4a6a-acc8-21ba43ea3f92 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:26.683680 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 976/1978] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:26.685956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1002/1978] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:26 2022] PUT /identity/v3/projects/5ac9bd2e837145aaa8ba36a1d48ebbd4/users/cd2de64c0d7a4337bc9a98a275426f89/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:26.687279 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfcf11-b0b8-4a6a-acc8-21ba43ea3f92 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:26.692280 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a813b1-99ec-4d9c-97e6-6d2de4f76ca5 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:26.692594 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a813b1-99ec-4d9c-97e6-6d2de4f76ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:26.692908 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a813b1-99ec-4d9c-97e6-6d2de4f76ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:26.703685 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfcf11-b0b8-4a6a-acc8-21ba43ea3f92 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:26.732157 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f4a813b1-99ec-4d9c-97e6-6d2de4f76ca5 None None] MFA Rules not processed for user `cd2de64c0d7a4337bc9a98a275426f89`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:26.733653 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f4a813b1-99ec-4d9c-97e6-6d2de4f76ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:26.770181 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:26.805314 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c664a-9a91-47f3-92bd-159c1754b490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:26.806144 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c664a-9a91-47f3-92bd-159c1754b490 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:26.806487 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c664a-9a91-47f3-92bd-159c1754b490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:26.806825 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c664a-9a91-47f3-92bd-159c1754b490 admin admin] PATH_INFO: `/v3/projects/54d944da893449bc9b2cb61dd32a3eda/users/b871b52848ed4c7e8f16a9da13996b2f/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:26.812939 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1003/1979] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:27:26.814280 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a813b1-99ec-4d9c-97e6-6d2de4f76ca5 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:26.817838 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f4a813b1-99ec-4d9c-97e6-6d2de4f76ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:26.824681 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c664a-9a91-47f3-92bd-159c1754b490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d944da893449bc9b2cb61dd32a3eda, user_id=b871b52848ed4c7e8f16a9da13996b2f, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:26.827475 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c664a-9a91-47f3-92bd-159c1754b490 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:26.831132 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a813b1-99ec-4d9c-97e6-6d2de4f76ca5 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:26.836593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3239713-443f-4dae-be6b-104f10716a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:26.837223 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3239713-443f-4dae-be6b-104f10716a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:26.837532 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3239713-443f-4dae-be6b-104f10716a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:26.837806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3239713-443f-4dae-be6b-104f10716a6e admin admin] PATH_INFO: `/v3/projects/8dee3035918a44fda3dbbaf5f5bce662` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:26.838927 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3239713-443f-4dae-be6b-104f10716a6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dee3035918a44fda3dbbaf5f5bce662)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:26.840651 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 977/1980] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:26 2022] PUT /identity/v3/projects/54d944da893449bc9b2cb61dd32a3eda/users/b871b52848ed4c7e8f16a9da13996b2f/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:26.841470 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c664a-9a91-47f3-92bd-159c1754b490 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:26.842993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-470c664a-9a91-47f3-92bd-159c1754b490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:26.845549 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3239713-443f-4dae-be6b-104f10716a6e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:26.893882 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e3239713-443f-4dae-be6b-104f10716a6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dee3035918a44fda3dbbaf5f5bce662', 'request_id': 'req-e3239713-443f-4dae-be6b-104f10716a6e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:26.899691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e3239713-443f-4dae-be6b-104f10716a6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dee3035918a44fda3dbbaf5f5bce662', 'request_id': 'req-e3239713-443f-4dae-be6b-104f10716a6e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:26.905759 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e3239713-443f-4dae-be6b-104f10716a6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dee3035918a44fda3dbbaf5f5bce662', 'request_id': 'req-e3239713-443f-4dae-be6b-104f10716a6e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:26.908629 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c664a-9a91-47f3-92bd-159c1754b490 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:26.919081 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e3239713-443f-4dae-be6b-104f10716a6e admin admin] The token cache is being invalidate because project 8dee3035918a44fda3dbbaf5f5bce662 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:26.919298 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e3239713-443f-4dae-be6b-104f10716a6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:26.919926 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e3239713-443f-4dae-be6b-104f10716a6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:26.921497 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1004/1981] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:26 2022] DELETE /identity/v3/projects/8dee3035918a44fda3dbbaf5f5bce662 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:26.922231 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3239713-443f-4dae-be6b-104f10716a6e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:26.923498 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e3239713-443f-4dae-be6b-104f10716a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:26.967007 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963ca11-2e59-465a-a7a6-971f4b8ab3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:26.967627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963ca11-2e59-465a-a7a6-971f4b8ab3bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:26.967876 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963ca11-2e59-465a-a7a6-971f4b8ab3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:26.968150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963ca11-2e59-465a-a7a6-971f4b8ab3bd admin admin] PATH_INFO: `/v3/projects/e55557b7faa74fbdb5a5a239db6d9c86` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:26.969444 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963ca11-2e59-465a-a7a6-971f4b8ab3bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e55557b7faa74fbdb5a5a239db6d9c86)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:26.971362 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963ca11-2e59-465a-a7a6-971f4b8ab3bd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:26.991544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3239713-443f-4dae-be6b-104f10716a6e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:26.996451 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62123daa-d9eb-4cac-a3b5-f34d7b532c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:26.997090 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62123daa-d9eb-4cac-a3b5-f34d7b532c53 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:26.997856 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62123daa-d9eb-4cac-a3b5-f34d7b532c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:26.997856 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62123daa-d9eb-4cac-a3b5-f34d7b532c53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:26.998541 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62123daa-d9eb-4cac-a3b5-f34d7b532c53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:27.000515 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62123daa-d9eb-4cac-a3b5-f34d7b532c53 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:27.007293 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:27.024497 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c963ca11-2e59-465a-a7a6-971f4b8ab3bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e55557b7faa74fbdb5a5a239db6d9c86', 'request_id': 'req-c963ca11-2e59-465a-a7a6-971f4b8ab3bd'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:27.030817 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c963ca11-2e59-465a-a7a6-971f4b8ab3bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e55557b7faa74fbdb5a5a239db6d9c86', 'request_id': 'req-c963ca11-2e59-465a-a7a6-971f4b8ab3bd'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:27.033568 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1005/1982] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:26 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:27.034904 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1bc5ae-cfa1-41e0-a3bf-e1f01bd57a3f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:27.035210 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1bc5ae-cfa1-41e0-a3bf-e1f01bd57a3f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:27.035467 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1bc5ae-cfa1-41e0-a3bf-e1f01bd57a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:27.038911 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c963ca11-2e59-465a-a7a6-971f4b8ab3bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e55557b7faa74fbdb5a5a239db6d9c86', 'request_id': 'req-c963ca11-2e59-465a-a7a6-971f4b8ab3bd'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:27.043174 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:27.056175 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c963ca11-2e59-465a-a7a6-971f4b8ab3bd admin admin] The token cache is being invalidate because project e55557b7faa74fbdb5a5a239db6d9c86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:27.056725 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c963ca11-2e59-465a-a7a6-971f4b8ab3bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:27.057536 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c963ca11-2e59-465a-a7a6-971f4b8ab3bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:27.059370 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 978/1983] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:26 2022] DELETE /identity/v3/projects/e55557b7faa74fbdb5a5a239db6d9c86 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:27.060318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963ca11-2e59-465a-a7a6-971f4b8ab3bd admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:27.061647 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c963ca11-2e59-465a-a7a6-971f4b8ab3bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:27.072962 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-cc1bc5ae-cfa1-41e0-a3bf-e1f01bd57a3f None None] MFA Rules not processed for user `b871b52848ed4c7e8f16a9da13996b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:27.074352 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cc1bc5ae-cfa1-41e0-a3bf-e1f01bd57a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:27.137286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963ca11-2e59-465a-a7a6-971f4b8ab3bd admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:27.146045 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1006/1984] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:27.147039 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1bc5ae-cfa1-41e0-a3bf-e1f01bd57a3f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:27.148342 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cc1bc5ae-cfa1-41e0-a3bf-e1f01bd57a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:27.203735 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11486358-2931-425e-a7a3-721bd183d91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:27.204370 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11486358-2931-425e-a7a3-721bd183d91b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:27.204644 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11486358-2931-425e-a7a3-721bd183d91b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:27.204914 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11486358-2931-425e-a7a3-721bd183d91b admin admin] PATH_INFO: `/v3/users/e66221f6a4c740b29744ae7b1256f4d4` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:27.206082 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11486358-2931-425e-a7a3-721bd183d91b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e66221f6a4c740b29744ae7b1256f4d4)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:27.207995 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11486358-2931-425e-a7a3-721bd183d91b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:27.218633 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1bc5ae-cfa1-41e0-a3bf-e1f01bd57a3f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:27.223306 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a997b05-3c5c-4029-9551-183c06176e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:27.223920 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a997b05-3c5c-4029-9551-183c06176e1e admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:27.224224 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a997b05-3c5c-4029-9551-183c06176e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:27.224498 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a997b05-3c5c-4029-9551-183c06176e1e admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:27.225123 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a997b05-3c5c-4029-9551-183c06176e1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:27.227102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a997b05-3c5c-4029-9551-183c06176e1e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:27.248011 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1007/1985] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:27 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:27.248970 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a997b05-3c5c-4029-9551-183c06176e1e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:27.250579 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7a997b05-3c5c-4029-9551-183c06176e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:27.256331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-11486358-2931-425e-a7a3-721bd183d91b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e66221f6a4c740b29744ae7b1256f4d4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:27.256990 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-11486358-2931-425e-a7a3-721bd183d91b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e66221f6a4c740b29744ae7b1256f4d4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:27.263205 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a997b05-3c5c-4029-9551-183c06176e1e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:27.265584 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-11486358-2931-425e-a7a3-721bd183d91b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e66221f6a4c740b29744ae7b1256f4d4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:27.266207 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-11486358-2931-425e-a7a3-721bd183d91b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e66221f6a4c740b29744ae7b1256f4d4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:27.268041 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd21265-4708-4634-bfcd-e45e378890a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:27.268655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd21265-4708-4634-bfcd-e45e378890a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:27.268938 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd21265-4708-4634-bfcd-e45e378890a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:27.269211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd21265-4708-4634-bfcd-e45e378890a9 admin admin] PATH_INFO: `/v3/users/dd6e1ab1740f459ba9ffef0f0e906dbd` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:27.270394 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd21265-4708-4634-bfcd-e45e378890a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd6e1ab1740f459ba9ffef0f0e906dbd)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:27.272413 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd21265-4708-4634-bfcd-e45e378890a9 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:27.273635 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-11486358-2931-425e-a7a3-721bd183d91b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e66221f6a4c740b29744ae7b1256f4d4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:27.291389 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 979/1986] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:27 2022] DELETE /identity/v3/users/e66221f6a4c740b29744ae7b1256f4d4 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:27.294591 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11486358-2931-425e-a7a3-721bd183d91b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:27.294591 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-11486358-2931-425e-a7a3-721bd183d91b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:27.323508 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:27.333692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8fd21265-4708-4634-bfcd-e45e378890a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd6e1ab1740f459ba9ffef0f0e906dbd'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:27.334476 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8fd21265-4708-4634-bfcd-e45e378890a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd6e1ab1740f459ba9ffef0f0e906dbd'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:27.348674 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:27.354014 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8fd21265-4708-4634-bfcd-e45e378890a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd6e1ab1740f459ba9ffef0f0e906dbd'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:27.369342 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11486358-2931-425e-a7a3-721bd183d91b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:27.369757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8fd21265-4708-4634-bfcd-e45e378890a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd6e1ab1740f459ba9ffef0f0e906dbd'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:27.374405 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9059fdb-c3dc-4d93-affd-59076f9468e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:27.375593 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9059fdb-c3dc-4d93-affd-59076f9468e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:27.375953 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9059fdb-c3dc-4d93-affd-59076f9468e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:27.376826 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9059fdb-c3dc-4d93-affd-59076f9468e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:27.379453 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8fd21265-4708-4634-bfcd-e45e378890a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd6e1ab1740f459ba9ffef0f0e906dbd'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:27.379757 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f9059fdb-c3dc-4d93-affd-59076f9468e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:27.390303 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1008/1987] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:27 2022] DELETE /identity/v3/users/dd6e1ab1740f459ba9ffef0f0e906dbd => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:27.391921 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd21265-4708-4634-bfcd-e45e378890a9 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:27.398257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8fd21265-4708-4634-bfcd-e45e378890a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:27.457389 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9059fdb-c3dc-4d93-affd-59076f9468e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:27.459017 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9059fdb-c3dc-4d93-affd-59076f9468e5 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:27.473724 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 980/1988] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:27.521821 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd21265-4708-4634-bfcd-e45e378890a9 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:27.533637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48307e90-1af0-4b1f-8154-555cf977984c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:27.534282 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48307e90-1af0-4b1f-8154-555cf977984c admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:27.534563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48307e90-1af0-4b1f-8154-555cf977984c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:27.534838 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48307e90-1af0-4b1f-8154-555cf977984c admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:27.535495 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48307e90-1af0-4b1f-8154-555cf977984c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:27.537671 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48307e90-1af0-4b1f-8154-555cf977984c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:27.556145 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1009/1989] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:27.559315 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9059fdb-c3dc-4d93-affd-59076f9468e5 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:27.561005 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f9059fdb-c3dc-4d93-affd-59076f9468e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:27.659209 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9059fdb-c3dc-4d93-affd-59076f9468e5 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:27.671654 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa31b2-8dbe-4992-8248-0430069f2ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:27.673529 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa31b2-8dbe-4992-8248-0430069f2ab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:27.673812 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa31b2-8dbe-4992-8248-0430069f2ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:27.674151 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa31b2-8dbe-4992-8248-0430069f2ab4 admin admin] PATH_INFO: `/v3/projects/3fae1a25305f435c8bf94097e11d503f/users/ac3e1fd100614bd299d1bd033a2a6621/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:27.694836 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa31b2-8dbe-4992-8248-0430069f2ab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fae1a25305f435c8bf94097e11d503f, user_id=ac3e1fd100614bd299d1bd033a2a6621, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:27.699529 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa31b2-8dbe-4992-8248-0430069f2ab4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:27.729371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 981/1990] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:27 2022] PUT /identity/v3/projects/3fae1a25305f435c8bf94097e11d503f/users/ac3e1fd100614bd299d1bd033a2a6621/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:27:27.731351 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48307e90-1af0-4b1f-8154-555cf977984c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:27.755346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48307e90-1af0-4b1f-8154-555cf977984c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:27.775965 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa31b2-8dbe-4992-8248-0430069f2ab4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:27.778864 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ecfa31b2-8dbe-4992-8248-0430069f2ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:27.881828 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c334fdc-4a32-482d-992f-e4b4dd8aefb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:27.882447 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c334fdc-4a32-482d-992f-e4b4dd8aefb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:27.882736 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c334fdc-4a32-482d-992f-e4b4dd8aefb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:27.883000 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c334fdc-4a32-482d-992f-e4b4dd8aefb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:27.883802 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c334fdc-4a32-482d-992f-e4b4dd8aefb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:27.885683 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c334fdc-4a32-482d-992f-e4b4dd8aefb9 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:27.895523 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa31b2-8dbe-4992-8248-0430069f2ab4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:27.900114 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1010/1991] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:27.904169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c334fdc-4a32-482d-992f-e4b4dd8aefb9 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:27.917617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388f7a9-6fa9-478b-b379-2ce682448fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:27.917617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388f7a9-6fa9-478b-b379-2ce682448fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:27.917617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388f7a9-6fa9-478b-b379-2ce682448fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:27.917617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388f7a9-6fa9-478b-b379-2ce682448fb0 admin admin] PATH_INFO: `/v3/projects/76695f55d27849dc8b92944bef5fbf5d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:27.917960 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388f7a9-6fa9-478b-b379-2ce682448fb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76695f55d27849dc8b92944bef5fbf5d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:27.917960 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388f7a9-6fa9-478b-b379-2ce682448fb0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:27.917960 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:27.930051 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c334fdc-4a32-482d-992f-e4b4dd8aefb9 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:27.935450 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a2480-2a92-4167-a260-a7c62a47076b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:27.936266 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a2480-2a92-4167-a260-a7c62a47076b admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:27.937441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a2480-2a92-4167-a260-a7c62a47076b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:27.937789 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a2480-2a92-4167-a260-a7c62a47076b admin admin] PATH_INFO: `/v3/projects/3fae1a25305f435c8bf94097e11d503f/users/ac3e1fd100614bd299d1bd033a2a6621/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:27.941131 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a2480-2a92-4167-a260-a7c62a47076b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fae1a25305f435c8bf94097e11d503f, user_id=ac3e1fd100614bd299d1bd033a2a6621, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:27.944277 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a2480-2a92-4167-a260-a7c62a47076b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:27.981467 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1011/1992] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:27 2022] PUT /identity/v3/projects/3fae1a25305f435c8bf94097e11d503f/users/ac3e1fd100614bd299d1bd033a2a6621/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:27.989125 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a1684-ee9a-497f-a57a-005031cc7360 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:27.989576 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a1684-ee9a-497f-a57a-005031cc7360 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:27.989822 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a1684-ee9a-497f-a57a-005031cc7360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:28.020565 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f388f7a9-6fa9-478b-b379-2ce682448fb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76695f55d27849dc8b92944bef5fbf5d', 'request_id': 'req-f388f7a9-6fa9-478b-b379-2ce682448fb0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:28.029381 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-808a1684-ee9a-497f-a57a-005031cc7360 None None] MFA Rules not processed for user `ac3e1fd100614bd299d1bd033a2a6621`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:28.030501 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f388f7a9-6fa9-478b-b379-2ce682448fb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76695f55d27849dc8b92944bef5fbf5d', 'request_id': 'req-f388f7a9-6fa9-478b-b379-2ce682448fb0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:28.031798 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-808a1684-ee9a-497f-a57a-005031cc7360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:28.039272 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f388f7a9-6fa9-478b-b379-2ce682448fb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76695f55d27849dc8b92944bef5fbf5d', 'request_id': 'req-f388f7a9-6fa9-478b-b379-2ce682448fb0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:28.059569 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f388f7a9-6fa9-478b-b379-2ce682448fb0 admin admin] The token cache is being invalidate because project 76695f55d27849dc8b92944bef5fbf5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:28.059865 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f388f7a9-6fa9-478b-b379-2ce682448fb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:28.061031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f388f7a9-6fa9-478b-b379-2ce682448fb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:28.063087 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 982/1993] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:27 2022] DELETE /identity/v3/projects/76695f55d27849dc8b92944bef5fbf5d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:28.069864 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984ea31-f7ff-4b29-9cc7-5bd8961ab10d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:28.070636 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984ea31-f7ff-4b29-9cc7-5bd8961ab10d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:28.071060 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984ea31-f7ff-4b29-9cc7-5bd8961ab10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:28.091650 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:28.100968 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7984ea31-f7ff-4b29-9cc7-5bd8961ab10d None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:28.102599 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7984ea31-f7ff-4b29-9cc7-5bd8961ab10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:28.121124 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1012/1994] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:27:28.142764 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a1684-ee9a-497f-a57a-005031cc7360 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:28.144715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-808a1684-ee9a-497f-a57a-005031cc7360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:28.198906 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 983/1995] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:27:28.207514 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde3a66-1b86-4b29-8fc4-8e73bd8f5a12 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:28.207809 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde3a66-1b86-4b29-8fc4-8e73bd8f5a12 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:28.208092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde3a66-1b86-4b29-8fc4-8e73bd8f5a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:28.225712 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a1684-ee9a-497f-a57a-005031cc7360 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:28.230802 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4052cf-ab99-47bf-8c23-94a62761d206 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:28.231909 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4052cf-ab99-47bf-8c23-94a62761d206 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:28.232338 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4052cf-ab99-47bf-8c23-94a62761d206 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:28.232756 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4052cf-ab99-47bf-8c23-94a62761d206 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:28.234064 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-bdde3a66-1b86-4b29-8fc4-8e73bd8f5a12 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:28.235370 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bdde3a66-1b86-4b29-8fc4-8e73bd8f5a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:28.249806 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 984/1996] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:27:28.258555 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde3a66-1b86-4b29-8fc4-8e73bd8f5a12 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:28.259097 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4052cf-ab99-47bf-8c23-94a62761d206 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:28.260788 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4052cf-ab99-47bf-8c23-94a62761d206 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:28.269594 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde3a66-1b86-4b29-8fc4-8e73bd8f5a12 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:28.275565 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1013/1997] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:28 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:27:28.277751 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b2370-cc16-48df-ac31-30403d263cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:28.278608 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b2370-cc16-48df-ac31-30403d263cdf admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:28.279414 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b2370-cc16-48df-ac31-30403d263cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:28.279789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b2370-cc16-48df-ac31-30403d263cdf admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:28.280460 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b2370-cc16-48df-ac31-30403d263cdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:27:28.280838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b2370-cc16-48df-ac31-30403d263cdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:28.283277 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b2370-cc16-48df-ac31-30403d263cdf admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:28.303331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 985/1998] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:27:28.307261 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4052cf-ab99-47bf-8c23-94a62761d206 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:28.319592 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4052cf-ab99-47bf-8c23-94a62761d206 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:28.329473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc722c-8fc1-43fd-908f-54302721d266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:28.330424 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc722c-8fc1-43fd-908f-54302721d266 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:28.330850 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc722c-8fc1-43fd-908f-54302721d266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:28.331305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc722c-8fc1-43fd-908f-54302721d266 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:28.332221 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc722c-8fc1-43fd-908f-54302721d266 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:28.335515 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc722c-8fc1-43fd-908f-54302721d266 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:28.385730 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1014/1999] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:28 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:28.389794 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b2370-cc16-48df-ac31-30403d263cdf admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:28.395970 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc722c-8fc1-43fd-908f-54302721d266 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:28.399048 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f4dc722c-8fc1-43fd-908f-54302721d266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:28.401003 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b2370-cc16-48df-ac31-30403d263cdf admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:28.471759 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787d574-ea90-47e0-9801-795bb2b18cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:28.472526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787d574-ea90-47e0-9801-795bb2b18cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:28.472870 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787d574-ea90-47e0-9801-795bb2b18cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:28.473257 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787d574-ea90-47e0-9801-795bb2b18cc9 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:28.474557 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787d574-ea90-47e0-9801-795bb2b18cc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:28.476583 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787d574-ea90-47e0-9801-795bb2b18cc9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:28.498730 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:28.510395 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 986/2000] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:28 2022] POST /identity/v3/users => generated 286 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:28.511416 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787d574-ea90-47e0-9801-795bb2b18cc9 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:28.513797 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b787d574-ea90-47e0-9801-795bb2b18cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:28.526561 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787d574-ea90-47e0-9801-795bb2b18cc9 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:28.533514 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc33ad-2f30-48fe-a573-945f521f1309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:28.534906 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc33ad-2f30-48fe-a573-945f521f1309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:28.535264 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc33ad-2f30-48fe-a573-945f521f1309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:28.535733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc33ad-2f30-48fe-a573-945f521f1309 admin admin] PATH_INFO: `/v3/users/cd2de64c0d7a4337bc9a98a275426f89` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:28.537149 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc33ad-2f30-48fe-a573-945f521f1309 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd2de64c0d7a4337bc9a98a275426f89)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:28.539971 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc33ad-2f30-48fe-a573-945f521f1309 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:28.557016 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc722c-8fc1-43fd-908f-54302721d266 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:28.562582 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb65a8-5f42-4077-9e5c-bf0c4486f454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:28.563327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb65a8-5f42-4077-9e5c-bf0c4486f454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:28.563777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb65a8-5f42-4077-9e5c-bf0c4486f454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:28.564310 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb65a8-5f42-4077-9e5c-bf0c4486f454 admin admin] PATH_INFO: `/v3/projects/44c29fc47ec54d88b64fc7fe6d827af3` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:28.565642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb65a8-5f42-4077-9e5c-bf0c4486f454 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44c29fc47ec54d88b64fc7fe6d827af3)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:28.567763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb65a8-5f42-4077-9e5c-bf0c4486f454 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:28.617557 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e8fc33ad-2f30-48fe-a573-945f521f1309 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd2de64c0d7a4337bc9a98a275426f89'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:28.618448 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e8fc33ad-2f30-48fe-a573-945f521f1309 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd2de64c0d7a4337bc9a98a275426f89'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:28.629088 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-00fb65a8-5f42-4077-9e5c-bf0c4486f454 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44c29fc47ec54d88b64fc7fe6d827af3', 'request_id': 'req-00fb65a8-5f42-4077-9e5c-bf0c4486f454'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:28.634893 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e8fc33ad-2f30-48fe-a573-945f521f1309 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd2de64c0d7a4337bc9a98a275426f89'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:28.635995 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e8fc33ad-2f30-48fe-a573-945f521f1309 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd2de64c0d7a4337bc9a98a275426f89'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:28.637537 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-00fb65a8-5f42-4077-9e5c-bf0c4486f454 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44c29fc47ec54d88b64fc7fe6d827af3', 'request_id': 'req-00fb65a8-5f42-4077-9e5c-bf0c4486f454'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:28.650142 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e8fc33ad-2f30-48fe-a573-945f521f1309 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd2de64c0d7a4337bc9a98a275426f89'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:28.657976 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-00fb65a8-5f42-4077-9e5c-bf0c4486f454 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44c29fc47ec54d88b64fc7fe6d827af3', 'request_id': 'req-00fb65a8-5f42-4077-9e5c-bf0c4486f454'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:28.662767 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:28.676604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 987/2001] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:28 2022] DELETE /identity/v3/users/cd2de64c0d7a4337bc9a98a275426f89 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:28.678566 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc33ad-2f30-48fe-a573-945f521f1309 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:28.680368 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e8fc33ad-2f30-48fe-a573-945f521f1309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:28.680493 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-00fb65a8-5f42-4077-9e5c-bf0c4486f454 admin admin] The token cache is being invalidate because project 44c29fc47ec54d88b64fc7fe6d827af3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:28.680859 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-00fb65a8-5f42-4077-9e5c-bf0c4486f454 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:28.682331 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-00fb65a8-5f42-4077-9e5c-bf0c4486f454 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:28.687897 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1015/2002] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:28 2022] DELETE /identity/v3/projects/44c29fc47ec54d88b64fc7fe6d827af3 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:27:28.687897 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c20a1-366a-42f3-9da7-ec9da7c25736 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:28.687897 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c20a1-366a-42f3-9da7-ec9da7c25736 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:28.687897 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c20a1-366a-42f3-9da7-ec9da7c25736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:28.708171 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6f0c20a1-366a-42f3-9da7-ec9da7c25736 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:28.709339 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6f0c20a1-366a-42f3-9da7-ec9da7c25736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:28.762907 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc33ad-2f30-48fe-a573-945f521f1309 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:28.768026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacd599-207d-485e-8a22-a5fbc6d75988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:28.768656 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacd599-207d-485e-8a22-a5fbc6d75988 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:28.768914 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacd599-207d-485e-8a22-a5fbc6d75988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:28.769214 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacd599-207d-485e-8a22-a5fbc6d75988 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:28.769856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aacd599-207d-485e-8a22-a5fbc6d75988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:28.771706 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aacd599-207d-485e-8a22-a5fbc6d75988 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:28.778605 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1016/2003] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:28.781140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06c615-53d5-4e9f-9d4b-2737af3e8f47 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:28.781613 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06c615-53d5-4e9f-9d4b-2737af3e8f47 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:28.782073 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06c615-53d5-4e9f-9d4b-2737af3e8f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:28.782259 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 988/2004] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:28.786061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacd599-207d-485e-8a22-a5fbc6d75988 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:28.788041 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6aacd599-207d-485e-8a22-a5fbc6d75988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:28.802820 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacd599-207d-485e-8a22-a5fbc6d75988 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:28.805962 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-7d06c615-53d5-4e9f-9d4b-2737af3e8f47 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:28.807170 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7d06c615-53d5-4e9f-9d4b-2737af3e8f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:28.809255 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5e297-db50-450a-a417-cc75256b002b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:28.810734 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5e297-db50-450a-a417-cc75256b002b admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:28.811142 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5e297-db50-450a-a417-cc75256b002b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:28.811498 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5e297-db50-450a-a417-cc75256b002b admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:28.812229 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5e297-db50-450a-a417-cc75256b002b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:28.814214 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5e297-db50-450a-a417-cc75256b002b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:28.823872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1017/2005] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:28.823872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06c615-53d5-4e9f-9d4b-2737af3e8f47 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:28.825697 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7d06c615-53d5-4e9f-9d4b-2737af3e8f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:28.830190 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 989/2006] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:28.834882 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384c6b4-b624-4a79-9ee8-6e0df7ba19d2 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:28.835556 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384c6b4-b624-4a79-9ee8-6e0df7ba19d2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:28.835962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384c6b4-b624-4a79-9ee8-6e0df7ba19d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:28.866432 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5384c6b4-b624-4a79-9ee8-6e0df7ba19d2 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:28.867985 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5384c6b4-b624-4a79-9ee8-6e0df7ba19d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:28.883143 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 990/2007] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:28.885822 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384c6b4-b624-4a79-9ee8-6e0df7ba19d2 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:28.899349 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06c615-53d5-4e9f-9d4b-2737af3e8f47 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:28.903258 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384c6b4-b624-4a79-9ee8-6e0df7ba19d2 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:28.904260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a202aaf-daf8-4b1a-8217-766b22149bb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:28.904260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a202aaf-daf8-4b1a-8217-766b22149bb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:28.904514 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a202aaf-daf8-4b1a-8217-766b22149bb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:28.904606 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a202aaf-daf8-4b1a-8217-766b22149bb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:28.912265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a94cc-0358-422b-95d2-b4ff2f88eb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:28.913450 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a94cc-0358-422b-95d2-b4ff2f88eb2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:28.913997 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a94cc-0358-422b-95d2-b4ff2f88eb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:28.914486 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a94cc-0358-422b-95d2-b4ff2f88eb2e admin admin] PATH_INFO: `/v3/projects/4cc43fae88cc4e27b2f620ab62e1c757/users/87fdd1ba67a94aa8960bed49de3b38eb/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:28.916976 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a202aaf-daf8-4b1a-8217-766b22149bb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:28.919139 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a202aaf-daf8-4b1a-8217-766b22149bb0 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:28.930827 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1018/2008] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:28.931691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a202aaf-daf8-4b1a-8217-766b22149bb0 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:28.934929 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a94cc-0358-422b-95d2-b4ff2f88eb2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cc43fae88cc4e27b2f620ab62e1c757, user_id=87fdd1ba67a94aa8960bed49de3b38eb, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:28.939395 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a94cc-0358-422b-95d2-b4ff2f88eb2e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:28.942072 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a202aaf-daf8-4b1a-8217-766b22149bb0 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:28.947517 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4be6e2-1e7a-475d-90d9-22fd6a8783dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:28.948132 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4be6e2-1e7a-475d-90d9-22fd6a8783dd admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:28.948530 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4be6e2-1e7a-475d-90d9-22fd6a8783dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:28.948834 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4be6e2-1e7a-475d-90d9-22fd6a8783dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:28.949428 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4be6e2-1e7a-475d-90d9-22fd6a8783dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:27:28.949762 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4be6e2-1e7a-475d-90d9-22fd6a8783dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:28.951609 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4be6e2-1e7a-475d-90d9-22fd6a8783dd admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:28.959403 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 991/2009] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:28 2022] PUT /identity/v3/projects/4cc43fae88cc4e27b2f620ab62e1c757/users/87fdd1ba67a94aa8960bed49de3b38eb/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:28.970801 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22d18d-e859-493b-9981-12c6b313a238 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:28.971074 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22d18d-e859-493b-9981-12c6b313a238 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:28.971838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22d18d-e859-493b-9981-12c6b313a238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:28.978946 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1019/2010] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:27:28.980839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4be6e2-1e7a-475d-90d9-22fd6a8783dd admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:29.006910 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4be6e2-1e7a-475d-90d9-22fd6a8783dd admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:29.018466 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9d22d18d-e859-493b-9981-12c6b313a238 None None] MFA Rules not processed for user `87fdd1ba67a94aa8960bed49de3b38eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:29.020714 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9d22d18d-e859-493b-9981-12c6b313a238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:29.052819 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:29.119021 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 992/2011] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:27:29.131440 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22d18d-e859-493b-9981-12c6b313a238 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:29.133291 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9d22d18d-e859-493b-9981-12c6b313a238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:29.145908 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f16ffa-a219-4e75-bd7d-81087d06d144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:29.147329 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f16ffa-a219-4e75-bd7d-81087d06d144 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:29.148163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f16ffa-a219-4e75-bd7d-81087d06d144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:29.148591 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f16ffa-a219-4e75-bd7d-81087d06d144 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:29.149555 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f16ffa-a219-4e75-bd7d-81087d06d144 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:29.151676 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f16ffa-a219-4e75-bd7d-81087d06d144 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:29.201092 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1020/2012] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:28 2022] POST /identity/v3/projects => generated 373 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:29.204656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f16ffa-a219-4e75-bd7d-81087d06d144 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:29.211994 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:29.255397 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22d18d-e859-493b-9981-12c6b313a238 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:29.320182 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f16ffa-a219-4e75-bd7d-81087d06d144 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:29.325748 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62b1f4-6980-4a55-a0a2-2973d9cc27e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:29.326371 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62b1f4-6980-4a55-a0a2-2973d9cc27e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:29.326844 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62b1f4-6980-4a55-a0a2-2973d9cc27e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:29.327175 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62b1f4-6980-4a55-a0a2-2973d9cc27e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:29.327897 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62b1f4-6980-4a55-a0a2-2973d9cc27e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:29.331123 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62b1f4-6980-4a55-a0a2-2973d9cc27e6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:29.357944 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da853b-e462-4caf-81fa-4b517eed88ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:29.358571 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da853b-e462-4caf-81fa-4b517eed88ba service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:29.358909 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da853b-e462-4caf-81fa-4b517eed88ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:29.359783 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da853b-e462-4caf-81fa-4b517eed88ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:29.391464 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1021/2013] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:29 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:29.394091 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62b1f4-6980-4a55-a0a2-2973d9cc27e6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:29.422916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62b1f4-6980-4a55-a0a2-2973d9cc27e6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:29.439387 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa25e3-3e21-4075-a073-ea4e27fec0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:29.439387 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa25e3-3e21-4075-a073-ea4e27fec0db admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:29.439754 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa25e3-3e21-4075-a073-ea4e27fec0db admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:29.440862 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa25e3-3e21-4075-a073-ea4e27fec0db admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:29.443503 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa25e3-3e21-4075-a073-ea4e27fec0db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:29.445800 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa25e3-3e21-4075-a073-ea4e27fec0db admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:29.457313 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1022/2014] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:29.461806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa25e3-3e21-4075-a073-ea4e27fec0db admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:29.473280 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da853b-e462-4caf-81fa-4b517eed88ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:29.475293 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da853b-e462-4caf-81fa-4b517eed88ba service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:29.476302 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa25e3-3e21-4075-a073-ea4e27fec0db admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:29.485568 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee6951-1e14-43b3-8b2b-5ae5e1a6ab28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:29.486467 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee6951-1e14-43b3-8b2b-5ae5e1a6ab28 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:29.486844 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee6951-1e14-43b3-8b2b-5ae5e1a6ab28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:29.487237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee6951-1e14-43b3-8b2b-5ae5e1a6ab28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:29.488975 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 993/2015] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:27:29.489123 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee6951-1e14-43b3-8b2b-5ae5e1a6ab28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:29.491905 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee6951-1e14-43b3-8b2b-5ae5e1a6ab28 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:29.512853 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da853b-e462-4caf-81fa-4b517eed88ba service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:29.518050 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1023/2016] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:29.523155 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee6951-1e14-43b3-8b2b-5ae5e1a6ab28 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:29.529005 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da853b-e462-4caf-81fa-4b517eed88ba service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:29.537561 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee6951-1e14-43b3-8b2b-5ae5e1a6ab28 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:29.538927 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840e775-3560-427c-9877-8e239bb417b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:29.539775 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840e775-3560-427c-9877-8e239bb417b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:29.540135 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840e775-3560-427c-9877-8e239bb417b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:29.540478 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840e775-3560-427c-9877-8e239bb417b7 admin admin] PATH_INFO: `/v3/users/87fdd1ba67a94aa8960bed49de3b38eb` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:29.541783 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840e775-3560-427c-9877-8e239bb417b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87fdd1ba67a94aa8960bed49de3b38eb)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:29.544274 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840e775-3560-427c-9877-8e239bb417b7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:29.545052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99040899-8b53-430f-816a-126939cada63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:29.545987 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99040899-8b53-430f-816a-126939cada63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:29.546812 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99040899-8b53-430f-816a-126939cada63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:29.547908 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99040899-8b53-430f-816a-126939cada63 admin admin] PATH_INFO: `/v3/projects/dba676f305dc4b139a7ea26521c9f712/users/acd8574f4f58447d96c762198e9ae077/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:29.573463 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99040899-8b53-430f-816a-126939cada63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dba676f305dc4b139a7ea26521c9f712, user_id=acd8574f4f58447d96c762198e9ae077, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:29.578003 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99040899-8b53-430f-816a-126939cada63 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:29.580091 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:29.605475 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1024/2017] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:29 2022] PUT /identity/v3/projects/dba676f305dc4b139a7ea26521c9f712/users/acd8574f4f58447d96c762198e9ae077/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:29.610802 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d692261-76fd-4f19-ba75-a655bfb3ea60 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:29.615186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d692261-76fd-4f19-ba75-a655bfb3ea60 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:29.615738 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d692261-76fd-4f19-ba75-a655bfb3ea60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:29.631980 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7840e775-3560-427c-9877-8e239bb417b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87fdd1ba67a94aa8960bed49de3b38eb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:29.633149 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7840e775-3560-427c-9877-8e239bb417b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87fdd1ba67a94aa8960bed49de3b38eb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:29.643513 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7840e775-3560-427c-9877-8e239bb417b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87fdd1ba67a94aa8960bed49de3b38eb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:29.644242 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2d692261-76fd-4f19-ba75-a655bfb3ea60 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:29.644402 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7840e775-3560-427c-9877-8e239bb417b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87fdd1ba67a94aa8960bed49de3b38eb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:29.647041 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2d692261-76fd-4f19-ba75-a655bfb3ea60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:29.654294 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7840e775-3560-427c-9877-8e239bb417b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87fdd1ba67a94aa8960bed49de3b38eb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:29.677517 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 994/2018] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:29 2022] DELETE /identity/v3/users/87fdd1ba67a94aa8960bed49de3b38eb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:27:29.681080 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53c6be-774c-4663-87b3-aadd365d0a0a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:29.681450 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53c6be-774c-4663-87b3-aadd365d0a0a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:29.681800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53c6be-774c-4663-87b3-aadd365d0a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:29.705752 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9d53c6be-774c-4663-87b3-aadd365d0a0a None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:29.708040 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9d53c6be-774c-4663-87b3-aadd365d0a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:29.746691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1025/2019] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:29.784518 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d692261-76fd-4f19-ba75-a655bfb3ea60 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:29.785916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2d692261-76fd-4f19-ba75-a655bfb3ea60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:29.801512 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 995/2020] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:27:29.823091 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53c6be-774c-4663-87b3-aadd365d0a0a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:29.825439 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9d53c6be-774c-4663-87b3-aadd365d0a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:29.882908 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:29.890113 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d692261-76fd-4f19-ba75-a655bfb3ea60 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:29.944085 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53c6be-774c-4663-87b3-aadd365d0a0a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:29.951123 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc756e20-cb52-40c3-94ab-4fc67947182b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:29.952635 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc756e20-cb52-40c3-94ab-4fc67947182b service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:29.953228 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc756e20-cb52-40c3-94ab-4fc67947182b service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:29.954307 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc756e20-cb52-40c3-94ab-4fc67947182b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:29.977917 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc756e20-cb52-40c3-94ab-4fc67947182b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:29.980790 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc756e20-cb52-40c3-94ab-4fc67947182b service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:29.988998 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d994f3f-20ea-4a15-a469-5c6e61464989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:29.992911 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d994f3f-20ea-4a15-a469-5c6e61464989 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:29.994959 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d994f3f-20ea-4a15-a469-5c6e61464989 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:29.995959 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d994f3f-20ea-4a15-a469-5c6e61464989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:30.007917 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 996/2021] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:30.014095 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d994f3f-20ea-4a15-a469-5c6e61464989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:30.016001 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d994f3f-20ea-4a15-a469-5c6e61464989 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:30.031494 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1026/2022] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:30.480998 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc756e20-cb52-40c3-94ab-4fc67947182b service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:30.482539 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fc756e20-cb52-40c3-94ab-4fc67947182b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:30.495748 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc756e20-cb52-40c3-94ab-4fc67947182b service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:30.501634 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8fdcd-4c1f-496d-b9aa-99659a31536e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:30.502355 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8fdcd-4c1f-496d-b9aa-99659a31536e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:30.503125 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8fdcd-4c1f-496d-b9aa-99659a31536e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:30.503125 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8fdcd-4c1f-496d-b9aa-99659a31536e admin admin] PATH_INFO: `/v3/projects/5ac9bd2e837145aaa8ba36a1d48ebbd4` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:30.504321 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8fdcd-4c1f-496d-b9aa-99659a31536e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ac9bd2e837145aaa8ba36a1d48ebbd4)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:30.508936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8fdcd-4c1f-496d-b9aa-99659a31536e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:30.563737 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:30.593981 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a6f8fdcd-4c1f-496d-b9aa-99659a31536e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ac9bd2e837145aaa8ba36a1d48ebbd4', 'request_id': 'req-a6f8fdcd-4c1f-496d-b9aa-99659a31536e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:30.604897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a6f8fdcd-4c1f-496d-b9aa-99659a31536e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ac9bd2e837145aaa8ba36a1d48ebbd4', 'request_id': 'req-a6f8fdcd-4c1f-496d-b9aa-99659a31536e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:30.615674 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a6f8fdcd-4c1f-496d-b9aa-99659a31536e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ac9bd2e837145aaa8ba36a1d48ebbd4', 'request_id': 'req-a6f8fdcd-4c1f-496d-b9aa-99659a31536e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:30.637044 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a6f8fdcd-4c1f-496d-b9aa-99659a31536e admin admin] The token cache is being invalidate because project 5ac9bd2e837145aaa8ba36a1d48ebbd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:30.637395 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a6f8fdcd-4c1f-496d-b9aa-99659a31536e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:30.638243 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a6f8fdcd-4c1f-496d-b9aa-99659a31536e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:30.640774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 997/2023] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:30 2022] DELETE /identity/v3/projects/5ac9bd2e837145aaa8ba36a1d48ebbd4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:30.651447 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d994f3f-20ea-4a15-a469-5c6e61464989 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:30.662234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d994f3f-20ea-4a15-a469-5c6e61464989 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:30.760483 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a79f47-e201-4723-a32a-d4447acdb561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:30.761427 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a79f47-e201-4723-a32a-d4447acdb561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:30.762382 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a79f47-e201-4723-a32a-d4447acdb561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:30.763027 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a79f47-e201-4723-a32a-d4447acdb561 admin admin] PATH_INFO: `/v3/users/ac3e1fd100614bd299d1bd033a2a6621` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:30.764902 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a79f47-e201-4723-a32a-d4447acdb561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac3e1fd100614bd299d1bd033a2a6621)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:30.770542 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a79f47-e201-4723-a32a-d4447acdb561 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:30.844239 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d9a79f47-e201-4723-a32a-d4447acdb561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac3e1fd100614bd299d1bd033a2a6621'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:30.847091 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d9a79f47-e201-4723-a32a-d4447acdb561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac3e1fd100614bd299d1bd033a2a6621'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:30.888043 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d9a79f47-e201-4723-a32a-d4447acdb561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac3e1fd100614bd299d1bd033a2a6621'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:30.899350 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d9a79f47-e201-4723-a32a-d4447acdb561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac3e1fd100614bd299d1bd033a2a6621'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:30.911056 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d9a79f47-e201-4723-a32a-d4447acdb561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac3e1fd100614bd299d1bd033a2a6621'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:30.919462 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1027/2024] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:30 2022] DELETE /identity/v3/users/ac3e1fd100614bd299d1bd033a2a6621 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:27:31.313256 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8fdcd-4c1f-496d-b9aa-99659a31536e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:31.315371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a6f8fdcd-4c1f-496d-b9aa-99659a31536e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:31.335336 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8fdcd-4c1f-496d-b9aa-99659a31536e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:31.462765 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3d572-83a0-48de-a048-f1d9705160f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:31.464173 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3d572-83a0-48de-a048-f1d9705160f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:31.464550 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3d572-83a0-48de-a048-f1d9705160f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:31.464938 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3d572-83a0-48de-a048-f1d9705160f5 admin admin] PATH_INFO: `/v3/projects/3fae1a25305f435c8bf94097e11d503f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:31.467307 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3d572-83a0-48de-a048-f1d9705160f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fae1a25305f435c8bf94097e11d503f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:31.472193 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3d572-83a0-48de-a048-f1d9705160f5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:31.613095 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-95f3d572-83a0-48de-a048-f1d9705160f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fae1a25305f435c8bf94097e11d503f', 'request_id': 'req-95f3d572-83a0-48de-a048-f1d9705160f5'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:31.632964 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-95f3d572-83a0-48de-a048-f1d9705160f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fae1a25305f435c8bf94097e11d503f', 'request_id': 'req-95f3d572-83a0-48de-a048-f1d9705160f5'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:31.649500 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-95f3d572-83a0-48de-a048-f1d9705160f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fae1a25305f435c8bf94097e11d503f', 'request_id': 'req-95f3d572-83a0-48de-a048-f1d9705160f5'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:31.711632 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-95f3d572-83a0-48de-a048-f1d9705160f5 admin admin] The token cache is being invalidate because project 3fae1a25305f435c8bf94097e11d503f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:31.711632 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-95f3d572-83a0-48de-a048-f1d9705160f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:31.718523 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-95f3d572-83a0-48de-a048-f1d9705160f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:31.726401 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 998/2025] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:31 2022] DELETE /identity/v3/projects/3fae1a25305f435c8bf94097e11d503f => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:31.728710 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba86be6-82c6-44f3-b0bd-eeb80cade87d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:31.729265 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba86be6-82c6-44f3-b0bd-eeb80cade87d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:31.729494 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba86be6-82c6-44f3-b0bd-eeb80cade87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:31.770546 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-bba86be6-82c6-44f3-b0bd-eeb80cade87d None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:31.772735 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bba86be6-82c6-44f3-b0bd-eeb80cade87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:31.803375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3d572-83a0-48de-a048-f1d9705160f5 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:31.805285 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-95f3d572-83a0-48de-a048-f1d9705160f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:31.836940 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:31.932342 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1028/2026] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:31.940111 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815133b-9979-4267-9daf-aba3d4e4ad20 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:31.940398 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815133b-9979-4267-9daf-aba3d4e4ad20 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:31.940675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815133b-9979-4267-9daf-aba3d4e4ad20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:31.945044 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:31.956947 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3d572-83a0-48de-a048-f1d9705160f5 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:31.971821 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425498c2-c577-4224-a761-7769015b5dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:31.972696 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425498c2-c577-4224-a761-7769015b5dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:31.972984 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425498c2-c577-4224-a761-7769015b5dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:31.974440 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425498c2-c577-4224-a761-7769015b5dcc admin admin] PATH_INFO: `/v3/projects/4cc43fae88cc4e27b2f620ab62e1c757` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:31.975152 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-7815133b-9979-4267-9daf-aba3d4e4ad20 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:31.976390 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425498c2-c577-4224-a761-7769015b5dcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cc43fae88cc4e27b2f620ab62e1c757)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:31.976559 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7815133b-9979-4267-9daf-aba3d4e4ad20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:31.981535 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425498c2-c577-4224-a761-7769015b5dcc admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:31.995959 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1029/2027] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:27:31.999724 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815133b-9979-4267-9daf-aba3d4e4ad20 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:32.018924 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815133b-9979-4267-9daf-aba3d4e4ad20 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:32.029033 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7801fcd-4681-48c7-bde0-964a5fe41b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:32.029995 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7801fcd-4681-48c7-bde0-964a5fe41b6c admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:32.030665 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7801fcd-4681-48c7-bde0-964a5fe41b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:32.031593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7801fcd-4681-48c7-bde0-964a5fe41b6c admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:32.034346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7801fcd-4681-48c7-bde0-964a5fe41b6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:27:32.035682 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7801fcd-4681-48c7-bde0-964a5fe41b6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:32.039486 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7801fcd-4681-48c7-bde0-964a5fe41b6c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:32.062705 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1030/2028] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:27:32.064816 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7801fcd-4681-48c7-bde0-964a5fe41b6c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:32.080739 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7801fcd-4681-48c7-bde0-964a5fe41b6c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:32.087533 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-425498c2-c577-4224-a761-7769015b5dcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cc43fae88cc4e27b2f620ab62e1c757', 'request_id': 'req-425498c2-c577-4224-a761-7769015b5dcc'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:32.095923 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-425498c2-c577-4224-a761-7769015b5dcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cc43fae88cc4e27b2f620ab62e1c757', 'request_id': 'req-425498c2-c577-4224-a761-7769015b5dcc'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:32.106127 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-425498c2-c577-4224-a761-7769015b5dcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cc43fae88cc4e27b2f620ab62e1c757', 'request_id': 'req-425498c2-c577-4224-a761-7769015b5dcc'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:32.169870 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-425498c2-c577-4224-a761-7769015b5dcc admin admin] The token cache is being invalidate because project 4cc43fae88cc4e27b2f620ab62e1c757 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:32.170182 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-425498c2-c577-4224-a761-7769015b5dcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:32.173068 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-425498c2-c577-4224-a761-7769015b5dcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:32.176326 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 999/2029] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:31 2022] DELETE /identity/v3/projects/4cc43fae88cc4e27b2f620ab62e1c757 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:32.181837 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2db712-dd66-46e0-bb9e-0c3d75f29d3a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:32.182147 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2db712-dd66-46e0-bb9e-0c3d75f29d3a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:32.182389 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2db712-dd66-46e0-bb9e-0c3d75f29d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:32.230562 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6c2db712-dd66-46e0-bb9e-0c3d75f29d3a None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:32.236769 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6c2db712-dd66-46e0-bb9e-0c3d75f29d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:32.303518 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cad541-869a-4c1e-affe-46316f5b8e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:32.304160 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cad541-869a-4c1e-affe-46316f5b8e70 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:32.304443 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cad541-869a-4c1e-affe-46316f5b8e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:32.304718 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cad541-869a-4c1e-affe-46316f5b8e70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:32.305374 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cad541-869a-4c1e-affe-46316f5b8e70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:32.307896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cad541-869a-4c1e-affe-46316f5b8e70 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:32.350742 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1031/2030] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:32 2022] POST /identity/v3/projects => generated 385 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:32.353450 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cad541-869a-4c1e-affe-46316f5b8e70 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:32.356422 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f8cad541-869a-4c1e-affe-46316f5b8e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:32.384257 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1000/2031] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:27:32.393176 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a59800-1079-42bb-b8d6-4a3f51354817 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:32.393884 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a59800-1079-42bb-b8d6-4a3f51354817 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:32.394341 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a59800-1079-42bb-b8d6-4a3f51354817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:32.420453 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-14a59800-1079-42bb-b8d6-4a3f51354817 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:32.422177 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-14a59800-1079-42bb-b8d6-4a3f51354817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:32.449789 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cad541-869a-4c1e-affe-46316f5b8e70 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:32.457461 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d4971-eca6-484b-b0b9-a521774fd361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:32.458599 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d4971-eca6-484b-b0b9-a521774fd361 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:32.458901 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d4971-eca6-484b-b0b9-a521774fd361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:32.459177 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d4971-eca6-484b-b0b9-a521774fd361 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:32.459825 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d4971-eca6-484b-b0b9-a521774fd361 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:32.474795 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d4971-eca6-484b-b0b9-a521774fd361 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:32.513723 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1032/2032] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:32 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:32.517382 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d4971-eca6-484b-b0b9-a521774fd361 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:32.534183 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d4971-eca6-484b-b0b9-a521774fd361 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:32.550659 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20e6ec-c876-47fe-9e62-4fcf1d4211ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:32.550961 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1001/2033] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:27:32.551534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20e6ec-c876-47fe-9e62-4fcf1d4211ec admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:32.552694 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a59800-1079-42bb-b8d6-4a3f51354817 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:32.553377 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20e6ec-c876-47fe-9e62-4fcf1d4211ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:32.554009 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20e6ec-c876-47fe-9e62-4fcf1d4211ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:32.556853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20e6ec-c876-47fe-9e62-4fcf1d4211ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:32.558970 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20e6ec-c876-47fe-9e62-4fcf1d4211ec admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:32.573194 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a59800-1079-42bb-b8d6-4a3f51354817 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:32.584973 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1033/2034] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:27:32.586993 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20e6ec-c876-47fe-9e62-4fcf1d4211ec admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:32.588861 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d23aa-42c8-4dfc-96f3-3c1390d6f4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:32.590016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d23aa-42c8-4dfc-96f3-3c1390d6f4ae admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:32.590129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d23aa-42c8-4dfc-96f3-3c1390d6f4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:32.590858 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d23aa-42c8-4dfc-96f3-3c1390d6f4ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:32.592973 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d23aa-42c8-4dfc-96f3-3c1390d6f4ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:27:32.594658 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d23aa-42c8-4dfc-96f3-3c1390d6f4ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:32.598241 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d23aa-42c8-4dfc-96f3-3c1390d6f4ae admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:32.607487 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20e6ec-c876-47fe-9e62-4fcf1d4211ec admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:32.621207 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b138a2f-8bfe-4d55-921a-5c6000bd9815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:32.622298 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b138a2f-8bfe-4d55-921a-5c6000bd9815 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:32.624600 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b138a2f-8bfe-4d55-921a-5c6000bd9815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:32.624973 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b138a2f-8bfe-4d55-921a-5c6000bd9815 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:32.625765 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b138a2f-8bfe-4d55-921a-5c6000bd9815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:32.626286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1002/2035] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:27:32.628653 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d23aa-42c8-4dfc-96f3-3c1390d6f4ae admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:32.629677 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b138a2f-8bfe-4d55-921a-5c6000bd9815 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:32.636552 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:32.657990 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d23aa-42c8-4dfc-96f3-3c1390d6f4ae admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:32.659252 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1034/2036] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:32.661941 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b138a2f-8bfe-4d55-921a-5c6000bd9815 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:32.671259 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37fac2-4a10-41de-9356-a42670469a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:32.671970 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37fac2-4a10-41de-9356-a42670469a29 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:32.672322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37fac2-4a10-41de-9356-a42670469a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:32.672667 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37fac2-4a10-41de-9356-a42670469a29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:32.675272 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37fac2-4a10-41de-9356-a42670469a29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:32.679375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37fac2-4a10-41de-9356-a42670469a29 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:32.683635 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b138a2f-8bfe-4d55-921a-5c6000bd9815 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:32.701712 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74516e50-02f1-4c49-b332-299b8712ace8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:32.702079 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74516e50-02f1-4c49-b332-299b8712ace8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:32.702454 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74516e50-02f1-4c49-b332-299b8712ace8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:32.702800 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74516e50-02f1-4c49-b332-299b8712ace8 admin admin] PATH_INFO: `/v3/projects/3f33be456fb8409682386100988d0110/users/7dc48f921b4647a592abd1be569471e0/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:32.708292 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:32.729281 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74516e50-02f1-4c49-b332-299b8712ace8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f33be456fb8409682386100988d0110, user_id=7dc48f921b4647a592abd1be569471e0, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:32.732392 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74516e50-02f1-4c49-b332-299b8712ace8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:32.753890 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1035/2037] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:32 2022] PUT /identity/v3/projects/3f33be456fb8409682386100988d0110/users/7dc48f921b4647a592abd1be569471e0/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:32.756897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1003/2038] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:32 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:32.764454 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad6fad-628e-4cd2-8927-2614ab5a5a56 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:32.765789 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad6fad-628e-4cd2-8927-2614ab5a5a56 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:32.766315 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37fac2-4a10-41de-9356-a42670469a29 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:32.766520 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad6fad-628e-4cd2-8927-2614ab5a5a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:32.813645 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-baad6fad-628e-4cd2-8927-2614ab5a5a56 None None] MFA Rules not processed for user `7dc48f921b4647a592abd1be569471e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:32.815249 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-baad6fad-628e-4cd2-8927-2614ab5a5a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:32.931000 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1036/2039] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:32.933583 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad6fad-628e-4cd2-8927-2614ab5a5a56 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:32.965416 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37fac2-4a10-41de-9356-a42670469a29 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:32.975772 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3387c34-0fee-4f2d-b9c6-eb4d7f132c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:32.976407 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3387c34-0fee-4f2d-b9c6-eb4d7f132c39 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:32.983221 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3387c34-0fee-4f2d-b9c6-eb4d7f132c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:32.983740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3387c34-0fee-4f2d-b9c6-eb4d7f132c39 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:32.984818 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3387c34-0fee-4f2d-b9c6-eb4d7f132c39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:32.986989 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3387c34-0fee-4f2d-b9c6-eb4d7f132c39 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:33.028856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1004/2040] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:32 2022] POST /identity/v3/users => generated 286 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:33.033267 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17331e3-e714-48e7-a778-a96d4e7b2e5c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:33.033603 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17331e3-e714-48e7-a778-a96d4e7b2e5c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:33.033877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17331e3-e714-48e7-a778-a96d4e7b2e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:33.036605 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad6fad-628e-4cd2-8927-2614ab5a5a56 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:33.046018 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033fd63-9349-4fce-8087-5822ea1ed2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:33.047102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033fd63-9349-4fce-8087-5822ea1ed2b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:33.048040 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033fd63-9349-4fce-8087-5822ea1ed2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:33.048503 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033fd63-9349-4fce-8087-5822ea1ed2b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:33.050168 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033fd63-9349-4fce-8087-5822ea1ed2b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:33.054298 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033fd63-9349-4fce-8087-5822ea1ed2b8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:33.065040 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e17331e3-e714-48e7-a778-a96d4e7b2e5c None None] MFA Rules not processed for user `acd8574f4f58447d96c762198e9ae077`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:33.066591 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e17331e3-e714-48e7-a778-a96d4e7b2e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:33.113686 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1037/2041] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:32 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:33.116261 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033fd63-9349-4fce-8087-5822ea1ed2b8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:33.167570 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1005/2042] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:33.168577 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17331e3-e714-48e7-a778-a96d4e7b2e5c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:33.186586 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17331e3-e714-48e7-a778-a96d4e7b2e5c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:33.200195 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:33.217703 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033fd63-9349-4fce-8087-5822ea1ed2b8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:33.222845 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8d5b3-cec1-464c-ae3b-d9af07bf55bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:33.223459 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8d5b3-cec1-464c-ae3b-d9af07bf55bb admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:33.223771 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8d5b3-cec1-464c-ae3b-d9af07bf55bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:33.224046 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8d5b3-cec1-464c-ae3b-d9af07bf55bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:33.224702 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8d5b3-cec1-464c-ae3b-d9af07bf55bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:33.226348 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8d5b3-cec1-464c-ae3b-d9af07bf55bb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:33.240472 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1038/2043] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:33.240472 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8d5b3-cec1-464c-ae3b-d9af07bf55bb admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:33.242430 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-13c8d5b3-cec1-464c-ae3b-d9af07bf55bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:33.257011 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8d5b3-cec1-464c-ae3b-d9af07bf55bb admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:33.262729 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0612c1-4f7a-4e83-a552-92c4bd2463c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:33.263336 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0612c1-4f7a-4e83-a552-92c4bd2463c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:33.263648 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0612c1-4f7a-4e83-a552-92c4bd2463c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:33.263878 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0612c1-4f7a-4e83-a552-92c4bd2463c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:33.264508 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0612c1-4f7a-4e83-a552-92c4bd2463c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:33.266619 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0612c1-4f7a-4e83-a552-92c4bd2463c8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:33.268776 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8403e7-9092-4b12-b6dc-fc995cdda9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:33.270250 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8403e7-9092-4b12-b6dc-fc995cdda9ec admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:33.270730 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8403e7-9092-4b12-b6dc-fc995cdda9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:33.272008 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8403e7-9092-4b12-b6dc-fc995cdda9ec admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:33.272942 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8403e7-9092-4b12-b6dc-fc995cdda9ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:33.275838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8403e7-9092-4b12-b6dc-fc995cdda9ec admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:33.301068 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:33.305589 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1039/2044] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:33 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:33.306712 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0612c1-4f7a-4e83-a552-92c4bd2463c8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:33.311838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1006/2045] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:33 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:33.311838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8403e7-9092-4b12-b6dc-fc995cdda9ec admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:33.324353 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8403e7-9092-4b12-b6dc-fc995cdda9ec admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:33.392770 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0612c1-4f7a-4e83-a552-92c4bd2463c8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:33.400400 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fb52f-d66d-4db6-bfd4-256b53a28205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:33.401151 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fb52f-d66d-4db6-bfd4-256b53a28205 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:33.401483 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fb52f-d66d-4db6-bfd4-256b53a28205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:33.401765 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fb52f-d66d-4db6-bfd4-256b53a28205 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:33.402931 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6fb52f-d66d-4db6-bfd4-256b53a28205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:33.405011 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6fb52f-d66d-4db6-bfd4-256b53a28205 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:33.419018 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1040/2046] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:33.420626 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fb52f-d66d-4db6-bfd4-256b53a28205 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:33.424663 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd650175-b5d1-4ee9-84fc-cabda92b172b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:33.425288 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd650175-b5d1-4ee9-84fc-cabda92b172b admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:33.425677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd650175-b5d1-4ee9-84fc-cabda92b172b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:33.426148 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd650175-b5d1-4ee9-84fc-cabda92b172b admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:33.426828 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd650175-b5d1-4ee9-84fc-cabda92b172b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:33.430857 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd650175-b5d1-4ee9-84fc-cabda92b172b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:33.431493 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fb52f-d66d-4db6-bfd4-256b53a28205 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:33.436827 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c833c-6cae-4a4f-b6ac-f48c3383635c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:33.437608 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c833c-6cae-4a4f-b6ac-f48c3383635c admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:33.437903 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c833c-6cae-4a4f-b6ac-f48c3383635c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:33.438291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c833c-6cae-4a4f-b6ac-f48c3383635c admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:33.439541 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c833c-6cae-4a4f-b6ac-f48c3383635c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:33.441307 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c833c-6cae-4a4f-b6ac-f48c3383635c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:33.464391 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1041/2047] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:33.466490 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c833c-6cae-4a4f-b6ac-f48c3383635c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:33.466749 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1007/2048] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:33 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:33.470334 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd650175-b5d1-4ee9-84fc-cabda92b172b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:33.482169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c833c-6cae-4a4f-b6ac-f48c3383635c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:33.482369 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd650175-b5d1-4ee9-84fc-cabda92b172b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:33.487425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881de8d7-ae1d-4355-82b7-ad45c8ff6f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:33.488176 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881de8d7-ae1d-4355-82b7-ad45c8ff6f55 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:33.488459 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881de8d7-ae1d-4355-82b7-ad45c8ff6f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:33.488731 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881de8d7-ae1d-4355-82b7-ad45c8ff6f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:33.489985 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881de8d7-ae1d-4355-82b7-ad45c8ff6f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:33.490898 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a21c71-969f-46f3-b035-3cfd685d09df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:33.491802 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a21c71-969f-46f3-b035-3cfd685d09df admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:33.492102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881de8d7-ae1d-4355-82b7-ad45c8ff6f55 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:33.492514 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a21c71-969f-46f3-b035-3cfd685d09df admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:33.493451 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a21c71-969f-46f3-b035-3cfd685d09df admin admin] PATH_INFO: `/v3/projects/d27808985f0247b7a5934742c0f2d7e0/users/f87c6d0e007d44c1a935c73404a9b619/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:33.509447 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1008/2049] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:33.509447 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881de8d7-ae1d-4355-82b7-ad45c8ff6f55 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:33.516137 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a21c71-969f-46f3-b035-3cfd685d09df admin admin] RBAC: Authorizing `identity:create_grant(project_id=d27808985f0247b7a5934742c0f2d7e0, user_id=f87c6d0e007d44c1a935c73404a9b619, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:33.519499 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a21c71-969f-46f3-b035-3cfd685d09df admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:33.527360 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881de8d7-ae1d-4355-82b7-ad45c8ff6f55 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:33.541080 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1042/2050] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:33 2022] PUT /identity/v3/projects/d27808985f0247b7a5934742c0f2d7e0/users/f87c6d0e007d44c1a935c73404a9b619/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:33.541080 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a21c71-969f-46f3-b035-3cfd685d09df admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:33.619283 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efef073-7d27-4904-84d8-6ccfa3241bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:33.619916 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efef073-7d27-4904-84d8-6ccfa3241bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:33.620302 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efef073-7d27-4904-84d8-6ccfa3241bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:33.620452 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efef073-7d27-4904-84d8-6ccfa3241bf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:33.621112 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efef073-7d27-4904-84d8-6ccfa3241bf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:33.622787 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efef073-7d27-4904-84d8-6ccfa3241bf7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:33.640179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a21c71-969f-46f3-b035-3cfd685d09df admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:33.640754 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1009/2051] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:33.642101 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef2298-c74c-404b-ac78-4374aaf60a15 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:33.642392 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef2298-c74c-404b-ac78-4374aaf60a15 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:33.642666 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef2298-c74c-404b-ac78-4374aaf60a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:33.659410 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953dde5-4ac9-4d8d-8610-33adcccf56a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:33.660826 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953dde5-4ac9-4d8d-8610-33adcccf56a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:33.661117 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953dde5-4ac9-4d8d-8610-33adcccf56a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:33.662909 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953dde5-4ac9-4d8d-8610-33adcccf56a5 admin admin] PATH_INFO: `/v3/projects/5bbc9a8fd39d476298d65026078eebe5/users/64836e87249740f792792ed4a0739ef4/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:33.663311 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6cef2298-c74c-404b-ac78-4374aaf60a15 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:33.664550 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6cef2298-c74c-404b-ac78-4374aaf60a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:33.672922 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1010/2052] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:33.673710 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef2298-c74c-404b-ac78-4374aaf60a15 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:33.684267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953dde5-4ac9-4d8d-8610-33adcccf56a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bbc9a8fd39d476298d65026078eebe5, user_id=64836e87249740f792792ed4a0739ef4, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:33.687951 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953dde5-4ac9-4d8d-8610-33adcccf56a5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:33.691887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef2298-c74c-404b-ac78-4374aaf60a15 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:33.697725 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96f783-f4eb-4dcc-9280-ad6447327978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:33.698485 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96f783-f4eb-4dcc-9280-ad6447327978 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:33.698677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96f783-f4eb-4dcc-9280-ad6447327978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:33.698964 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96f783-f4eb-4dcc-9280-ad6447327978 admin admin] PATH_INFO: `/v3/projects/a4d6d57909484b17939d74c1cd38a610/users/6134c54d4895427099fe7dec08c20292/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:33.714931 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1043/2053] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:33 2022] PUT /identity/v3/projects/5bbc9a8fd39d476298d65026078eebe5/users/64836e87249740f792792ed4a0739ef4/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:33.714931 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953dde5-4ac9-4d8d-8610-33adcccf56a5 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:33.716073 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96f783-f4eb-4dcc-9280-ad6447327978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4d6d57909484b17939d74c1cd38a610, user_id=6134c54d4895427099fe7dec08c20292, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:33.716782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5953dde5-4ac9-4d8d-8610-33adcccf56a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:33.719175 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96f783-f4eb-4dcc-9280-ad6447327978 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:33.729686 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:33.736391 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1011/2054] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:33 2022] PUT /identity/v3/projects/a4d6d57909484b17939d74c1cd38a610/users/6134c54d4895427099fe7dec08c20292/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:33.737517 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285ccc8-d844-4ab1-86f3-fc327cd16189 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:33.737820 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285ccc8-d844-4ab1-86f3-fc327cd16189 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:33.738079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285ccc8-d844-4ab1-86f3-fc327cd16189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:33.768932 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7285ccc8-d844-4ab1-86f3-fc327cd16189 None None] MFA Rules not processed for user `64836e87249740f792792ed4a0739ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:33.770252 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7285ccc8-d844-4ab1-86f3-fc327cd16189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:33.784507 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953dde5-4ac9-4d8d-8610-33adcccf56a5 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:33.809548 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:33.844905 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f476747-e9ba-47e9-bccc-c9b74ea3e3d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:33.845789 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f476747-e9ba-47e9-bccc-c9b74ea3e3d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:33.846301 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f476747-e9ba-47e9-bccc-c9b74ea3e3d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:33.846638 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f476747-e9ba-47e9-bccc-c9b74ea3e3d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:33.863122 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1012/2055] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:33.863857 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285ccc8-d844-4ab1-86f3-fc327cd16189 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:33.921572 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f476747-e9ba-47e9-bccc-c9b74ea3e3d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:33.923087 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f476747-e9ba-47e9-bccc-c9b74ea3e3d7 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:33.933485 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1044/2056] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:33.934476 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f476747-e9ba-47e9-bccc-c9b74ea3e3d7 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:33.946514 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f476747-e9ba-47e9-bccc-c9b74ea3e3d7 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:33.957835 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285ccc8-d844-4ab1-86f3-fc327cd16189 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:33.961301 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76eb24-e4d4-43b7-9569-6c431482f816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:33.961979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76eb24-e4d4-43b7-9569-6c431482f816 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:33.962261 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76eb24-e4d4-43b7-9569-6c431482f816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:33.962531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76eb24-e4d4-43b7-9569-6c431482f816 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:33.963169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76eb24-e4d4-43b7-9569-6c431482f816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:33.966174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76eb24-e4d4-43b7-9569-6c431482f816 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:33.975034 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a714298-6924-4d73-8545-4bfa03cf414c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:33.975706 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a714298-6924-4d73-8545-4bfa03cf414c admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:33.975992 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a714298-6924-4d73-8545-4bfa03cf414c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:33.976814 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a714298-6924-4d73-8545-4bfa03cf414c admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:33.976947 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a714298-6924-4d73-8545-4bfa03cf414c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:33.978547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a714298-6924-4d73-8545-4bfa03cf414c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:33.996587 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1013/2057] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:33.997884 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a714298-6924-4d73-8545-4bfa03cf414c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:34.000066 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2a714298-6924-4d73-8545-4bfa03cf414c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:34.007624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1045/2058] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:33 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:34.008811 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76eb24-e4d4-43b7-9569-6c431482f816 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:34.015597 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a714298-6924-4d73-8545-4bfa03cf414c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:34.093723 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:34.102745 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16c011-e132-4fee-8031-39074bc884fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:34.103406 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16c011-e132-4fee-8031-39074bc884fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:34.103689 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16c011-e132-4fee-8031-39074bc884fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:34.103962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16c011-e132-4fee-8031-39074bc884fa admin admin] PATH_INFO: `/v3/users/b871b52848ed4c7e8f16a9da13996b2f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:34.105327 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16c011-e132-4fee-8031-39074bc884fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b871b52848ed4c7e8f16a9da13996b2f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:34.107881 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16c011-e132-4fee-8031-39074bc884fa admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:34.109884 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76eb24-e4d4-43b7-9569-6c431482f816 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:34.117218 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ccae5d-118a-43e8-89a8-6a2f032ea02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:34.118556 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccae5d-118a-43e8-89a8-6a2f032ea02d admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:34.119079 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccae5d-118a-43e8-89a8-6a2f032ea02d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:34.119605 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccae5d-118a-43e8-89a8-6a2f032ea02d admin admin] PATH_INFO: `/v3/projects/a4d6d57909484b17939d74c1cd38a610/users/6134c54d4895427099fe7dec08c20292/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:34.121823 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ccae5d-118a-43e8-89a8-6a2f032ea02d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4d6d57909484b17939d74c1cd38a610, user_id=6134c54d4895427099fe7dec08c20292, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:34.125846 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ccae5d-118a-43e8-89a8-6a2f032ea02d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:34.169363 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fb16c011-e132-4fee-8031-39074bc884fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b871b52848ed4c7e8f16a9da13996b2f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:34.170284 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fb16c011-e132-4fee-8031-39074bc884fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b871b52848ed4c7e8f16a9da13996b2f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:34.176083 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1046/2059] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:34 2022] PUT /identity/v3/projects/a4d6d57909484b17939d74c1cd38a610/users/6134c54d4895427099fe7dec08c20292/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:34.179322 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ccae5d-118a-43e8-89a8-6a2f032ea02d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:34.206961 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fb16c011-e132-4fee-8031-39074bc884fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b871b52848ed4c7e8f16a9da13996b2f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:34.208743 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fb16c011-e132-4fee-8031-39074bc884fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b871b52848ed4c7e8f16a9da13996b2f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:34.219037 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fb16c011-e132-4fee-8031-39074bc884fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b871b52848ed4c7e8f16a9da13996b2f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:34.233776 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:34.255327 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1014/2060] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:33 2022] DELETE /identity/v3/users/b871b52848ed4c7e8f16a9da13996b2f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:34.260996 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfb040-df6a-40a7-9c7e-b29ea8abd091 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:34.261640 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfb040-df6a-40a7-9c7e-b29ea8abd091 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:34.262280 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfb040-df6a-40a7-9c7e-b29ea8abd091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:34.272206 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ccae5d-118a-43e8-89a8-6a2f032ea02d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:34.291846 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7dbfb040-df6a-40a7-9c7e-b29ea8abd091 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:34.293132 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7dbfb040-df6a-40a7-9c7e-b29ea8abd091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:34.392632 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee99b1-7e0e-47dd-9de1-1f559dadcd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:34.393546 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee99b1-7e0e-47dd-9de1-1f559dadcd99 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:34.393967 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee99b1-7e0e-47dd-9de1-1f559dadcd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:34.394374 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee99b1-7e0e-47dd-9de1-1f559dadcd99 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:34.395161 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee99b1-7e0e-47dd-9de1-1f559dadcd99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:34.398358 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee99b1-7e0e-47dd-9de1-1f559dadcd99 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:34.437104 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1015/2061] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:34.446029 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbfb040-df6a-40a7-9c7e-b29ea8abd091 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:34.450876 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7dbfb040-df6a-40a7-9c7e-b29ea8abd091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:34.467675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1047/2062] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:34 2022] POST /identity/v3/users => generated 298 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:34.467675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee99b1-7e0e-47dd-9de1-1f559dadcd99 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:34.472230 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-04ee99b1-7e0e-47dd-9de1-1f559dadcd99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:34.495750 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee99b1-7e0e-47dd-9de1-1f559dadcd99 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:34.511403 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084cd02-b463-4edf-acda-a4e4436ec030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:34.512020 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084cd02-b463-4edf-acda-a4e4436ec030 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:34.512294 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084cd02-b463-4edf-acda-a4e4436ec030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:34.512713 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084cd02-b463-4edf-acda-a4e4436ec030 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:34.513367 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084cd02-b463-4edf-acda-a4e4436ec030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:34.514991 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084cd02-b463-4edf-acda-a4e4436ec030 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:34.533032 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1048/2063] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:34.543582 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084cd02-b463-4edf-acda-a4e4436ec030 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:34.557900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084cd02-b463-4edf-acda-a4e4436ec030 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:34.565116 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65da00-2b94-4f62-98aa-fb336e3218e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:34.566043 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65da00-2b94-4f62-98aa-fb336e3218e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:34.566461 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65da00-2b94-4f62-98aa-fb336e3218e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:34.567025 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65da00-2b94-4f62-98aa-fb336e3218e9 admin admin] PATH_INFO: `/v3/projects/6ef7023fca4842fca284651d7faa2d8b/users/fc38d8ad737f4c238db869d045ad346a/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:34.596281 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb65da00-2b94-4f62-98aa-fb336e3218e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef7023fca4842fca284651d7faa2d8b, user_id=fc38d8ad737f4c238db869d045ad346a, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:34.604286 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb65da00-2b94-4f62-98aa-fb336e3218e9 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:34.608251 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbfb040-df6a-40a7-9c7e-b29ea8abd091 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:34.618351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d66a7-c72d-4bab-8022-c0b8186a3cb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:34.618988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d66a7-c72d-4bab-8022-c0b8186a3cb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:34.619423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d66a7-c72d-4bab-8022-c0b8186a3cb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:34.619773 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d66a7-c72d-4bab-8022-c0b8186a3cb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:34.633097 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1049/2064] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:34 2022] PUT /identity/v3/projects/6ef7023fca4842fca284651d7faa2d8b/users/fc38d8ad737f4c238db869d045ad346a/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:34.637924 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65da00-2b94-4f62-98aa-fb336e3218e9 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:34.650036 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d66a7-c72d-4bab-8022-c0b8186a3cb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:34.653567 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d66a7-c72d-4bab-8022-c0b8186a3cb1 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:34.669293 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1016/2065] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:34.729572 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:34.763154 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65da00-2b94-4f62-98aa-fb336e3218e9 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:34.783892 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f96ee-2100-402d-b3aa-cb448bc1df72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:34.784519 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f96ee-2100-402d-b3aa-cb448bc1df72 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:34.784795 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f96ee-2100-402d-b3aa-cb448bc1df72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:34.785061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f96ee-2100-402d-b3aa-cb448bc1df72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:34.785738 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f96ee-2100-402d-b3aa-cb448bc1df72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:34.787736 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f96ee-2100-402d-b3aa-cb448bc1df72 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:34.806809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1050/2066] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:27:34.807529 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d66a7-c72d-4bab-8022-c0b8186a3cb1 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:34.834859 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d66a7-c72d-4bab-8022-c0b8186a3cb1 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:34.849860 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439622ad-62c5-4b6f-a8dc-ab9884b773e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:34.850428 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439622ad-62c5-4b6f-a8dc-ab9884b773e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:34.850572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439622ad-62c5-4b6f-a8dc-ab9884b773e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:34.851290 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439622ad-62c5-4b6f-a8dc-ab9884b773e9 admin admin] PATH_INFO: `/v3/projects/6ef7023fca4842fca284651d7faa2d8b/users/fc38d8ad737f4c238db869d045ad346a/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:34.857283 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439622ad-62c5-4b6f-a8dc-ab9884b773e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef7023fca4842fca284651d7faa2d8b, user_id=fc38d8ad737f4c238db869d045ad346a, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:34.866222 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439622ad-62c5-4b6f-a8dc-ab9884b773e9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:34.908895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1017/2067] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:34 2022] PUT /identity/v3/projects/6ef7023fca4842fca284651d7faa2d8b/users/fc38d8ad737f4c238db869d045ad346a/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:27:34.910657 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6613c-a7e3-4d5e-88b3-9859c8b547e0 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:34.911039 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6613c-a7e3-4d5e-88b3-9859c8b547e0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:34.912029 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6613c-a7e3-4d5e-88b3-9859c8b547e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:34.946937 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1ce6613c-a7e3-4d5e-88b3-9859c8b547e0 None None] MFA Rules not processed for user `fc38d8ad737f4c238db869d045ad346a`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:34.948551 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1ce6613c-a7e3-4d5e-88b3-9859c8b547e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:35.041888 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1051/2068] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:34 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:35.058328 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439622ad-62c5-4b6f-a8dc-ab9884b773e9 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:35.060385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-439622ad-62c5-4b6f-a8dc-ab9884b773e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:35.140075 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439622ad-62c5-4b6f-a8dc-ab9884b773e9 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:35.144144 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4846ddc-52be-40b3-94e0-92e6b820037e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:35.144816 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4846ddc-52be-40b3-94e0-92e6b820037e service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:35.145098 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4846ddc-52be-40b3-94e0-92e6b820037e service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:35.145615 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4846ddc-52be-40b3-94e0-92e6b820037e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:35.147437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e4846ddc-52be-40b3-94e0-92e6b820037e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:35.168495 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6613c-a7e3-4d5e-88b3-9859c8b547e0 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:35.171027 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1ce6613c-a7e3-4d5e-88b3-9859c8b547e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:35.220124 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:35.286679 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6613c-a7e3-4d5e-88b3-9859c8b547e0 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:35.293449 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b28578-35a3-4758-b3b1-2e90224667c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:35.294109 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b28578-35a3-4758-b3b1-2e90224667c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:35.294393 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b28578-35a3-4758-b3b1-2e90224667c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:35.294825 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b28578-35a3-4758-b3b1-2e90224667c6 admin admin] PATH_INFO: `/v3/projects/54d944da893449bc9b2cb61dd32a3eda` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:35.296250 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b28578-35a3-4758-b3b1-2e90224667c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54d944da893449bc9b2cb61dd32a3eda)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:35.296807 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4846ddc-52be-40b3-94e0-92e6b820037e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:35.298976 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b28578-35a3-4758-b3b1-2e90224667c6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:35.306012 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4846ddc-52be-40b3-94e0-92e6b820037e service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:35.322721 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1018/2069] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:35.324653 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5b11f-aee4-4a99-8d5f-30fd72273c8a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:35.325022 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5b11f-aee4-4a99-8d5f-30fd72273c8a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:35.325513 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5b11f-aee4-4a99-8d5f-30fd72273c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:35.377931 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-13c5b11f-aee4-4a99-8d5f-30fd72273c8a None None] MFA Rules not processed for user `f87c6d0e007d44c1a935c73404a9b619`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:35.379439 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-13c5b11f-aee4-4a99-8d5f-30fd72273c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:35.420612 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-60b28578-35a3-4758-b3b1-2e90224667c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54d944da893449bc9b2cb61dd32a3eda', 'request_id': 'req-60b28578-35a3-4758-b3b1-2e90224667c6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:35.432417 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-60b28578-35a3-4758-b3b1-2e90224667c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54d944da893449bc9b2cb61dd32a3eda', 'request_id': 'req-60b28578-35a3-4758-b3b1-2e90224667c6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:35.439189 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-60b28578-35a3-4758-b3b1-2e90224667c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54d944da893449bc9b2cb61dd32a3eda', 'request_id': 'req-60b28578-35a3-4758-b3b1-2e90224667c6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:35.451430 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:35.460723 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-60b28578-35a3-4758-b3b1-2e90224667c6 admin admin] The token cache is being invalidate because project 54d944da893449bc9b2cb61dd32a3eda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:35.461516 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-60b28578-35a3-4758-b3b1-2e90224667c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:35.464090 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-60b28578-35a3-4758-b3b1-2e90224667c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:35.466860 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1052/2070] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:35 2022] DELETE /identity/v3/projects/54d944da893449bc9b2cb61dd32a3eda => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:35.469033 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52955fa1-88ed-45b4-bc20-e43df5c52f09 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:35.470088 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52955fa1-88ed-45b4-bc20-e43df5c52f09 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:35.470088 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52955fa1-88ed-45b4-bc20-e43df5c52f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:35.497341 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1019/2071] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:35.502342 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f21dc5-51cd-49a0-bb4b-103c2ef164e3 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:35.502605 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f21dc5-51cd-49a0-bb4b-103c2ef164e3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:35.503311 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f21dc5-51cd-49a0-bb4b-103c2ef164e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:35.521142 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-52955fa1-88ed-45b4-bc20-e43df5c52f09 None None] MFA Rules not processed for user `6134c54d4895427099fe7dec08c20292`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:35.522873 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-52955fa1-88ed-45b4-bc20-e43df5c52f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:35.531978 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-74f21dc5-51cd-49a0-bb4b-103c2ef164e3 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:35.533287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-74f21dc5-51cd-49a0-bb4b-103c2ef164e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:35.636147 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1020/2072] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:35.637043 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f21dc5-51cd-49a0-bb4b-103c2ef164e3 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:35.637870 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1053/2073] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:35.638856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-74f21dc5-51cd-49a0-bb4b-103c2ef164e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:35.653581 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd5a06-8fa4-4c12-93ab-8cd5f9709590 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:35.655193 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd5a06-8fa4-4c12-93ab-8cd5f9709590 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:35.655554 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd5a06-8fa4-4c12-93ab-8cd5f9709590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:35.683778 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f3bd5a06-8fa4-4c12-93ab-8cd5f9709590 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:35.685553 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f3bd5a06-8fa4-4c12-93ab-8cd5f9709590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:35.700179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1054/2074] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:35.702528 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503431c-6a9d-4449-82c8-a8336a307888 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:35.702985 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503431c-6a9d-4449-82c8-a8336a307888 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:35.703452 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503431c-6a9d-4449-82c8-a8336a307888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:35.721638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f21dc5-51cd-49a0-bb4b-103c2ef164e3 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:35.728652 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958dd30-7e55-4fa4-82bf-ab5244cf7d51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:35.729179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2503431c-6a9d-4449-82c8-a8336a307888 None None] MFA Rules not processed for user `acd8574f4f58447d96c762198e9ae077`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:35.729608 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958dd30-7e55-4fa4-82bf-ab5244cf7d51 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:35.730012 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958dd30-7e55-4fa4-82bf-ab5244cf7d51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:35.730387 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958dd30-7e55-4fa4-82bf-ab5244cf7d51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:35.730629 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2503431c-6a9d-4449-82c8-a8336a307888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:35.743586 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958dd30-7e55-4fa4-82bf-ab5244cf7d51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:35.745771 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958dd30-7e55-4fa4-82bf-ab5244cf7d51 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:35.773285 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1021/2075] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:35.774316 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958dd30-7e55-4fa4-82bf-ab5244cf7d51 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:35.797479 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958dd30-7e55-4fa4-82bf-ab5244cf7d51 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:35.810634 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ba2a7-3d3c-41f7-8752-f288c862dd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:35.811378 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ba2a7-3d3c-41f7-8752-f288c862dd42 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:35.811518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ba2a7-3d3c-41f7-8752-f288c862dd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:35.811792 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ba2a7-3d3c-41f7-8752-f288c862dd42 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:35.812445 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ba2a7-3d3c-41f7-8752-f288c862dd42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:27:35.813024 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ba2a7-3d3c-41f7-8752-f288c862dd42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:35.816811 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ba2a7-3d3c-41f7-8752-f288c862dd42 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:35.818628 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:35.842352 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1055/2076] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:35.842858 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1022/2077] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:27:35.843400 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503431c-6a9d-4449-82c8-a8336a307888 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:35.850038 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ba2a7-3d3c-41f7-8752-f288c862dd42 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:35.852853 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dc9ba2a7-3d3c-41f7-8752-f288c862dd42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:35.861684 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503431c-6a9d-4449-82c8-a8336a307888 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:35.871846 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e2c57-b3e9-400c-a483-c8349ca053cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:35.872492 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e2c57-b3e9-400c-a483-c8349ca053cf admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:35.872777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e2c57-b3e9-400c-a483-c8349ca053cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:35.873052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e2c57-b3e9-400c-a483-c8349ca053cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:35.873751 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e2c57-b3e9-400c-a483-c8349ca053cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:35.875696 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e2c57-b3e9-400c-a483-c8349ca053cf admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:35.918356 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1056/2078] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:35 2022] POST /identity/v3/projects => generated 375 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:35.919978 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e2c57-b3e9-400c-a483-c8349ca053cf admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:35.955519 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ba2a7-3d3c-41f7-8752-f288c862dd42 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:36.029093 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e2c57-b3e9-400c-a483-c8349ca053cf admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:36.034978 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23e401-f00c-46ce-bf56-8f44e6ecf585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:36.035719 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23e401-f00c-46ce-bf56-8f44e6ecf585 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:36.036000 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23e401-f00c-46ce-bf56-8f44e6ecf585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:36.036835 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23e401-f00c-46ce-bf56-8f44e6ecf585 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:36.037511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23e401-f00c-46ce-bf56-8f44e6ecf585 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:36.039517 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23e401-f00c-46ce-bf56-8f44e6ecf585 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:36.048364 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:36.068649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1057/2079] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:35 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:27:36.072914 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23e401-f00c-46ce-bf56-8f44e6ecf585 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:36.077514 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57744e6f-5038-420a-a3fe-a1facbf75307 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:36.078194 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57744e6f-5038-420a-a3fe-a1facbf75307 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:36.078582 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57744e6f-5038-420a-a3fe-a1facbf75307 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:36.078838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57744e6f-5038-420a-a3fe-a1facbf75307 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:36.081211 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-57744e6f-5038-420a-a3fe-a1facbf75307 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:36.094891 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23e401-f00c-46ce-bf56-8f44e6ecf585 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:36.104997 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2308a8-de22-4926-b4eb-12b6eedad585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:36.105712 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2308a8-de22-4926-b4eb-12b6eedad585 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:36.105951 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2308a8-de22-4926-b4eb-12b6eedad585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:36.106222 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2308a8-de22-4926-b4eb-12b6eedad585 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:36.107376 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2308a8-de22-4926-b4eb-12b6eedad585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:36.108500 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2308a8-de22-4926-b4eb-12b6eedad585 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:36.125771 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1058/2080] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:27:36.129462 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2308a8-de22-4926-b4eb-12b6eedad585 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:36.142784 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2308a8-de22-4926-b4eb-12b6eedad585 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:36.150246 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c9c9d-9715-4454-bb32-2ffc83fa7b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:36.151446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c9c9d-9715-4454-bb32-2ffc83fa7b58 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:36.151446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c9c9d-9715-4454-bb32-2ffc83fa7b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:36.151446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c9c9d-9715-4454-bb32-2ffc83fa7b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:36.152076 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c9c9d-9715-4454-bb32-2ffc83fa7b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:36.153805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c9c9d-9715-4454-bb32-2ffc83fa7b58 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:36.168524 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1059/2081] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:27:36.173301 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c9c9d-9715-4454-bb32-2ffc83fa7b58 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:36.199162 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c9c9d-9715-4454-bb32-2ffc83fa7b58 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:36.203454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57744e6f-5038-420a-a3fe-a1facbf75307 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:36.205270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57744e6f-5038-420a-a3fe-a1facbf75307 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:36.206108 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0f42e-9503-4db1-ab81-b6221359e5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:36.206795 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0f42e-9503-4db1-ab81-b6221359e5b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:36.207145 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0f42e-9503-4db1-ab81-b6221359e5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:36.207488 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0f42e-9503-4db1-ab81-b6221359e5b8 admin admin] PATH_INFO: `/v3/projects/d19963d019e941d0a655b33e19750f76/users/dd768981635a49a0976607104ab46782/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:36.229980 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1023/2082] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:36.242321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0f42e-9503-4db1-ab81-b6221359e5b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d19963d019e941d0a655b33e19750f76, user_id=dd768981635a49a0976607104ab46782, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:36.249666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0f42e-9503-4db1-ab81-b6221359e5b8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:36.278531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1060/2083] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:36 2022] PUT /identity/v3/projects/d19963d019e941d0a655b33e19750f76/users/dd768981635a49a0976607104ab46782/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:27:36.291014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f904db7-628a-46d0-b554-7df21f6010fe None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:36.291325 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f904db7-628a-46d0-b554-7df21f6010fe None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:36.291580 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f904db7-628a-46d0-b554-7df21f6010fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:36.345635 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8f904db7-628a-46d0-b554-7df21f6010fe None None] MFA Rules not processed for user `dd768981635a49a0976607104ab46782`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:36.347071 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8f904db7-628a-46d0-b554-7df21f6010fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:36.364050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:36.414319 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1024/2084] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:36.426055 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0f42e-9503-4db1-ab81-b6221359e5b8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:36.484094 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0f42e-9503-4db1-ab81-b6221359e5b8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:36.487786 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd689263-5f08-4ca6-995b-0bbe2425d44d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:36.488392 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd689263-5f08-4ca6-995b-0bbe2425d44d service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:36.488677 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd689263-5f08-4ca6-995b-0bbe2425d44d service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:36.488950 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd689263-5f08-4ca6-995b-0bbe2425d44d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:36.498179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd689263-5f08-4ca6-995b-0bbe2425d44d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:36.499699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd689263-5f08-4ca6-995b-0bbe2425d44d service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:36.509045 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1061/2085] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:37.062613 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f904db7-628a-46d0-b554-7df21f6010fe None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:37.064548 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8f904db7-628a-46d0-b554-7df21f6010fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:37.078206 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f904db7-628a-46d0-b554-7df21f6010fe None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:37.083660 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bd163-bf2c-48e2-864e-03de4824f14f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:37.083807 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bd163-bf2c-48e2-864e-03de4824f14f service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:37.084345 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bd163-bf2c-48e2-864e-03de4824f14f service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:37.084622 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bd163-bf2c-48e2-864e-03de4824f14f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:37.086406 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-899bd163-bf2c-48e2-864e-03de4824f14f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:37.157057 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899bd163-bf2c-48e2-864e-03de4824f14f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:37.158557 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899bd163-bf2c-48e2-864e-03de4824f14f service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:37.168995 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1025/2086] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:37.339416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997fac1-0937-4f96-bdd6-a3d3c11cd559 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:37.340405 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997fac1-0937-4f96-bdd6-a3d3c11cd559 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:37.340899 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997fac1-0937-4f96-bdd6-a3d3c11cd559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:37.366340 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2997fac1-0937-4f96-bdd6-a3d3c11cd559 None None] MFA Rules not processed for user `f87c6d0e007d44c1a935c73404a9b619`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:37.368429 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2997fac1-0937-4f96-bdd6-a3d3c11cd559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:37.452317 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1062/2087] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:27:37.829271 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bd163-bf2c-48e2-864e-03de4824f14f service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:37.846319 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bd163-bf2c-48e2-864e-03de4824f14f service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:37.850899 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f980d-6ab2-49eb-8dc8-d2121598df52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:37.851524 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f980d-6ab2-49eb-8dc8-d2121598df52 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:37.851801 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f980d-6ab2-49eb-8dc8-d2121598df52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:37.852076 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f980d-6ab2-49eb-8dc8-d2121598df52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:37.856618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-120f980d-6ab2-49eb-8dc8-d2121598df52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:37.946456 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f980d-6ab2-49eb-8dc8-d2121598df52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:37.948214 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f980d-6ab2-49eb-8dc8-d2121598df52 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:37.962686 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1026/2088] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:37 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:27:42.389601 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997fac1-0937-4f96-bdd6-a3d3c11cd559 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:42.391053 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2997fac1-0937-4f96-bdd6-a3d3c11cd559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:42.447134 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:42.463632 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997fac1-0937-4f96-bdd6-a3d3c11cd559 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:42.468555 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea8614-1463-402d-af4b-e61e7a1731f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:42.469238 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea8614-1463-402d-af4b-e61e7a1731f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:42.469570 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea8614-1463-402d-af4b-e61e7a1731f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:42.469856 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea8614-1463-402d-af4b-e61e7a1731f3 admin admin] PATH_INFO: `/v3/users/7dc48f921b4647a592abd1be569471e0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:42.470991 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea8614-1463-402d-af4b-e61e7a1731f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dc48f921b4647a592abd1be569471e0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:42.472963 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea8614-1463-402d-af4b-e61e7a1731f3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:42.550105 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6dea8614-1463-402d-af4b-e61e7a1731f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dc48f921b4647a592abd1be569471e0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:42.550884 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6dea8614-1463-402d-af4b-e61e7a1731f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dc48f921b4647a592abd1be569471e0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:42.575656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6dea8614-1463-402d-af4b-e61e7a1731f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dc48f921b4647a592abd1be569471e0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:42.585930 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6dea8614-1463-402d-af4b-e61e7a1731f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dc48f921b4647a592abd1be569471e0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:42.594545 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6dea8614-1463-402d-af4b-e61e7a1731f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dc48f921b4647a592abd1be569471e0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:42.604725 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1063/2089] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:42 2022] DELETE /identity/v3/users/7dc48f921b4647a592abd1be569471e0 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:42.609193 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432c17d-b9af-4474-b71f-a50cd5c19b87 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:42.609707 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432c17d-b9af-4474-b71f-a50cd5c19b87 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:42.609783 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432c17d-b9af-4474-b71f-a50cd5c19b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:42.643076 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9432c17d-b9af-4474-b71f-a50cd5c19b87 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:42.644789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9432c17d-b9af-4474-b71f-a50cd5c19b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:42.725892 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:42.747723 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1027/2090] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:42.758645 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea8614-1463-402d-af4b-e61e7a1731f3 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:42.760156 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6dea8614-1463-402d-af4b-e61e7a1731f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:42.819949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea8614-1463-402d-af4b-e61e7a1731f3 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:42.823533 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703f14f-20dd-4bdf-b29a-d6c49f3a8308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:42.824114 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703f14f-20dd-4bdf-b29a-d6c49f3a8308 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:42.824388 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703f14f-20dd-4bdf-b29a-d6c49f3a8308 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:42.824655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703f14f-20dd-4bdf-b29a-d6c49f3a8308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:42.834187 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703f14f-20dd-4bdf-b29a-d6c49f3a8308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:42.835617 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703f14f-20dd-4bdf-b29a-d6c49f3a8308 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:42.845019 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1064/2091] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:27:43.127247 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9432c17d-b9af-4474-b71f-a50cd5c19b87 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:43.128771 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9432c17d-b9af-4474-b71f-a50cd5c19b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:43.141001 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9432c17d-b9af-4474-b71f-a50cd5c19b87 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:43.146875 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60957c1e-f359-4d98-b471-2f98bb15d84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:43.147617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60957c1e-f359-4d98-b471-2f98bb15d84a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:43.147992 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60957c1e-f359-4d98-b471-2f98bb15d84a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:43.148363 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60957c1e-f359-4d98-b471-2f98bb15d84a admin admin] PATH_INFO: `/v3/projects/3f33be456fb8409682386100988d0110` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:43.149890 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60957c1e-f359-4d98-b471-2f98bb15d84a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f33be456fb8409682386100988d0110)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:43.152220 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60957c1e-f359-4d98-b471-2f98bb15d84a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:43.235738 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-60957c1e-f359-4d98-b471-2f98bb15d84a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f33be456fb8409682386100988d0110', 'request_id': 'req-60957c1e-f359-4d98-b471-2f98bb15d84a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:43.252397 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-60957c1e-f359-4d98-b471-2f98bb15d84a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f33be456fb8409682386100988d0110', 'request_id': 'req-60957c1e-f359-4d98-b471-2f98bb15d84a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:43.262424 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-60957c1e-f359-4d98-b471-2f98bb15d84a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f33be456fb8409682386100988d0110', 'request_id': 'req-60957c1e-f359-4d98-b471-2f98bb15d84a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:43.282911 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-60957c1e-f359-4d98-b471-2f98bb15d84a admin admin] The token cache is being invalidate because project 3f33be456fb8409682386100988d0110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:43.283126 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-60957c1e-f359-4d98-b471-2f98bb15d84a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:43.283877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-60957c1e-f359-4d98-b471-2f98bb15d84a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:43.289801 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1028/2092] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:43 2022] DELETE /identity/v3/projects/3f33be456fb8409682386100988d0110 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:43.293362 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703f14f-20dd-4bdf-b29a-d6c49f3a8308 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:43.304990 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703f14f-20dd-4bdf-b29a-d6c49f3a8308 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:43.369593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc5e87-6b9e-41ea-be8d-8c2e5317c843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:43.370240 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc5e87-6b9e-41ea-be8d-8c2e5317c843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:43.370517 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc5e87-6b9e-41ea-be8d-8c2e5317c843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:43.370771 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc5e87-6b9e-41ea-be8d-8c2e5317c843 admin admin] PATH_INFO: `/v3/users/64836e87249740f792792ed4a0739ef4` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:43.373361 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc5e87-6b9e-41ea-be8d-8c2e5317c843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64836e87249740f792792ed4a0739ef4)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:43.375318 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc5e87-6b9e-41ea-be8d-8c2e5317c843 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:43.392978 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:43.464465 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e7bc5e87-6b9e-41ea-be8d-8c2e5317c843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64836e87249740f792792ed4a0739ef4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:43.465267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e7bc5e87-6b9e-41ea-be8d-8c2e5317c843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64836e87249740f792792ed4a0739ef4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:43.497923 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e7bc5e87-6b9e-41ea-be8d-8c2e5317c843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64836e87249740f792792ed4a0739ef4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:43.513243 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e7bc5e87-6b9e-41ea-be8d-8c2e5317c843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64836e87249740f792792ed4a0739ef4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:43.523056 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e7bc5e87-6b9e-41ea-be8d-8c2e5317c843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64836e87249740f792792ed4a0739ef4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:43.532323 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1065/2093] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:43 2022] DELETE /identity/v3/users/64836e87249740f792792ed4a0739ef4 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:44.178256 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60957c1e-f359-4d98-b471-2f98bb15d84a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:44.180015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-60957c1e-f359-4d98-b471-2f98bb15d84a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:44.194538 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60957c1e-f359-4d98-b471-2f98bb15d84a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:44.292888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a16aae-77c1-4a94-83fe-9d0427537028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:44.293599 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a16aae-77c1-4a94-83fe-9d0427537028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:44.293994 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a16aae-77c1-4a94-83fe-9d0427537028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:44.294426 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a16aae-77c1-4a94-83fe-9d0427537028 admin admin] PATH_INFO: `/v3/projects/5bbc9a8fd39d476298d65026078eebe5` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:44.295991 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a16aae-77c1-4a94-83fe-9d0427537028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bbc9a8fd39d476298d65026078eebe5)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:44.298673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a16aae-77c1-4a94-83fe-9d0427537028 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:44.391285 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-40a16aae-77c1-4a94-83fe-9d0427537028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bbc9a8fd39d476298d65026078eebe5', 'request_id': 'req-40a16aae-77c1-4a94-83fe-9d0427537028'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:44.398422 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-40a16aae-77c1-4a94-83fe-9d0427537028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bbc9a8fd39d476298d65026078eebe5', 'request_id': 'req-40a16aae-77c1-4a94-83fe-9d0427537028'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:44.413092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-40a16aae-77c1-4a94-83fe-9d0427537028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bbc9a8fd39d476298d65026078eebe5', 'request_id': 'req-40a16aae-77c1-4a94-83fe-9d0427537028'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:44.436129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-40a16aae-77c1-4a94-83fe-9d0427537028 admin admin] The token cache is being invalidate because project 5bbc9a8fd39d476298d65026078eebe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:44.436801 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-40a16aae-77c1-4a94-83fe-9d0427537028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:44.437978 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-40a16aae-77c1-4a94-83fe-9d0427537028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:44.440278 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1029/2094] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:44 2022] DELETE /identity/v3/projects/5bbc9a8fd39d476298d65026078eebe5 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:44.444237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc5e87-6b9e-41ea-be8d-8c2e5317c843 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:44.446553 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e7bc5e87-6b9e-41ea-be8d-8c2e5317c843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:44.463500 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc5e87-6b9e-41ea-be8d-8c2e5317c843 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:44.537080 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece4004-f8db-4b53-837b-4295b98cddbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:44.537802 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece4004-f8db-4b53-837b-4295b98cddbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:44.538145 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece4004-f8db-4b53-837b-4295b98cddbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:44.538669 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece4004-f8db-4b53-837b-4295b98cddbb admin admin] PATH_INFO: `/v3/users/fc38d8ad737f4c238db869d045ad346a` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:44.540270 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece4004-f8db-4b53-837b-4295b98cddbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc38d8ad737f4c238db869d045ad346a)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:44.542490 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece4004-f8db-4b53-837b-4295b98cddbb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:44.611935 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-aece4004-f8db-4b53-837b-4295b98cddbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc38d8ad737f4c238db869d045ad346a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:44.612585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-aece4004-f8db-4b53-837b-4295b98cddbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc38d8ad737f4c238db869d045ad346a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:44.630605 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-aece4004-f8db-4b53-837b-4295b98cddbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc38d8ad737f4c238db869d045ad346a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:44.642511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-aece4004-f8db-4b53-837b-4295b98cddbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc38d8ad737f4c238db869d045ad346a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:44.656542 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-aece4004-f8db-4b53-837b-4295b98cddbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc38d8ad737f4c238db869d045ad346a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:44.668294 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1066/2095] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:44 2022] DELETE /identity/v3/users/fc38d8ad737f4c238db869d045ad346a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:27:45.226120 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a16aae-77c1-4a94-83fe-9d0427537028 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:45.238121 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-40a16aae-77c1-4a94-83fe-9d0427537028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:45.270996 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:45.276380 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a16aae-77c1-4a94-83fe-9d0427537028 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:45.360595 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae9524-2b23-452e-bd6c-72032a30b999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:45.361261 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae9524-2b23-452e-bd6c-72032a30b999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:45.361597 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae9524-2b23-452e-bd6c-72032a30b999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:45.361864 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae9524-2b23-452e-bd6c-72032a30b999 admin admin] PATH_INFO: `/v3/projects/6ef7023fca4842fca284651d7faa2d8b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:45.364204 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae9524-2b23-452e-bd6c-72032a30b999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ef7023fca4842fca284651d7faa2d8b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:45.366437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae9524-2b23-452e-bd6c-72032a30b999 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:45.420817 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-87ae9524-2b23-452e-bd6c-72032a30b999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ef7023fca4842fca284651d7faa2d8b', 'request_id': 'req-87ae9524-2b23-452e-bd6c-72032a30b999'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:45.428310 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-87ae9524-2b23-452e-bd6c-72032a30b999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ef7023fca4842fca284651d7faa2d8b', 'request_id': 'req-87ae9524-2b23-452e-bd6c-72032a30b999'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:45.436023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-87ae9524-2b23-452e-bd6c-72032a30b999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ef7023fca4842fca284651d7faa2d8b', 'request_id': 'req-87ae9524-2b23-452e-bd6c-72032a30b999'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:45.450604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-87ae9524-2b23-452e-bd6c-72032a30b999 admin admin] The token cache is being invalidate because project 6ef7023fca4842fca284651d7faa2d8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:45.450896 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-87ae9524-2b23-452e-bd6c-72032a30b999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:45.451550 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-87ae9524-2b23-452e-bd6c-72032a30b999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:45.453355 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1030/2096] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:45 2022] DELETE /identity/v3/projects/6ef7023fca4842fca284651d7faa2d8b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:45.458171 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b975e4-129a-4e81-ac91-15c1419eff37 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:45.458701 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b975e4-129a-4e81-ac91-15c1419eff37 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:45.459140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b975e4-129a-4e81-ac91-15c1419eff37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:45.480950 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a8b975e4-129a-4e81-ac91-15c1419eff37 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:45.482982 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a8b975e4-129a-4e81-ac91-15c1419eff37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:45.491627 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:45.567570 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1067/2097] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:45.575714 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766cb25-1dc5-44d1-98d9-ecc201525448 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:45.576151 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766cb25-1dc5-44d1-98d9-ecc201525448 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:45.576480 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766cb25-1dc5-44d1-98d9-ecc201525448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:45.597381 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b766cb25-1dc5-44d1-98d9-ecc201525448 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:45.599419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b766cb25-1dc5-44d1-98d9-ecc201525448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:45.608107 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1031/2098] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:45.612217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b975e4-129a-4e81-ac91-15c1419eff37 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:45.622073 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b975e4-129a-4e81-ac91-15c1419eff37 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:45.627601 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9ea67-b792-4c7c-bccf-d4f9a3ec0be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:45.628244 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9ea67-b792-4c7c-bccf-d4f9a3ec0be2 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:45.628501 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9ea67-b792-4c7c-bccf-d4f9a3ec0be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:45.628776 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9ea67-b792-4c7c-bccf-d4f9a3ec0be2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:45.629993 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9ea67-b792-4c7c-bccf-d4f9a3ec0be2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:27:45.630435 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9ea67-b792-4c7c-bccf-d4f9a3ec0be2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:45.632047 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9ea67-b792-4c7c-bccf-d4f9a3ec0be2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:45.663237 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766cb25-1dc5-44d1-98d9-ecc201525448 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:45.667455 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1068/2099] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:27:45.673625 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766cb25-1dc5-44d1-98d9-ecc201525448 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:45.681916 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c8b8c-4347-4778-8ade-e5a21ca880ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:45.682543 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c8b8c-4347-4778-8ade-e5a21ca880ec admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:45.682821 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c8b8c-4347-4778-8ade-e5a21ca880ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:45.683269 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c8b8c-4347-4778-8ade-e5a21ca880ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:45.684683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c8b8c-4347-4778-8ade-e5a21ca880ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:45.694814 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c8b8c-4347-4778-8ade-e5a21ca880ec admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:45.739921 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1032/2100] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:45 2022] POST /identity/v3/projects => generated 369 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:27:45.741185 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9ea67-b792-4c7c-bccf-d4f9a3ec0be2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:45.751618 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9ea67-b792-4c7c-bccf-d4f9a3ec0be2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:45.814624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9e7b8-46ad-42e8-8d99-fefd1352f6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:45.815545 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9e7b8-46ad-42e8-8d99-fefd1352f6b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:45.816107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9e7b8-46ad-42e8-8d99-fefd1352f6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:45.816545 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9e7b8-46ad-42e8-8d99-fefd1352f6b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:45.817977 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9e7b8-46ad-42e8-8d99-fefd1352f6b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:45.820068 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9e7b8-46ad-42e8-8d99-fefd1352f6b8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:45.878158 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1069/2101] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:45 2022] POST /identity/v3/users => generated 285 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:45.882959 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c8b8c-4347-4778-8ade-e5a21ca880ec admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:45.893105 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c8b8c-4347-4778-8ade-e5a21ca880ec admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:45.897796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b1687-1a7d-4cec-a1a6-a382fb3932b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:45.898396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b1687-1a7d-4cec-a1a6-a382fb3932b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:45.898672 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b1687-1a7d-4cec-a1a6-a382fb3932b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:45.899002 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b1687-1a7d-4cec-a1a6-a382fb3932b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:45.899582 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b1687-1a7d-4cec-a1a6-a382fb3932b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:45.901208 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b1687-1a7d-4cec-a1a6-a382fb3932b1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:45.911333 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1033/2102] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:45.915734 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9e7b8-46ad-42e8-8d99-fefd1352f6b8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:45.927068 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9e7b8-46ad-42e8-8d99-fefd1352f6b8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:45.931827 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7cd14-a837-42ba-9e16-c105ed2f876e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:45.932437 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7cd14-a837-42ba-9e16-c105ed2f876e admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:45.932716 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7cd14-a837-42ba-9e16-c105ed2f876e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:45.933065 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7cd14-a837-42ba-9e16-c105ed2f876e admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:45.933679 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7cd14-a837-42ba-9e16-c105ed2f876e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:45.935291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7cd14-a837-42ba-9e16-c105ed2f876e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:45.948612 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1070/2103] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:45.952547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b1687-1a7d-4cec-a1a6-a382fb3932b1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:45.962489 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b1687-1a7d-4cec-a1a6-a382fb3932b1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:45.968618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aeebe5-8ef5-49c7-894a-e732538469c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:45.969505 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aeebe5-8ef5-49c7-894a-e732538469c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:45.970089 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aeebe5-8ef5-49c7-894a-e732538469c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:45.970560 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aeebe5-8ef5-49c7-894a-e732538469c9 admin admin] PATH_INFO: `/v3/projects/6dba1b7b50dd49159379caf60dbcdd19/users/c7f88239641542139eed7c0c10cad19b/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:45.993857 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aeebe5-8ef5-49c7-894a-e732538469c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dba1b7b50dd49159379caf60dbcdd19, user_id=c7f88239641542139eed7c0c10cad19b, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:45.993857 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aeebe5-8ef5-49c7-894a-e732538469c9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:46.025233 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1034/2104] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:45 2022] PUT /identity/v3/projects/6dba1b7b50dd49159379caf60dbcdd19/users/c7f88239641542139eed7c0c10cad19b/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:27:46.036365 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf57c3d-5b1e-49e8-a9c5-d3081bc5f853 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:46.036639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf57c3d-5b1e-49e8-a9c5-d3081bc5f853 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:46.036902 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf57c3d-5b1e-49e8-a9c5-d3081bc5f853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:46.105586 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1cf57c3d-5b1e-49e8-a9c5-d3081bc5f853 None None] MFA Rules not processed for user `c7f88239641542139eed7c0c10cad19b`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:46.106816 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1cf57c3d-5b1e-49e8-a9c5-d3081bc5f853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:46.180037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1071/2105] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:46.196291 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aeebe5-8ef5-49c7-894a-e732538469c9 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:46.198906 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-14aeebe5-8ef5-49c7-894a-e732538469c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:46.258279 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:46.324343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aeebe5-8ef5-49c7-894a-e732538469c9 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:46.331719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec5630-c581-4458-b84e-29dab7ffb3d4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6647f3aa54dc68e888b3adb8c28b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:46.332692 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec5630-c581-4458-b84e-29dab7ffb3d4 service glance] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:46.333194 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec5630-c581-4458-b84e-29dab7ffb3d4 service glance] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:46.333647 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec5630-c581-4458-b84e-29dab7ffb3d4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:46.347168 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec5630-c581-4458-b84e-29dab7ffb3d4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:46.349144 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec5630-c581-4458-b84e-29dab7ffb3d4 service glance] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:46.366750 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1035/2106] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:47.139029 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74033a02-b348-41d8-8917-5004e5bb1527 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:47.139550 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74033a02-b348-41d8-8917-5004e5bb1527 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:47.139740 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74033a02-b348-41d8-8917-5004e5bb1527 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:47.141371 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1072/2107] 10.222.0.94 () {54 vars in 921 bytes} [Thu Sep 1 17:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:27:47.167943 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f132da-12d1-4640-bd93-c825cbdb79a7 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:47.168230 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f132da-12d1-4640-bd93-c825cbdb79a7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:47.168539 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f132da-12d1-4640-bd93-c825cbdb79a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:47.189162 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-34f132da-12d1-4640-bd93-c825cbdb79a7 None None] MFA Rules not processed for user `e3622621761f4f18ae3e9dfb5ba99bef`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:47.190404 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-34f132da-12d1-4640-bd93-c825cbdb79a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:47.277805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74033a02-b348-41d8-8917-5004e5bb1527 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:47.279927 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-74033a02-b348-41d8-8917-5004e5bb1527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:47.292834 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1036/2108] 10.222.0.94 () {58 vars in 1018 bytes} [Thu Sep 1 17:27:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:47.304262 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:47.313847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae48b53-41ba-4c99-813d-e731c2241114 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:47.314339 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae48b53-41ba-4c99-813d-e731c2241114 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:47.314611 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae48b53-41ba-4c99-813d-e731c2241114 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:47.317047 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1037/2109] 10.222.0.94 () {54 vars in 961 bytes} [Thu Sep 1 17:27:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:27:47.324545 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07d26c-1d29-47bc-b466-34b055c7a908 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:47.324832 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07d26c-1d29-47bc-b466-34b055c7a908 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:47.325274 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07d26c-1d29-47bc-b466-34b055c7a908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:47.389869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8e07d26c-1d29-47bc-b466-34b055c7a908 None None] MFA Rules not processed for user `e3622621761f4f18ae3e9dfb5ba99bef`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:47.391077 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8e07d26c-1d29-47bc-b466-34b055c7a908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:47.406958 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1038/2110] 10.222.0.94 () {58 vars in 1058 bytes} [Thu Sep 1 17:27:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:47.414789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07d26c-1d29-47bc-b466-34b055c7a908 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:47.416920 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74033a02-b348-41d8-8917-5004e5bb1527 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:47.422395 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62eed3-bba8-4b92-8c45-5a7b1338ca9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:47.423578 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62eed3-bba8-4b92-8c45-5a7b1338ca9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:47.424082 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62eed3-bba8-4b92-8c45-5a7b1338ca9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:47.424637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62eed3-bba8-4b92-8c45-5a7b1338ca9a admin admin] PATH_INFO: `/v3/users/933d1ebb00cd407ba39ed91d887a5254` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:47.427464 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62eed3-bba8-4b92-8c45-5a7b1338ca9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=933d1ebb00cd407ba39ed91d887a5254)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:47.429435 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07d26c-1d29-47bc-b466-34b055c7a908 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:47.430413 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62eed3-bba8-4b92-8c45-5a7b1338ca9a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:47.440767 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb05db2-adf0-472e-b7b8-ebd973f68928 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3622621761f4f18ae3e9dfb5ba99bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:47.441988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb05db2-adf0-472e-b7b8-ebd973f68928 service placement] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:47.442467 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb05db2-adf0-472e-b7b8-ebd973f68928 service placement] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:47.442927 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb05db2-adf0-472e-b7b8-ebd973f68928 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:47.452313 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb05db2-adf0-472e-b7b8-ebd973f68928 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:47.454191 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb05db2-adf0-472e-b7b8-ebd973f68928 service placement] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:47.475168 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1039/2111] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:27:47.486027 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2f62eed3-bba8-4b92-8c45-5a7b1338ca9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '933d1ebb00cd407ba39ed91d887a5254'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:47.486708 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2f62eed3-bba8-4b92-8c45-5a7b1338ca9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '933d1ebb00cd407ba39ed91d887a5254'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:47.520539 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2f62eed3-bba8-4b92-8c45-5a7b1338ca9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '933d1ebb00cd407ba39ed91d887a5254'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:47.531650 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2f62eed3-bba8-4b92-8c45-5a7b1338ca9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '933d1ebb00cd407ba39ed91d887a5254'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:47.545732 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2f62eed3-bba8-4b92-8c45-5a7b1338ca9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '933d1ebb00cd407ba39ed91d887a5254'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:47.553645 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1073/2112] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:47 2022] DELETE /identity/v3/users/933d1ebb00cd407ba39ed91d887a5254 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:47.742496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb05db2-adf0-472e-b7b8-ebd973f68928 service placement] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:47.757186 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb05db2-adf0-472e-b7b8-ebd973f68928 service placement] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:47.822352 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9629b40-bd91-48ba-acf3-cdd24e682e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:47.823017 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9629b40-bd91-48ba-acf3-cdd24e682e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:47.823301 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9629b40-bd91-48ba-acf3-cdd24e682e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:47.823570 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9629b40-bd91-48ba-acf3-cdd24e682e31 admin admin] PATH_INFO: `/v3/projects/b24a45fe16a64191a07dc27b67e336a8` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:47.824687 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9629b40-bd91-48ba-acf3-cdd24e682e31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b24a45fe16a64191a07dc27b67e336a8)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:47.826752 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9629b40-bd91-48ba-acf3-cdd24e682e31 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:47.863549 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:47.877678 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f9629b40-bd91-48ba-acf3-cdd24e682e31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b24a45fe16a64191a07dc27b67e336a8', 'request_id': 'req-f9629b40-bd91-48ba-acf3-cdd24e682e31'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:47.884389 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f9629b40-bd91-48ba-acf3-cdd24e682e31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b24a45fe16a64191a07dc27b67e336a8', 'request_id': 'req-f9629b40-bd91-48ba-acf3-cdd24e682e31'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:47.891157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f9629b40-bd91-48ba-acf3-cdd24e682e31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b24a45fe16a64191a07dc27b67e336a8', 'request_id': 'req-f9629b40-bd91-48ba-acf3-cdd24e682e31'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:47.904484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f9629b40-bd91-48ba-acf3-cdd24e682e31 admin admin] The token cache is being invalidate because project b24a45fe16a64191a07dc27b67e336a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:47.904795 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f9629b40-bd91-48ba-acf3-cdd24e682e31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:47.905537 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f9629b40-bd91-48ba-acf3-cdd24e682e31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:47.907439 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1040/2113] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:47 2022] DELETE /identity/v3/projects/b24a45fe16a64191a07dc27b67e336a8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:47.912788 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f489a3-b4d2-45e9-9b9b-3ead56d75e7a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:47.913079 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f489a3-b4d2-45e9-9b9b-3ead56d75e7a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:47.913382 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f489a3-b4d2-45e9-9b9b-3ead56d75e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:47.933276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-70f489a3-b4d2-45e9-9b9b-3ead56d75e7a None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:47.934501 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-70f489a3-b4d2-45e9-9b9b-3ead56d75e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:47.995356 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1074/2114] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:48.003143 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64197b14-a97c-4065-98a2-7b4585eb76e3 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:48.003429 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64197b14-a97c-4065-98a2-7b4585eb76e3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:48.003700 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64197b14-a97c-4065-98a2-7b4585eb76e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:48.023672 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-64197b14-a97c-4065-98a2-7b4585eb76e3 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:48.024860 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-64197b14-a97c-4065-98a2-7b4585eb76e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:48.032755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1041/2115] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:48.037959 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f489a3-b4d2-45e9-9b9b-3ead56d75e7a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:48.056069 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f489a3-b4d2-45e9-9b9b-3ead56d75e7a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:48.060981 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770162b3-ec48-44f6-b817-2dc3f34a3bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:48.061644 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770162b3-ec48-44f6-b817-2dc3f34a3bbd admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:48.061924 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770162b3-ec48-44f6-b817-2dc3f34a3bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:48.062198 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770162b3-ec48-44f6-b817-2dc3f34a3bbd admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:48.062849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770162b3-ec48-44f6-b817-2dc3f34a3bbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:27:48.063152 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770162b3-ec48-44f6-b817-2dc3f34a3bbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:48.065059 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770162b3-ec48-44f6-b817-2dc3f34a3bbd admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:48.077239 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1075/2116] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:27:48.081949 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64197b14-a97c-4065-98a2-7b4585eb76e3 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:48.091864 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64197b14-a97c-4065-98a2-7b4585eb76e3 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:48.096584 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34409d3f-8f38-4d0f-be24-6aab7d52493a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:48.097175 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34409d3f-8f38-4d0f-be24-6aab7d52493a admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:48.097482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34409d3f-8f38-4d0f-be24-6aab7d52493a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:48.097753 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34409d3f-8f38-4d0f-be24-6aab7d52493a admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:48.099008 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34409d3f-8f38-4d0f-be24-6aab7d52493a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:48.100945 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34409d3f-8f38-4d0f-be24-6aab7d52493a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:48.132529 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1042/2117] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:48 2022] POST /identity/v3/projects => generated 403 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:48.133628 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770162b3-ec48-44f6-b817-2dc3f34a3bbd admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:48.144334 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770162b3-ec48-44f6-b817-2dc3f34a3bbd admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:48.154878 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:48.202924 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ecfaf-4b53-4554-adef-a5c77faa29ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:48.203523 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ecfaf-4b53-4554-adef-a5c77faa29ff admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:48.203797 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ecfaf-4b53-4554-adef-a5c77faa29ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:48.204065 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ecfaf-4b53-4554-adef-a5c77faa29ff admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:48.204690 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ecfaf-4b53-4554-adef-a5c77faa29ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:48.206628 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ecfaf-4b53-4554-adef-a5c77faa29ff admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:48.229726 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1076/2118] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:48 2022] POST /identity/v3/users => generated 302 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:48.233991 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34409d3f-8f38-4d0f-be24-6aab7d52493a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:48.245116 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34409d3f-8f38-4d0f-be24-6aab7d52493a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:48.249771 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93013d3e-023e-4cfe-a046-825a0ee79b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:48.250364 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93013d3e-023e-4cfe-a046-825a0ee79b94 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:48.250644 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93013d3e-023e-4cfe-a046-825a0ee79b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:48.250914 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93013d3e-023e-4cfe-a046-825a0ee79b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:48.251559 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93013d3e-023e-4cfe-a046-825a0ee79b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:48.253159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93013d3e-023e-4cfe-a046-825a0ee79b94 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:48.264611 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1043/2119] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:48.268596 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ecfaf-4b53-4554-adef-a5c77faa29ff admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:48.279037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ecfaf-4b53-4554-adef-a5c77faa29ff admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:48.283911 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fc2c5-9633-4278-a410-b7dde8bf598b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:48.284502 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fc2c5-9633-4278-a410-b7dde8bf598b admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:48.284780 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fc2c5-9633-4278-a410-b7dde8bf598b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:48.285051 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fc2c5-9633-4278-a410-b7dde8bf598b admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:48.285749 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fc2c5-9633-4278-a410-b7dde8bf598b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:48.287339 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fc2c5-9633-4278-a410-b7dde8bf598b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:48.301830 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1077/2120] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:48.302944 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93013d3e-023e-4cfe-a046-825a0ee79b94 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:48.313169 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93013d3e-023e-4cfe-a046-825a0ee79b94 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:48.319312 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4807f-655b-40ad-9ec1-d3554aa84e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:48.319971 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4807f-655b-40ad-9ec1-d3554aa84e00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:48.320252 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4807f-655b-40ad-9ec1-d3554aa84e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:48.320525 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4807f-655b-40ad-9ec1-d3554aa84e00 admin admin] PATH_INFO: `/v3/projects/cf00bbc3dfea4cebbf76916fc5364111/users/ae10162375754a3f84a7de71ea431c7d/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:48.335592 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4807f-655b-40ad-9ec1-d3554aa84e00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf00bbc3dfea4cebbf76916fc5364111, user_id=ae10162375754a3f84a7de71ea431c7d, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:48.338319 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4807f-655b-40ad-9ec1-d3554aa84e00 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:48.353555 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1044/2121] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:48 2022] PUT /identity/v3/projects/cf00bbc3dfea4cebbf76916fc5364111/users/ae10162375754a3f84a7de71ea431c7d/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:48.364061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d9acc-12cd-4618-8e7d-da3c771c0d7a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:48.364382 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d9acc-12cd-4618-8e7d-da3c771c0d7a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:48.364672 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d9acc-12cd-4618-8e7d-da3c771c0d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:48.392947 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-342d9acc-12cd-4618-8e7d-da3c771c0d7a None None] MFA Rules not processed for user `ae10162375754a3f84a7de71ea431c7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:48.394115 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-342d9acc-12cd-4618-8e7d-da3c771c0d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:48.471543 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1078/2122] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:48 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:48.476523 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4807f-655b-40ad-9ec1-d3554aa84e00 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:48.548725 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4807f-655b-40ad-9ec1-d3554aa84e00 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:48.555426 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31495ae-eac2-4b51-8077-29d3d6a03f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:48.555936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31495ae-eac2-4b51-8077-29d3d6a03f79 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:48.556240 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31495ae-eac2-4b51-8077-29d3d6a03f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:48.556849 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31495ae-eac2-4b51-8077-29d3d6a03f79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:48.558224 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31495ae-eac2-4b51-8077-29d3d6a03f79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:48.559933 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31495ae-eac2-4b51-8077-29d3d6a03f79 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:48.589439 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1045/2123] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:48 2022] POST /identity/v3/projects => generated 403 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:27:48.593130 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d9acc-12cd-4618-8e7d-da3c771c0d7a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:48.605075 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d9acc-12cd-4618-8e7d-da3c771c0d7a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:48.726795 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312c928-78e2-4e58-b4d2-6c0eb5614348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:48.727449 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312c928-78e2-4e58-b4d2-6c0eb5614348 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:48.728757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312c928-78e2-4e58-b4d2-6c0eb5614348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:48.728757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312c928-78e2-4e58-b4d2-6c0eb5614348 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:48.728757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312c928-78e2-4e58-b4d2-6c0eb5614348 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:48.730931 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312c928-78e2-4e58-b4d2-6c0eb5614348 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:48.758427 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1079/2124] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:48 2022] POST /identity/v3/users => generated 308 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:48.763488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31495ae-eac2-4b51-8077-29d3d6a03f79 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:48.781777 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31495ae-eac2-4b51-8077-29d3d6a03f79 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:48.787582 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716a89c-fdf4-45c9-a2ec-632eed891c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:48.789045 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716a89c-fdf4-45c9-a2ec-632eed891c73 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:48.789418 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716a89c-fdf4-45c9-a2ec-632eed891c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:48.790166 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716a89c-fdf4-45c9-a2ec-632eed891c73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:48.790480 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716a89c-fdf4-45c9-a2ec-632eed891c73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:48.792708 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716a89c-fdf4-45c9-a2ec-632eed891c73 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:48.819949 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1046/2125] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:27:48.820812 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312c928-78e2-4e58-b4d2-6c0eb5614348 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:48.832279 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312c928-78e2-4e58-b4d2-6c0eb5614348 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:48.833056 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716a89c-fdf4-45c9-a2ec-632eed891c73 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:48.834832 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5716a89c-fdf4-45c9-a2ec-632eed891c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:48.837030 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b04c3-b3d8-4eff-bd52-73732c0beaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:48.837718 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b04c3-b3d8-4eff-bd52-73732c0beaa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:48.837999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b04c3-b3d8-4eff-bd52-73732c0beaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:48.838270 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b04c3-b3d8-4eff-bd52-73732c0beaa3 admin admin] PATH_INFO: `/v3/projects/60535a0659b54a49955b319384082918/users/97da025c5ed5424ea49f4e073e22bff2/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:48.847542 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:48.851342 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716a89c-fdf4-45c9-a2ec-632eed891c73 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:48.856824 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b04c3-b3d8-4eff-bd52-73732c0beaa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60535a0659b54a49955b319384082918, user_id=97da025c5ed5424ea49f4e073e22bff2, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:48.858393 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e324657-09f5-440d-bffc-114593f69613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:48.859107 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e324657-09f5-440d-bffc-114593f69613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:48.859455 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e324657-09f5-440d-bffc-114593f69613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:48.860159 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b04c3-b3d8-4eff-bd52-73732c0beaa3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:48.860290 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e324657-09f5-440d-bffc-114593f69613 admin admin] PATH_INFO: `/v3/users/dd768981635a49a0976607104ab46782` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:48.861167 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e324657-09f5-440d-bffc-114593f69613 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd768981635a49a0976607104ab46782)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:48.863195 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e324657-09f5-440d-bffc-114593f69613 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:48.877944 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1080/2126] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:48 2022] PUT /identity/v3/projects/60535a0659b54a49955b319384082918/users/97da025c5ed5424ea49f4e073e22bff2/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:27:48.882290 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b04c3-b3d8-4eff-bd52-73732c0beaa3 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:48.919286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:48.946435 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7e324657-09f5-440d-bffc-114593f69613 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd768981635a49a0976607104ab46782'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:48.947239 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7e324657-09f5-440d-bffc-114593f69613 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd768981635a49a0976607104ab46782'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:48.960890 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7e324657-09f5-440d-bffc-114593f69613 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd768981635a49a0976607104ab46782'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:48.961744 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7e324657-09f5-440d-bffc-114593f69613 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd768981635a49a0976607104ab46782'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:48.980982 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7e324657-09f5-440d-bffc-114593f69613 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd768981635a49a0976607104ab46782'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:49.003896 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1047/2127] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:48 2022] DELETE /identity/v3/users/dd768981635a49a0976607104ab46782 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:49.009549 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f4954-08ff-4c25-bef1-92bb3d55d167 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:49.011379 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f4954-08ff-4c25-bef1-92bb3d55d167 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:49.013179 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f4954-08ff-4c25-bef1-92bb3d55d167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:49.025652 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b04c3-b3d8-4eff-bd52-73732c0beaa3 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:49.038995 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-099f4954-08ff-4c25-bef1-92bb3d55d167 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:49.041343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-099f4954-08ff-4c25-bef1-92bb3d55d167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:49.136400 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68559e1e-9508-4c8d-baa4-efe5c70c14ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:49.137250 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68559e1e-9508-4c8d-baa4-efe5c70c14ba admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:49.137565 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68559e1e-9508-4c8d-baa4-efe5c70c14ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:49.137837 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68559e1e-9508-4c8d-baa4-efe5c70c14ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:49.138488 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68559e1e-9508-4c8d-baa4-efe5c70c14ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:49.140940 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68559e1e-9508-4c8d-baa4-efe5c70c14ba admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:49.152576 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1081/2128] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:49.155770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1048/2129] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:49.170597 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68559e1e-9508-4c8d-baa4-efe5c70c14ba admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:49.172881 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f4954-08ff-4c25-bef1-92bb3d55d167 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:49.174358 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-099f4954-08ff-4c25-bef1-92bb3d55d167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:49.187054 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-68559e1e-9508-4c8d-baa4-efe5c70c14ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:49.205212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68559e1e-9508-4c8d-baa4-efe5c70c14ba admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:49.211224 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e004e-d5d5-4ad6-acf8-8665edd229af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:49.212383 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e004e-d5d5-4ad6-acf8-8665edd229af admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:49.212720 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e004e-d5d5-4ad6-acf8-8665edd229af admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:49.212993 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e004e-d5d5-4ad6-acf8-8665edd229af admin admin] PATH_INFO: `/v3/projects/60535a0659b54a49955b319384082918/users/97da025c5ed5424ea49f4e073e22bff2/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:49.215332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e004e-d5d5-4ad6-acf8-8665edd229af admin admin] RBAC: Authorizing `identity:create_grant(project_id=60535a0659b54a49955b319384082918, user_id=97da025c5ed5424ea49f4e073e22bff2, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:49.218036 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e004e-d5d5-4ad6-acf8-8665edd229af admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:49.229850 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1082/2130] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:49 2022] PUT /identity/v3/projects/60535a0659b54a49955b319384082918/users/97da025c5ed5424ea49f4e073e22bff2/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:49.241625 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4ae46-ed1f-4da3-8a11-c730005c0daa None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:49.242238 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4ae46-ed1f-4da3-8a11-c730005c0daa None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:49.242609 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4ae46-ed1f-4da3-8a11-c730005c0daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:49.258604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f4954-08ff-4c25-bef1-92bb3d55d167 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:49.275191 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a5e4ae46-ed1f-4da3-8a11-c730005c0daa None None] MFA Rules not processed for user `97da025c5ed5424ea49f4e073e22bff2`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:49.276631 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a5e4ae46-ed1f-4da3-8a11-c730005c0daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:49.319501 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c4387-8ebf-4819-abbb-e75b01ac962d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:49.320135 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c4387-8ebf-4819-abbb-e75b01ac962d service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:49.320446 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c4387-8ebf-4819-abbb-e75b01ac962d service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:49.320743 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c4387-8ebf-4819-abbb-e75b01ac962d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:49.334459 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:49.360736 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1083/2131] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:49 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:49.368175 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4ae46-ed1f-4da3-8a11-c730005c0daa None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:49.369558 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a5e4ae46-ed1f-4da3-8a11-c730005c0daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:49.374550 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:49.388071 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c4387-8ebf-4819-abbb-e75b01ac962d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:49.389537 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c4387-8ebf-4819-abbb-e75b01ac962d service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:49.399680 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1049/2132] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:27:49.430080 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4ae46-ed1f-4da3-8a11-c730005c0daa None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:49.433625 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35acc07c-4238-4807-a221-941950c496c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:49.434226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acc07c-4238-4807-a221-941950c496c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:49.434499 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acc07c-4238-4807-a221-941950c496c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:49.434766 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acc07c-4238-4807-a221-941950c496c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:49.445328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35acc07c-4238-4807-a221-941950c496c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:49.446958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35acc07c-4238-4807-a221-941950c496c2 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:49.458306 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1084/2133] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:49 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:27:49.752857 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c4387-8ebf-4819-abbb-e75b01ac962d service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:49.754310 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-375c4387-8ebf-4819-abbb-e75b01ac962d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:49.771323 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c4387-8ebf-4819-abbb-e75b01ac962d service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:49.779471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38840c86-9795-474d-ad54-53073532392a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:49.780448 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38840c86-9795-474d-ad54-53073532392a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:49.780785 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38840c86-9795-474d-ad54-53073532392a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:49.781125 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38840c86-9795-474d-ad54-53073532392a admin admin] PATH_INFO: `/v3/projects/d19963d019e941d0a655b33e19750f76` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:49.782596 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38840c86-9795-474d-ad54-53073532392a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d19963d019e941d0a655b33e19750f76)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:49.784643 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38840c86-9795-474d-ad54-53073532392a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:49.787258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35acc07c-4238-4807-a221-941950c496c2 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:49.801086 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35acc07c-4238-4807-a221-941950c496c2 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:49.806294 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672b52d-046e-413b-9dc1-25adff0549c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:49.806931 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672b52d-046e-413b-9dc1-25adff0549c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:49.807211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672b52d-046e-413b-9dc1-25adff0549c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:49.807483 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672b52d-046e-413b-9dc1-25adff0549c3 admin admin] PATH_INFO: `/v3/users/ae10162375754a3f84a7de71ea431c7d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:49.810327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5672b52d-046e-413b-9dc1-25adff0549c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae10162375754a3f84a7de71ea431c7d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:49.812515 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5672b52d-046e-413b-9dc1-25adff0549c3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:49.867082 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-38840c86-9795-474d-ad54-53073532392a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd19963d019e941d0a655b33e19750f76', 'request_id': 'req-38840c86-9795-474d-ad54-53073532392a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:49.874416 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-38840c86-9795-474d-ad54-53073532392a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd19963d019e941d0a655b33e19750f76', 'request_id': 'req-38840c86-9795-474d-ad54-53073532392a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:49.881844 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-38840c86-9795-474d-ad54-53073532392a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd19963d019e941d0a655b33e19750f76', 'request_id': 'req-38840c86-9795-474d-ad54-53073532392a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:49.882950 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5672b52d-046e-413b-9dc1-25adff0549c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae10162375754a3f84a7de71ea431c7d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:49.884375 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5672b52d-046e-413b-9dc1-25adff0549c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae10162375754a3f84a7de71ea431c7d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:49.897196 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-38840c86-9795-474d-ad54-53073532392a admin admin] The token cache is being invalidate because project d19963d019e941d0a655b33e19750f76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:49.897552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-38840c86-9795-474d-ad54-53073532392a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:49.898218 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-38840c86-9795-474d-ad54-53073532392a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:49.899955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5672b52d-046e-413b-9dc1-25adff0549c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae10162375754a3f84a7de71ea431c7d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:49.906981 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1050/2134] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:49 2022] DELETE /identity/v3/projects/d19963d019e941d0a655b33e19750f76 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:49.908278 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5672b52d-046e-413b-9dc1-25adff0549c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae10162375754a3f84a7de71ea431c7d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:49.911664 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed8315-4dcf-4762-877a-299b6909b22e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:49.911962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed8315-4dcf-4762-877a-299b6909b22e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:49.912239 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed8315-4dcf-4762-877a-299b6909b22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:49.924319 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5672b52d-046e-413b-9dc1-25adff0549c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae10162375754a3f84a7de71ea431c7d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:49.930444 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1085/2135] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:49 2022] DELETE /identity/v3/users/ae10162375754a3f84a7de71ea431c7d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:27:49.932126 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d3ed8315-4dcf-4762-877a-299b6909b22e None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:49.933343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d3ed8315-4dcf-4762-877a-299b6909b22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:49.934840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f27572-da83-4705-bdf9-fe2e45f99fe1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:49.935133 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f27572-da83-4705-bdf9-fe2e45f99fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:49.935404 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f27572-da83-4705-bdf9-fe2e45f99fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:49.954608 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-70f27572-da83-4705-bdf9-fe2e45f99fe1 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:49.955797 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-70f27572-da83-4705-bdf9-fe2e45f99fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:49.994296 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1051/2136] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:50.003115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1d1a8-a822-4067-9248-353f17ca55c3 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:50.003403 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1d1a8-a822-4067-9248-353f17ca55c3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:50.003708 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1d1a8-a822-4067-9248-353f17ca55c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:50.022273 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1086/2137] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:27:50.024539 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-60f1d1a8-a822-4067-9248-353f17ca55c3 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:50.025795 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-60f1d1a8-a822-4067-9248-353f17ca55c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:50.031800 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f27572-da83-4705-bdf9-fe2e45f99fe1 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:50.033129 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-70f27572-da83-4705-bdf9-fe2e45f99fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:50.034031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1052/2138] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:27:50.038071 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1d1a8-a822-4067-9248-353f17ca55c3 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:50.047744 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1d1a8-a822-4067-9248-353f17ca55c3 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:50.052346 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfaefcb-343b-47c6-b28b-7dbdfee9cd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:50.052931 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfaefcb-343b-47c6-b28b-7dbdfee9cd8c admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:50.053201 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfaefcb-343b-47c6-b28b-7dbdfee9cd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:50.053505 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfaefcb-343b-47c6-b28b-7dbdfee9cd8c admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:50.054138 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfaefcb-343b-47c6-b28b-7dbdfee9cd8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:27:50.054435 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfaefcb-343b-47c6-b28b-7dbdfee9cd8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:50.054617 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:50.056387 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfaefcb-343b-47c6-b28b-7dbdfee9cd8c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:50.072912 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1053/2139] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:27:50.073873 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfaefcb-343b-47c6-b28b-7dbdfee9cd8c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:50.083318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfaefcb-343b-47c6-b28b-7dbdfee9cd8c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:50.088401 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184551c-0588-4126-879f-faed28c400dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:50.089191 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184551c-0588-4126-879f-faed28c400dc admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:50.089508 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184551c-0588-4126-879f-faed28c400dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:50.089786 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184551c-0588-4126-879f-faed28c400dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:50.090413 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184551c-0588-4126-879f-faed28c400dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:50.092350 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184551c-0588-4126-879f-faed28c400dc admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:50.094768 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f27572-da83-4705-bdf9-fe2e45f99fe1 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:50.099018 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19b4e6-7814-41db-ab63-f2541474bbcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:50.099603 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19b4e6-7814-41db-ab63-f2541474bbcd service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:50.099877 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19b4e6-7814-41db-ab63-f2541474bbcd service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:50.100145 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19b4e6-7814-41db-ab63-f2541474bbcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:50.104870 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:50.110037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e19b4e6-7814-41db-ab63-f2541474bbcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:50.111830 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e19b4e6-7814-41db-ab63-f2541474bbcd service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:50.123108 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1087/2140] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:27:50.123747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1054/2141] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:50 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:27:50.127630 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19b4e6-7814-41db-ab63-f2541474bbcd service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:50.137322 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19b4e6-7814-41db-ab63-f2541474bbcd service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:50.196065 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b836cda-20e1-4810-b0fb-d0b1dc307155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:50.196756 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b836cda-20e1-4810-b0fb-d0b1dc307155 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:50.203448 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b836cda-20e1-4810-b0fb-d0b1dc307155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:50.203448 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b836cda-20e1-4810-b0fb-d0b1dc307155 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:50.203448 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b836cda-20e1-4810-b0fb-d0b1dc307155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:50.203448 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b836cda-20e1-4810-b0fb-d0b1dc307155 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:50.227106 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1088/2142] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:50 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:27:50.233872 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184551c-0588-4126-879f-faed28c400dc admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:50.245491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184551c-0588-4126-879f-faed28c400dc admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:50.251529 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9e99d-9989-469d-ba33-d1fe6821db66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:50.252144 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9e99d-9989-469d-ba33-d1fe6821db66 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:50.252422 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9e99d-9989-469d-ba33-d1fe6821db66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:50.252696 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9e99d-9989-469d-ba33-d1fe6821db66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:50.253390 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9e99d-9989-469d-ba33-d1fe6821db66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:50.255837 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9e99d-9989-469d-ba33-d1fe6821db66 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:50.268934 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1055/2143] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:50.273320 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b836cda-20e1-4810-b0fb-d0b1dc307155 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:50.284053 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b836cda-20e1-4810-b0fb-d0b1dc307155 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:50.289663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00310e55-c680-4697-81d8-8a45316c48a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:50.290275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00310e55-c680-4697-81d8-8a45316c48a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:50.290573 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00310e55-c680-4697-81d8-8a45316c48a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:50.290849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00310e55-c680-4697-81d8-8a45316c48a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:50.291884 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00310e55-c680-4697-81d8-8a45316c48a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:50.293105 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00310e55-c680-4697-81d8-8a45316c48a3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:50.304891 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1089/2144] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:50.309550 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9e99d-9989-469d-ba33-d1fe6821db66 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:50.319943 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9e99d-9989-469d-ba33-d1fe6821db66 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:50.333034 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c91c6c-136c-4293-94e0-7f5169b0b44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:50.333739 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c91c6c-136c-4293-94e0-7f5169b0b44a admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:50.334015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c91c6c-136c-4293-94e0-7f5169b0b44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:50.334287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c91c6c-136c-4293-94e0-7f5169b0b44a admin admin] PATH_INFO: `/v3/projects/0dae411a425e41efb0816549dea14b3d/users/dcb78b24194a46c5b3d87a5af413231e/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:50.352846 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c91c6c-136c-4293-94e0-7f5169b0b44a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dae411a425e41efb0816549dea14b3d, user_id=dcb78b24194a46c5b3d87a5af413231e, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:50.355706 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c91c6c-136c-4293-94e0-7f5169b0b44a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:50.372498 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1056/2145] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:50 2022] PUT /identity/v3/projects/0dae411a425e41efb0816549dea14b3d/users/dcb78b24194a46c5b3d87a5af413231e/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:27:50.382942 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624a2e1-1d73-4d28-949c-906323e0fbdb None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:50.383230 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624a2e1-1d73-4d28-949c-906323e0fbdb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:50.383504 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624a2e1-1d73-4d28-949c-906323e0fbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:50.414547 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4624a2e1-1d73-4d28-949c-906323e0fbdb None None] MFA Rules not processed for user `dcb78b24194a46c5b3d87a5af413231e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:50.416153 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4624a2e1-1d73-4d28-949c-906323e0fbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:50.451680 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c91c6c-136c-4293-94e0-7f5169b0b44a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:50.454645 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-92c91c6c-136c-4293-94e0-7f5169b0b44a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:50.496417 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1090/2146] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:50.500767 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624a2e1-1d73-4d28-949c-906323e0fbdb None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:50.527983 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c91c6c-136c-4293-94e0-7f5169b0b44a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:50.532718 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f4fee-a219-4e93-a1b1-9b9d2c43d7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:50.533358 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f4fee-a219-4e93-a1b1-9b9d2c43d7c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:50.533670 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f4fee-a219-4e93-a1b1-9b9d2c43d7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:50.533944 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f4fee-a219-4e93-a1b1-9b9d2c43d7c0 admin admin] PATH_INFO: `/v3/projects/cf00bbc3dfea4cebbf76916fc5364111` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:50.535083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f4fee-a219-4e93-a1b1-9b9d2c43d7c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf00bbc3dfea4cebbf76916fc5364111)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:50.536223 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:50.537590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f4fee-a219-4e93-a1b1-9b9d2c43d7c0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:50.570943 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624a2e1-1d73-4d28-949c-906323e0fbdb None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:50.575297 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f52278-09ef-4a8e-a139-8bdde3169998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:50.575905 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f52278-09ef-4a8e-a139-8bdde3169998 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:50.576178 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f52278-09ef-4a8e-a139-8bdde3169998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:50.576450 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f52278-09ef-4a8e-a139-8bdde3169998 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:50.577077 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f52278-09ef-4a8e-a139-8bdde3169998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:50.579093 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f52278-09ef-4a8e-a139-8bdde3169998 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:50.585737 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-082f4fee-a219-4e93-a1b1-9b9d2c43d7c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf00bbc3dfea4cebbf76916fc5364111', 'request_id': 'req-082f4fee-a219-4e93-a1b1-9b9d2c43d7c0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:50.591429 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-082f4fee-a219-4e93-a1b1-9b9d2c43d7c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf00bbc3dfea4cebbf76916fc5364111', 'request_id': 'req-082f4fee-a219-4e93-a1b1-9b9d2c43d7c0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:50.597700 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-082f4fee-a219-4e93-a1b1-9b9d2c43d7c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf00bbc3dfea4cebbf76916fc5364111', 'request_id': 'req-082f4fee-a219-4e93-a1b1-9b9d2c43d7c0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:50.609229 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1091/2147] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:50 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:27:50.610870 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-082f4fee-a219-4e93-a1b1-9b9d2c43d7c0 admin admin] The token cache is being invalidate because project cf00bbc3dfea4cebbf76916fc5364111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:50.611193 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-082f4fee-a219-4e93-a1b1-9b9d2c43d7c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:50.611944 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-082f4fee-a219-4e93-a1b1-9b9d2c43d7c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:50.613023 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f52278-09ef-4a8e-a139-8bdde3169998 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:50.613873 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1057/2148] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:50 2022] DELETE /identity/v3/projects/cf00bbc3dfea4cebbf76916fc5364111 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:50.615154 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-03f52278-09ef-4a8e-a139-8bdde3169998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:50.617437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f4fee-a219-4e93-a1b1-9b9d2c43d7c0 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:50.618759 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-082f4fee-a219-4e93-a1b1-9b9d2c43d7c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:50.667983 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:50.682874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f52278-09ef-4a8e-a139-8bdde3169998 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:50.685499 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f4fee-a219-4e93-a1b1-9b9d2c43d7c0 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:50.691124 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55519664-0687-4c1d-a2ec-6d8fecb69d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:50.692318 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55519664-0687-4c1d-a2ec-6d8fecb69d91 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:50.692606 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55519664-0687-4c1d-a2ec-6d8fecb69d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:50.692875 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55519664-0687-4c1d-a2ec-6d8fecb69d91 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:50.695899 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55519664-0687-4c1d-a2ec-6d8fecb69d91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:50.695899 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55519664-0687-4c1d-a2ec-6d8fecb69d91 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:50.698444 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd740b1e-5d11-4017-a3e8-ae09af9872c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:50.699323 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd740b1e-5d11-4017-a3e8-ae09af9872c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:50.699610 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd740b1e-5d11-4017-a3e8-ae09af9872c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:50.699891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd740b1e-5d11-4017-a3e8-ae09af9872c8 admin admin] PATH_INFO: `/v3/users/97da025c5ed5424ea49f4e073e22bff2` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:50.701814 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd740b1e-5d11-4017-a3e8-ae09af9872c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97da025c5ed5424ea49f4e073e22bff2)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:50.705088 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd740b1e-5d11-4017-a3e8-ae09af9872c8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:50.728553 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1092/2149] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:50 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:27:50.730097 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55519664-0687-4c1d-a2ec-6d8fecb69d91 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:50.742301 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55519664-0687-4c1d-a2ec-6d8fecb69d91 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:50.749551 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9e2a5-73cd-43dd-b59c-a87490e2f397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:50.750403 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9e2a5-73cd-43dd-b59c-a87490e2f397 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:50.750900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9e2a5-73cd-43dd-b59c-a87490e2f397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:50.751126 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9e2a5-73cd-43dd-b59c-a87490e2f397 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:50.752227 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9e2a5-73cd-43dd-b59c-a87490e2f397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:50.754717 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9e2a5-73cd-43dd-b59c-a87490e2f397 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:50.766435 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1093/2150] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:50.771662 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9e2a5-73cd-43dd-b59c-a87490e2f397 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:50.777949 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bd740b1e-5d11-4017-a3e8-ae09af9872c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97da025c5ed5424ea49f4e073e22bff2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:50.780870 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bd740b1e-5d11-4017-a3e8-ae09af9872c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97da025c5ed5424ea49f4e073e22bff2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:50.783901 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9e2a5-73cd-43dd-b59c-a87490e2f397 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:50.790797 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd7389-5445-4e4e-b011-2a36b2ab677e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:50.792182 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd7389-5445-4e4e-b011-2a36b2ab677e admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:50.792625 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd7389-5445-4e4e-b011-2a36b2ab677e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:50.793980 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bd740b1e-5d11-4017-a3e8-ae09af9872c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97da025c5ed5424ea49f4e073e22bff2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:50.794373 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd7389-5445-4e4e-b011-2a36b2ab677e admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:50.794873 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bd740b1e-5d11-4017-a3e8-ae09af9872c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97da025c5ed5424ea49f4e073e22bff2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:50.795956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd7389-5445-4e4e-b011-2a36b2ab677e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:50.798138 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd7389-5445-4e4e-b011-2a36b2ab677e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:50.806398 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bd740b1e-5d11-4017-a3e8-ae09af9872c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97da025c5ed5424ea49f4e073e22bff2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:50.817015 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1094/2151] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:27:50.824889 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd7389-5445-4e4e-b011-2a36b2ab677e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:50.827300 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8fcd7389-5445-4e4e-b011-2a36b2ab677e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:50.834075 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1058/2152] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:50 2022] DELETE /identity/v3/users/97da025c5ed5424ea49f4e073e22bff2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:27:50.857230 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd7389-5445-4e4e-b011-2a36b2ab677e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:50.963319 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4286f-7cd3-4c58-95c0-619fb982dc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:50.964274 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4286f-7cd3-4c58-95c0-619fb982dc46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:50.965182 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4286f-7cd3-4c58-95c0-619fb982dc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:50.965713 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4286f-7cd3-4c58-95c0-619fb982dc46 admin admin] PATH_INFO: `/v3/projects/167a1cce9da64851a4a8902f01dcafd8/users/595580c21ab24be5a481d98b547da662/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:51.003685 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a4286f-7cd3-4c58-95c0-619fb982dc46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=167a1cce9da64851a4a8902f01dcafd8, user_id=595580c21ab24be5a481d98b547da662, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:51.007985 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a4286f-7cd3-4c58-95c0-619fb982dc46 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:51.028969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1095/2153] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:50 2022] PUT /identity/v3/projects/167a1cce9da64851a4a8902f01dcafd8/users/595580c21ab24be5a481d98b547da662/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:51.040898 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3378aa-8a1d-40f9-804f-35f010f0019a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:51.041490 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3378aa-8a1d-40f9-804f-35f010f0019a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:51.042125 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3378aa-8a1d-40f9-804f-35f010f0019a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:51.079790 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-4a3378aa-8a1d-40f9-804f-35f010f0019a None None] MFA Rules not processed for user `595580c21ab24be5a481d98b547da662`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:51.081005 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4a3378aa-8a1d-40f9-804f-35f010f0019a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:51.162725 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1059/2154] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:27:51.167260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4286f-7cd3-4c58-95c0-619fb982dc46 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:51.172809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:51.175067 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3378aa-8a1d-40f9-804f-35f010f0019a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:51.177387 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4a3378aa-8a1d-40f9-804f-35f010f0019a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:51.245730 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:51.251853 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3378aa-8a1d-40f9-804f-35f010f0019a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:51.255276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4286f-7cd3-4c58-95c0-619fb982dc46 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:51.258574 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f1611-d275-469e-96b4-6d05ea447489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:51.259210 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f1611-d275-469e-96b4-6d05ea447489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:51.259495 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f1611-d275-469e-96b4-6d05ea447489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:51.259772 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f1611-d275-469e-96b4-6d05ea447489 admin admin] PATH_INFO: `/v3/projects/60535a0659b54a49955b319384082918` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:51.260059 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b830f7d-1b62-4c84-82e5-c892e0f16829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:51.260690 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b830f7d-1b62-4c84-82e5-c892e0f16829 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:51.260886 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f1611-d275-469e-96b4-6d05ea447489 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60535a0659b54a49955b319384082918)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:51.260985 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b830f7d-1b62-4c84-82e5-c892e0f16829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:51.261220 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b830f7d-1b62-4c84-82e5-c892e0f16829 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:51.261895 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b830f7d-1b62-4c84-82e5-c892e0f16829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:51.262837 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f1611-d275-469e-96b4-6d05ea447489 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:51.263813 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b830f7d-1b62-4c84-82e5-c892e0f16829 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:51.295130 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1096/2155] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:51 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:51.299271 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b830f7d-1b62-4c84-82e5-c892e0f16829 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:51.331465 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-476f1611-d275-469e-96b4-6d05ea447489 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60535a0659b54a49955b319384082918', 'request_id': 'req-476f1611-d275-469e-96b4-6d05ea447489'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:51.338436 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-476f1611-d275-469e-96b4-6d05ea447489 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60535a0659b54a49955b319384082918', 'request_id': 'req-476f1611-d275-469e-96b4-6d05ea447489'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:51.345685 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-476f1611-d275-469e-96b4-6d05ea447489 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60535a0659b54a49955b319384082918', 'request_id': 'req-476f1611-d275-469e-96b4-6d05ea447489'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:51.358888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-476f1611-d275-469e-96b4-6d05ea447489 admin admin] The token cache is being invalidate because project 60535a0659b54a49955b319384082918 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:51.359183 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-476f1611-d275-469e-96b4-6d05ea447489 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:51.359928 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-476f1611-d275-469e-96b4-6d05ea447489 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:51.361509 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1060/2156] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:51 2022] DELETE /identity/v3/projects/60535a0659b54a49955b319384082918 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:51.366815 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d868ee-840c-431b-adbd-9ecdd94611af None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:51.367119 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d868ee-840c-431b-adbd-9ecdd94611af None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:51.367477 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d868ee-840c-431b-adbd-9ecdd94611af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:51.372600 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b830f7d-1b62-4c84-82e5-c892e0f16829 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:51.390312 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d8d868ee-840c-431b-adbd-9ecdd94611af None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:51.391535 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d8d868ee-840c-431b-adbd-9ecdd94611af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:51.433065 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf8ffd-b37a-4ea2-97ce-3d1405d5b1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:51.434109 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf8ffd-b37a-4ea2-97ce-3d1405d5b1d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:51.434461 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf8ffd-b37a-4ea2-97ce-3d1405d5b1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:51.434807 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf8ffd-b37a-4ea2-97ce-3d1405d5b1d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:51.435515 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf8ffd-b37a-4ea2-97ce-3d1405d5b1d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:51.437594 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf8ffd-b37a-4ea2-97ce-3d1405d5b1d6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:51.461443 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1097/2157] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:51 2022] POST /identity/v3/users => generated 299 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:27:51.461583 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1061/2158] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:51.465777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf8ffd-b37a-4ea2-97ce-3d1405d5b1d6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:51.467475 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-96bf8ffd-b37a-4ea2-97ce-3d1405d5b1d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:51.468490 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56166dca-941f-4c25-ab47-2c208e7c05fe None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:51.468790 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56166dca-941f-4c25-ab47-2c208e7c05fe None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:51.469083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56166dca-941f-4c25-ab47-2c208e7c05fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:51.480078 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf8ffd-b37a-4ea2-97ce-3d1405d5b1d6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:51.485444 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330f70f-7d21-4c03-b85b-39da13a5048e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:51.485684 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330f70f-7d21-4c03-b85b-39da13a5048e admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:51.485967 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330f70f-7d21-4c03-b85b-39da13a5048e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:51.486241 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330f70f-7d21-4c03-b85b-39da13a5048e admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:51.486895 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b330f70f-7d21-4c03-b85b-39da13a5048e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:51.489058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b330f70f-7d21-4c03-b85b-39da13a5048e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:51.491793 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-56166dca-941f-4c25-ab47-2c208e7c05fe None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:51.493013 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-56166dca-941f-4c25-ab47-2c208e7c05fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:51.500486 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1098/2159] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:51.503578 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1062/2160] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:51.504619 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330f70f-7d21-4c03-b85b-39da13a5048e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:51.508109 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56166dca-941f-4c25-ab47-2c208e7c05fe None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:51.515340 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330f70f-7d21-4c03-b85b-39da13a5048e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:51.519553 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56166dca-941f-4c25-ab47-2c208e7c05fe None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:51.520377 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61987db-220c-4778-a495-8dd556e1e957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:51.521042 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61987db-220c-4778-a495-8dd556e1e957 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:51.521325 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61987db-220c-4778-a495-8dd556e1e957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:51.521637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61987db-220c-4778-a495-8dd556e1e957 admin admin] PATH_INFO: `/v3/projects/99e6e60d63a540229f40c7697983f688/users/6e3102e7c1ed4e318da93d93845247bf/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:51.524508 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a0054-76c2-41db-afdb-af7bef3aaf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:51.525202 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a0054-76c2-41db-afdb-af7bef3aaf80 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:51.525582 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a0054-76c2-41db-afdb-af7bef3aaf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:51.525924 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a0054-76c2-41db-afdb-af7bef3aaf80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:51.526665 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a0054-76c2-41db-afdb-af7bef3aaf80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:27:51.526969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a0054-76c2-41db-afdb-af7bef3aaf80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:51.528725 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a0054-76c2-41db-afdb-af7bef3aaf80 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:51.549460 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1063/2161] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:27:51.549643 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61987db-220c-4778-a495-8dd556e1e957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99e6e60d63a540229f40c7697983f688, user_id=6e3102e7c1ed4e318da93d93845247bf, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:51.551743 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a0054-76c2-41db-afdb-af7bef3aaf80 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:51.552499 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61987db-220c-4778-a495-8dd556e1e957 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:51.555637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:51.567639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1099/2162] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:51 2022] PUT /identity/v3/projects/99e6e60d63a540229f40c7697983f688/users/6e3102e7c1ed4e318da93d93845247bf/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:51.571967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a0054-76c2-41db-afdb-af7bef3aaf80 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:51.572157 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61987db-220c-4778-a495-8dd556e1e957 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:51.636426 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f9f64-2918-4f10-a9e7-08e80e46ca11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:51.637194 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f9f64-2918-4f10-a9e7-08e80e46ca11 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:51.637512 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f9f64-2918-4f10-a9e7-08e80e46ca11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:51.637797 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f9f64-2918-4f10-a9e7-08e80e46ca11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:51.638433 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f9f64-2918-4f10-a9e7-08e80e46ca11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:51.640226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61987db-220c-4778-a495-8dd556e1e957 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:51.640348 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f9f64-2918-4f10-a9e7-08e80e46ca11 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:51.645602 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9277634-cbc9-49a5-8a77-8c711ef84739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:51.646209 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9277634-cbc9-49a5-8a77-8c711ef84739 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:51.646487 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9277634-cbc9-49a5-8a77-8c711ef84739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:51.647308 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9277634-cbc9-49a5-8a77-8c711ef84739 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:51.647962 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9277634-cbc9-49a5-8a77-8c711ef84739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:51.649627 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9277634-cbc9-49a5-8a77-8c711ef84739 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:51.652819 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:51.664704 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1100/2163] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:27:51.665841 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9277634-cbc9-49a5-8a77-8c711ef84739 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:51.670639 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1064/2164] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:51 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:51.674697 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f9f64-2918-4f10-a9e7-08e80e46ca11 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:51.676199 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9277634-cbc9-49a5-8a77-8c711ef84739 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:51.736239 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6ae4b-7b6a-4e3e-8d23-ee5e9427dc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:51.736985 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6ae4b-7b6a-4e3e-8d23-ee5e9427dc10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:51.737488 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6ae4b-7b6a-4e3e-8d23-ee5e9427dc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:51.737768 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6ae4b-7b6a-4e3e-8d23-ee5e9427dc10 admin admin] PATH_INFO: `/v3/projects/99e6e60d63a540229f40c7697983f688/users/6e3102e7c1ed4e318da93d93845247bf/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:51.740853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6ae4b-7b6a-4e3e-8d23-ee5e9427dc10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99e6e60d63a540229f40c7697983f688, user_id=6e3102e7c1ed4e318da93d93845247bf, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:51.743590 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6ae4b-7b6a-4e3e-8d23-ee5e9427dc10 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:51.751759 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f9f64-2918-4f10-a9e7-08e80e46ca11 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:51.754829 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1101/2165] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:51 2022] PUT /identity/v3/projects/99e6e60d63a540229f40c7697983f688/users/6e3102e7c1ed4e318da93d93845247bf/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:51.765166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec619844-3eae-4ef2-9d42-7f5cbcfc1ff4 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:51.765567 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec619844-3eae-4ef2-9d42-7f5cbcfc1ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:51.765875 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec619844-3eae-4ef2-9d42-7f5cbcfc1ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:51.799193 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ec619844-3eae-4ef2-9d42-7f5cbcfc1ff4 None None] MFA Rules not processed for user `6e3102e7c1ed4e318da93d93845247bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:51.800518 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ec619844-3eae-4ef2-9d42-7f5cbcfc1ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:51.813516 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fa66e-e972-49bf-b6ad-4b835626e9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:51.814249 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fa66e-e972-49bf-b6ad-4b835626e9f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:51.814536 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fa66e-e972-49bf-b6ad-4b835626e9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:51.814793 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fa66e-e972-49bf-b6ad-4b835626e9f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:51.815515 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6fa66e-e972-49bf-b6ad-4b835626e9f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:51.818004 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6fa66e-e972-49bf-b6ad-4b835626e9f7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:51.842576 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1065/2166] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:51 2022] POST /identity/v3/users => generated 287 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:27:51.847769 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fa66e-e972-49bf-b6ad-4b835626e9f7 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:51.858115 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fa66e-e972-49bf-b6ad-4b835626e9f7 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:51.863018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba4c0b-926c-415e-9dd0-f3cd15cc28d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:51.864151 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba4c0b-926c-415e-9dd0-f3cd15cc28d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:51.864429 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba4c0b-926c-415e-9dd0-f3cd15cc28d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:51.864702 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba4c0b-926c-415e-9dd0-f3cd15cc28d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:51.865380 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba4c0b-926c-415e-9dd0-f3cd15cc28d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:51.867086 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba4c0b-926c-415e-9dd0-f3cd15cc28d3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:51.875890 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1102/2167] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:51 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:27:51.880506 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1066/2168] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:27:51.881736 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec619844-3eae-4ef2-9d42-7f5cbcfc1ff4 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:51.887860 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba4c0b-926c-415e-9dd0-f3cd15cc28d3 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:51.889715 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3aba4c0b-926c-415e-9dd0-f3cd15cc28d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:51.892432 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec619844-3eae-4ef2-9d42-7f5cbcfc1ff4 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:51.913456 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df34b48-a068-4bb9-ac79-f76878655c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:51.914110 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df34b48-a068-4bb9-ac79-f76878655c15 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:51.914392 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df34b48-a068-4bb9-ac79-f76878655c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:51.914665 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df34b48-a068-4bb9-ac79-f76878655c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:51.915329 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df34b48-a068-4bb9-ac79-f76878655c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:51.917039 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df34b48-a068-4bb9-ac79-f76878655c15 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:51.918881 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:51.938672 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1103/2169] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:27:51.942798 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df34b48-a068-4bb9-ac79-f76878655c15 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:51.960715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df34b48-a068-4bb9-ac79-f76878655c15 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:51.968331 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f16567-0ccf-473a-bcc6-558df403801f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:51.968727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba4c0b-926c-415e-9dd0-f3cd15cc28d3 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:51.969059 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f16567-0ccf-473a-bcc6-558df403801f admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:51.969344 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f16567-0ccf-473a-bcc6-558df403801f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:51.969785 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f16567-0ccf-473a-bcc6-558df403801f admin admin] PATH_INFO: `/v3/projects/1366951be0994b8ca5c8c17373ffcaad/users/1313b21bb0604f08822728547913cec2/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:51.976011 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ffeee-fae0-45e2-846f-6b6ba010446c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:51.976729 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ffeee-fae0-45e2-846f-6b6ba010446c service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:51.977528 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ffeee-fae0-45e2-846f-6b6ba010446c service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:51.977853 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ffeee-fae0-45e2-846f-6b6ba010446c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:51.980531 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-db3ffeee-fae0-45e2-846f-6b6ba010446c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:51.994467 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f16567-0ccf-473a-bcc6-558df403801f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1366951be0994b8ca5c8c17373ffcaad, user_id=1313b21bb0604f08822728547913cec2, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:51.997870 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f16567-0ccf-473a-bcc6-558df403801f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:52.016236 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1104/2170] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:51 2022] PUT /identity/v3/projects/1366951be0994b8ca5c8c17373ffcaad/users/1313b21bb0604f08822728547913cec2/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:27:52.026630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:52.027174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f2718-867c-4523-b841-370e0d89f852 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:52.027515 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f2718-867c-4523-b841-370e0d89f852 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:52.027797 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f2718-867c-4523-b841-370e0d89f852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:52.055859 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ffeee-fae0-45e2-846f-6b6ba010446c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:52.057331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ffeee-fae0-45e2-846f-6b6ba010446c service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:52.064878 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f74f2718-867c-4523-b841-370e0d89f852 None None] MFA Rules not processed for user `1313b21bb0604f08822728547913cec2`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:52.066249 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f74f2718-867c-4523-b841-370e0d89f852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:52.070186 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1067/2171] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:27:52.155998 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1105/2172] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:52.160165 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ffeee-fae0-45e2-846f-6b6ba010446c service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:52.176754 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ffeee-fae0-45e2-846f-6b6ba010446c service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:52.258135 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ade60-9fb9-4821-9ce6-efcd4bcc6fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:52.258925 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ade60-9fb9-4821-9ce6-efcd4bcc6fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:52.259281 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ade60-9fb9-4821-9ce6-efcd4bcc6fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:52.259624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ade60-9fb9-4821-9ce6-efcd4bcc6fb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:52.261015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ade60-9fb9-4821-9ce6-efcd4bcc6fb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:52.263426 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ade60-9fb9-4821-9ce6-efcd4bcc6fb1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:52.312713 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1068/2173] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:27:52 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:27:52.317932 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f2718-867c-4523-b841-370e0d89f852 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:52.333631 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f2718-867c-4523-b841-370e0d89f852 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:52.408615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df31d8c-613f-4ae2-bb4b-56f9fbfb40ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:52.409351 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df31d8c-613f-4ae2-bb4b-56f9fbfb40ed admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:52.409819 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df31d8c-613f-4ae2-bb4b-56f9fbfb40ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:52.409980 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df31d8c-613f-4ae2-bb4b-56f9fbfb40ed admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:52.411263 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df31d8c-613f-4ae2-bb4b-56f9fbfb40ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:52.413344 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df31d8c-613f-4ae2-bb4b-56f9fbfb40ed admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:52.442010 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1106/2174] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:27:52 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:27:52.443234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ade60-9fb9-4821-9ce6-efcd4bcc6fb1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:52.459094 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ade60-9fb9-4821-9ce6-efcd4bcc6fb1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:52.464990 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee845345-5c74-43b1-838b-755b7ce5ce10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:52.465877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee845345-5c74-43b1-838b-755b7ce5ce10 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:52.466346 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee845345-5c74-43b1-838b-755b7ce5ce10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:52.466663 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee845345-5c74-43b1-838b-755b7ce5ce10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:52.468576 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee845345-5c74-43b1-838b-755b7ce5ce10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:52.469597 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee845345-5c74-43b1-838b-755b7ce5ce10 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:52.488920 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1069/2175] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:52.490294 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df31d8c-613f-4ae2-bb4b-56f9fbfb40ed admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:52.502378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df31d8c-613f-4ae2-bb4b-56f9fbfb40ed admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:52.522166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898c962-eacf-479d-a8cb-8d4adb4762e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:52.522817 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898c962-eacf-479d-a8cb-8d4adb4762e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:52.523100 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898c962-eacf-479d-a8cb-8d4adb4762e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:52.523378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898c962-eacf-479d-a8cb-8d4adb4762e2 admin admin] PATH_INFO: `/v3/projects/7f1044050e0b44ba9347b761b2ee7e0b/users/09290539522442a78069c1a6d5b36ac0/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:52.555496 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898c962-eacf-479d-a8cb-8d4adb4762e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f1044050e0b44ba9347b761b2ee7e0b, user_id=09290539522442a78069c1a6d5b36ac0, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:52.558268 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898c962-eacf-479d-a8cb-8d4adb4762e2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:52.576337 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1107/2176] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:52 2022] PUT /identity/v3/projects/7f1044050e0b44ba9347b761b2ee7e0b/users/09290539522442a78069c1a6d5b36ac0/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:27:52.582657 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee845345-5c74-43b1-838b-755b7ce5ce10 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:52.599172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee845345-5c74-43b1-838b-755b7ce5ce10 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:52.669434 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e54a5-e468-4eb5-9b0b-1dbdb1fa9cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:52.670142 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e54a5-e468-4eb5-9b0b-1dbdb1fa9cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:52.670516 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e54a5-e468-4eb5-9b0b-1dbdb1fa9cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:52.670801 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e54a5-e468-4eb5-9b0b-1dbdb1fa9cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:52.671447 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e54a5-e468-4eb5-9b0b-1dbdb1fa9cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:52.673152 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e54a5-e468-4eb5-9b0b-1dbdb1fa9cf9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:52.684826 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1070/2177] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:27:52.688880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898c962-eacf-479d-a8cb-8d4adb4762e2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:52.699642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898c962-eacf-479d-a8cb-8d4adb4762e2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:52.706792 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57904771-4c64-4691-bbff-a63f0251db3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:52.708499 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57904771-4c64-4691-bbff-a63f0251db3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:52.708804 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57904771-4c64-4691-bbff-a63f0251db3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:52.709084 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57904771-4c64-4691-bbff-a63f0251db3d admin admin] PATH_INFO: `/v3/projects/7f1044050e0b44ba9347b761b2ee7e0b/users/09290539522442a78069c1a6d5b36ac0/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:52.711118 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57904771-4c64-4691-bbff-a63f0251db3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f1044050e0b44ba9347b761b2ee7e0b, user_id=09290539522442a78069c1a6d5b36ac0, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:52.714361 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57904771-4c64-4691-bbff-a63f0251db3d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:52.726248 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1108/2178] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:27:52 2022] PUT /identity/v3/projects/7f1044050e0b44ba9347b761b2ee7e0b/users/09290539522442a78069c1a6d5b36ac0/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:52.740796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ebcef-08ad-481e-bd2c-f0981d8fef77 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:52.741085 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ebcef-08ad-481e-bd2c-f0981d8fef77 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:52.741361 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ebcef-08ad-481e-bd2c-f0981d8fef77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:52.769949 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-0c8ebcef-08ad-481e-bd2c-f0981d8fef77 None None] MFA Rules not processed for user `09290539522442a78069c1a6d5b36ac0`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:52.771382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0c8ebcef-08ad-481e-bd2c-f0981d8fef77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:52.800248 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:52.840815 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1071/2179] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:52.852885 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57904771-4c64-4691-bbff-a63f0251db3d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:52.854709 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-57904771-4c64-4691-bbff-a63f0251db3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:52.869680 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:52.914874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57904771-4c64-4691-bbff-a63f0251db3d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:52.918560 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f81689-f629-4a5b-9978-1bc323083118 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:52.919163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f81689-f629-4a5b-9978-1bc323083118 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:52.919444 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f81689-f629-4a5b-9978-1bc323083118 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:52.919716 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f81689-f629-4a5b-9978-1bc323083118 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:52.929576 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f81689-f629-4a5b-9978-1bc323083118 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:52.931010 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f81689-f629-4a5b-9978-1bc323083118 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:52.940517 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1109/2180] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:53.015864 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ebcef-08ad-481e-bd2c-f0981d8fef77 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:53.025533 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ebcef-08ad-481e-bd2c-f0981d8fef77 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:53.029051 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f510d-2a32-475c-adb6-cc65b1635fa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:53.029677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f510d-2a32-475c-adb6-cc65b1635fa9 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:53.029956 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f510d-2a32-475c-adb6-cc65b1635fa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:53.030226 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f510d-2a32-475c-adb6-cc65b1635fa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:53.088587 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f510d-2a32-475c-adb6-cc65b1635fa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:53.090044 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f510d-2a32-475c-adb6-cc65b1635fa9 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:53.099225 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1072/2181] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:53.758293 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f81689-f629-4a5b-9978-1bc323083118 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:53.769392 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f81689-f629-4a5b-9978-1bc323083118 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:53.776714 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b5d3f-a366-49a0-a871-a658105573b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:53.777417 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b5d3f-a366-49a0-a871-a658105573b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:53.777800 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b5d3f-a366-49a0-a871-a658105573b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:53.778078 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b5d3f-a366-49a0-a871-a658105573b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:53.779881 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b08b5d3f-a366-49a0-a871-a658105573b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:53.842440 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b5d3f-a366-49a0-a871-a658105573b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:53.843882 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b5d3f-a366-49a0-a871-a658105573b9 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:53.852938 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1110/2182] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:54.077298 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f510d-2a32-475c-adb6-cc65b1635fa9 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:54.086712 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f510d-2a32-475c-adb6-cc65b1635fa9 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:54.090622 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d912d3-12d3-492a-8160-8a41ddda1061 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:54.091309 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d912d3-12d3-492a-8160-8a41ddda1061 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:54.091691 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d912d3-12d3-492a-8160-8a41ddda1061 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:54.092007 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d912d3-12d3-492a-8160-8a41ddda1061 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:54.093805 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-53d912d3-12d3-492a-8160-8a41ddda1061 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:54.168110 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d912d3-12d3-492a-8160-8a41ddda1061 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:54.170269 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d912d3-12d3-492a-8160-8a41ddda1061 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:54.182131 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1073/2183] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:54.577451 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b5d3f-a366-49a0-a871-a658105573b9 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:54.587266 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b5d3f-a366-49a0-a871-a658105573b9 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:54.592634 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48a49a-c53a-44c9-9fe2-f9edde3dea33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:54.593356 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48a49a-c53a-44c9-9fe2-f9edde3dea33 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:54.593750 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48a49a-c53a-44c9-9fe2-f9edde3dea33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:54.594091 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48a49a-c53a-44c9-9fe2-f9edde3dea33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:54.665635 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48a49a-c53a-44c9-9fe2-f9edde3dea33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:54.667161 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48a49a-c53a-44c9-9fe2-f9edde3dea33 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:54.679759 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1111/2184] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:27:59.027138 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d912d3-12d3-492a-8160-8a41ddda1061 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:59.094532 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d912d3-12d3-492a-8160-8a41ddda1061 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:59.100458 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668173d2-8fcd-4773-8966-454969a79bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:59.101099 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668173d2-8fcd-4773-8966-454969a79bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:59.101373 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668173d2-8fcd-4773-8966-454969a79bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:59.101683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668173d2-8fcd-4773-8966-454969a79bd2 admin admin] PATH_INFO: `/v3/users/dcb78b24194a46c5b3d87a5af413231e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:59.102816 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668173d2-8fcd-4773-8966-454969a79bd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcb78b24194a46c5b3d87a5af413231e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:59.104743 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668173d2-8fcd-4773-8966-454969a79bd2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:59.106393 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:59.166952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-668173d2-8fcd-4773-8966-454969a79bd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcb78b24194a46c5b3d87a5af413231e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:59.167612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-668173d2-8fcd-4773-8966-454969a79bd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcb78b24194a46c5b3d87a5af413231e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:59.176004 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-668173d2-8fcd-4773-8966-454969a79bd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcb78b24194a46c5b3d87a5af413231e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:59.176670 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-668173d2-8fcd-4773-8966-454969a79bd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcb78b24194a46c5b3d87a5af413231e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:59.184141 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-668173d2-8fcd-4773-8966-454969a79bd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcb78b24194a46c5b3d87a5af413231e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:59.203075 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1074/2185] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:59 2022] DELETE /identity/v3/users/dcb78b24194a46c5b3d87a5af413231e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:59.208052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dbb51-fcc5-4e4f-8c2a-9c4de3549628 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:59.208498 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dbb51-fcc5-4e4f-8c2a-9c4de3549628 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:59.208587 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dbb51-fcc5-4e4f-8c2a-9c4de3549628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:59.235566 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-894dbb51-fcc5-4e4f-8c2a-9c4de3549628 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:27:59.235566 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-894dbb51-fcc5-4e4f-8c2a-9c4de3549628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:59.277292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:27:59.293909 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1112/2186] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:27:59.304455 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668173d2-8fcd-4773-8966-454969a79bd2 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:59.307166 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-668173d2-8fcd-4773-8966-454969a79bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:59.384204 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668173d2-8fcd-4773-8966-454969a79bd2 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:59.388078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31007bc-9cbf-4885-bdb2-52a9b0055da9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:59.389294 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31007bc-9cbf-4885-bdb2-52a9b0055da9 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:59.389294 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31007bc-9cbf-4885-bdb2-52a9b0055da9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:59.389557 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31007bc-9cbf-4885-bdb2-52a9b0055da9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:59.399699 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31007bc-9cbf-4885-bdb2-52a9b0055da9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:59.402736 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31007bc-9cbf-4885-bdb2-52a9b0055da9 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:59.414353 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1075/2187] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:27:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:27:59.776387 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894dbb51-fcc5-4e4f-8c2a-9c4de3549628 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:59.778513 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-894dbb51-fcc5-4e4f-8c2a-9c4de3549628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:27:59.796676 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894dbb51-fcc5-4e4f-8c2a-9c4de3549628 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:59.806263 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f1e6b-ea27-4b99-845d-36178d25cfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:59.806947 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f1e6b-ea27-4b99-845d-36178d25cfd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:59.807229 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f1e6b-ea27-4b99-845d-36178d25cfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:59.807504 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f1e6b-ea27-4b99-845d-36178d25cfd1 admin admin] PATH_INFO: `/v3/projects/0dae411a425e41efb0816549dea14b3d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:59.808772 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f1e6b-ea27-4b99-845d-36178d25cfd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dae411a425e41efb0816549dea14b3d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:59.811342 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f1e6b-ea27-4b99-845d-36178d25cfd1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:27:59.872310 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f04f1e6b-ea27-4b99-845d-36178d25cfd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dae411a425e41efb0816549dea14b3d', 'request_id': 'req-f04f1e6b-ea27-4b99-845d-36178d25cfd1'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:59.879968 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f04f1e6b-ea27-4b99-845d-36178d25cfd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dae411a425e41efb0816549dea14b3d', 'request_id': 'req-f04f1e6b-ea27-4b99-845d-36178d25cfd1'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:59.886371 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f04f1e6b-ea27-4b99-845d-36178d25cfd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dae411a425e41efb0816549dea14b3d', 'request_id': 'req-f04f1e6b-ea27-4b99-845d-36178d25cfd1'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:59.903689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f04f1e6b-ea27-4b99-845d-36178d25cfd1 admin admin] The token cache is being invalidate because project 0dae411a425e41efb0816549dea14b3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:27:59.904033 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f04f1e6b-ea27-4b99-845d-36178d25cfd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:59.904662 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f04f1e6b-ea27-4b99-845d-36178d25cfd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:27:59.906406 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1113/2188] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:27:59 2022] DELETE /identity/v3/projects/0dae411a425e41efb0816549dea14b3d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:27:59.910862 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31007bc-9cbf-4885-bdb2-52a9b0055da9 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:27:59.921733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31007bc-9cbf-4885-bdb2-52a9b0055da9 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:27:59.983716 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d96fb-0129-4d19-965f-81ea360ed269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:27:59.984603 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d96fb-0129-4d19-965f-81ea360ed269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:27:59.984916 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d96fb-0129-4d19-965f-81ea360ed269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:27:59.985192 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d96fb-0129-4d19-965f-81ea360ed269 admin admin] PATH_INFO: `/v3/users/595580c21ab24be5a481d98b547da662` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:27:59.986395 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d96fb-0129-4d19-965f-81ea360ed269 admin admin] RBAC: Authorizing `identity:delete_user(user_id=595580c21ab24be5a481d98b547da662)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:27:59.988845 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d96fb-0129-4d19-965f-81ea360ed269 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:00.013687 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:00.039530 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4a5d96fb-0129-4d19-965f-81ea360ed269 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '595580c21ab24be5a481d98b547da662'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:00.040166 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4a5d96fb-0129-4d19-965f-81ea360ed269 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '595580c21ab24be5a481d98b547da662'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:00.048319 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4a5d96fb-0129-4d19-965f-81ea360ed269 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '595580c21ab24be5a481d98b547da662'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:00.050942 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4a5d96fb-0129-4d19-965f-81ea360ed269 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '595580c21ab24be5a481d98b547da662'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:00.059929 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4a5d96fb-0129-4d19-965f-81ea360ed269 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '595580c21ab24be5a481d98b547da662'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:00.099797 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1076/2189] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:27:59 2022] DELETE /identity/v3/users/595580c21ab24be5a481d98b547da662 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:28:00.370814 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f1e6b-ea27-4b99-845d-36178d25cfd1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:00.372481 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f04f1e6b-ea27-4b99-845d-36178d25cfd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:00.391050 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f1e6b-ea27-4b99-845d-36178d25cfd1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:00.465614 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b24ca6-7ce8-46f3-a9ff-6e91df58455b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:00.466253 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b24ca6-7ce8-46f3-a9ff-6e91df58455b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:00.466615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b24ca6-7ce8-46f3-a9ff-6e91df58455b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:00.466890 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b24ca6-7ce8-46f3-a9ff-6e91df58455b admin admin] PATH_INFO: `/v3/projects/167a1cce9da64851a4a8902f01dcafd8` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:00.468043 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b24ca6-7ce8-46f3-a9ff-6e91df58455b admin admin] RBAC: Authorizing `identity:delete_project(project_id=167a1cce9da64851a4a8902f01dcafd8)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:00.470070 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b24ca6-7ce8-46f3-a9ff-6e91df58455b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:00.523865 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b0b24ca6-7ce8-46f3-a9ff-6e91df58455b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '167a1cce9da64851a4a8902f01dcafd8', 'request_id': 'req-b0b24ca6-7ce8-46f3-a9ff-6e91df58455b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:00.529705 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b0b24ca6-7ce8-46f3-a9ff-6e91df58455b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '167a1cce9da64851a4a8902f01dcafd8', 'request_id': 'req-b0b24ca6-7ce8-46f3-a9ff-6e91df58455b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:00.536716 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b0b24ca6-7ce8-46f3-a9ff-6e91df58455b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '167a1cce9da64851a4a8902f01dcafd8', 'request_id': 'req-b0b24ca6-7ce8-46f3-a9ff-6e91df58455b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:00.549083 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b0b24ca6-7ce8-46f3-a9ff-6e91df58455b admin admin] The token cache is being invalidate because project 167a1cce9da64851a4a8902f01dcafd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:28:00.549377 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b0b24ca6-7ce8-46f3-a9ff-6e91df58455b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:00.550026 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b0b24ca6-7ce8-46f3-a9ff-6e91df58455b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:00.552168 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1114/2190] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:28:00 2022] DELETE /identity/v3/projects/167a1cce9da64851a4a8902f01dcafd8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:00.556384 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d96fb-0129-4d19-965f-81ea360ed269 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:00.558260 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4a5d96fb-0129-4d19-965f-81ea360ed269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:00.572800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d96fb-0129-4d19-965f-81ea360ed269 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:00.646809 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d96190-1de4-4628-8a6d-f3cbcc2788b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:00.647573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d96190-1de4-4628-8a6d-f3cbcc2788b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:00.647925 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d96190-1de4-4628-8a6d-f3cbcc2788b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:00.648266 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d96190-1de4-4628-8a6d-f3cbcc2788b7 admin admin] PATH_INFO: `/v3/users/6e3102e7c1ed4e318da93d93845247bf` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:00.649502 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d96190-1de4-4628-8a6d-f3cbcc2788b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e3102e7c1ed4e318da93d93845247bf)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:00.651429 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d96190-1de4-4628-8a6d-f3cbcc2788b7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:00.708517 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-06d96190-1de4-4628-8a6d-f3cbcc2788b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e3102e7c1ed4e318da93d93845247bf'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:00.709645 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-06d96190-1de4-4628-8a6d-f3cbcc2788b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e3102e7c1ed4e318da93d93845247bf'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:00.730554 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-06d96190-1de4-4628-8a6d-f3cbcc2788b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e3102e7c1ed4e318da93d93845247bf'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:00.731206 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-06d96190-1de4-4628-8a6d-f3cbcc2788b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e3102e7c1ed4e318da93d93845247bf'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:00.739819 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-06d96190-1de4-4628-8a6d-f3cbcc2788b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e3102e7c1ed4e318da93d93845247bf'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:00.762584 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1077/2191] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:28:00 2022] DELETE /identity/v3/users/6e3102e7c1ed4e318da93d93845247bf => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:28:01.047725 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b24ca6-7ce8-46f3-a9ff-6e91df58455b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:01.049235 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b0b24ca6-7ce8-46f3-a9ff-6e91df58455b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:01.058853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:01.065880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b24ca6-7ce8-46f3-a9ff-6e91df58455b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:01.132070 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8d57b-395b-443a-8a59-a963af6a95b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:01.132763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8d57b-395b-443a-8a59-a963af6a95b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:01.133040 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8d57b-395b-443a-8a59-a963af6a95b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:01.133335 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8d57b-395b-443a-8a59-a963af6a95b6 admin admin] PATH_INFO: `/v3/projects/99e6e60d63a540229f40c7697983f688` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:01.134531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8d57b-395b-443a-8a59-a963af6a95b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99e6e60d63a540229f40c7697983f688)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:01.136444 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8d57b-395b-443a-8a59-a963af6a95b6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:01.187386 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-edb8d57b-395b-443a-8a59-a963af6a95b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99e6e60d63a540229f40c7697983f688', 'request_id': 'req-edb8d57b-395b-443a-8a59-a963af6a95b6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:01.193868 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-edb8d57b-395b-443a-8a59-a963af6a95b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99e6e60d63a540229f40c7697983f688', 'request_id': 'req-edb8d57b-395b-443a-8a59-a963af6a95b6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:01.200457 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-edb8d57b-395b-443a-8a59-a963af6a95b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99e6e60d63a540229f40c7697983f688', 'request_id': 'req-edb8d57b-395b-443a-8a59-a963af6a95b6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:01.212782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-edb8d57b-395b-443a-8a59-a963af6a95b6 admin admin] The token cache is being invalidate because project 99e6e60d63a540229f40c7697983f688 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:28:01.213051 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-edb8d57b-395b-443a-8a59-a963af6a95b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:01.213686 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-edb8d57b-395b-443a-8a59-a963af6a95b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:01.215149 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1115/2192] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:28:01 2022] DELETE /identity/v3/projects/99e6e60d63a540229f40c7697983f688 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:01.220095 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23695f93-bbce-447e-a4f4-ca0c4ce273f2 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:01.220559 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23695f93-bbce-447e-a4f4-ca0c4ce273f2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:01.220649 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23695f93-bbce-447e-a4f4-ca0c4ce273f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:01.243180 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-23695f93-bbce-447e-a4f4-ca0c4ce273f2 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:01.244541 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-23695f93-bbce-447e-a4f4-ca0c4ce273f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:01.263867 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:01.308992 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1078/2193] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:01.317755 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ffece-166a-4462-9c15-786b2d7f5d8b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:01.318155 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ffece-166a-4462-9c15-786b2d7f5d8b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:01.318436 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ffece-166a-4462-9c15-786b2d7f5d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:01.339125 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-379ffece-166a-4462-9c15-786b2d7f5d8b None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:01.340348 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-379ffece-166a-4462-9c15-786b2d7f5d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:01.350129 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1116/2194] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:01.359148 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23695f93-bbce-447e-a4f4-ca0c4ce273f2 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:01.369034 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23695f93-bbce-447e-a4f4-ca0c4ce273f2 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:01.373564 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873240c-acd9-4eaa-af93-2679678abccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:01.374159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873240c-acd9-4eaa-af93-2679678abccd admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:01.374431 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873240c-acd9-4eaa-af93-2679678abccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:01.374696 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873240c-acd9-4eaa-af93-2679678abccd admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:01.375331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873240c-acd9-4eaa-af93-2679678abccd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:28:01.375628 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873240c-acd9-4eaa-af93-2679678abccd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:01.377229 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873240c-acd9-4eaa-af93-2679678abccd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:01.393486 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1079/2195] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:28:01.394666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ffece-166a-4462-9c15-786b2d7f5d8b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:01.405191 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ffece-166a-4462-9c15-786b2d7f5d8b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:01.417887 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7bf08-f481-440e-ab4e-c6704a24b3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:01.418632 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7bf08-f481-440e-ab4e-c6704a24b3b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:01.418974 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7bf08-f481-440e-ab4e-c6704a24b3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:01.419791 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7bf08-f481-440e-ab4e-c6704a24b3b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:01.420058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7bf08-f481-440e-ab4e-c6704a24b3b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:01.422173 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7bf08-f481-440e-ab4e-c6704a24b3b5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:01.453533 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1117/2196] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:28:01 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:28:01.454542 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873240c-acd9-4eaa-af93-2679678abccd admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:01.464654 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873240c-acd9-4eaa-af93-2679678abccd admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:01.521144 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c8335-b414-4558-a87f-9b32a6e9812a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:01.521781 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c8335-b414-4558-a87f-9b32a6e9812a admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:01.522057 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c8335-b414-4558-a87f-9b32a6e9812a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:01.522335 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c8335-b414-4558-a87f-9b32a6e9812a admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:01.522972 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c8335-b414-4558-a87f-9b32a6e9812a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:01.524881 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c8335-b414-4558-a87f-9b32a6e9812a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:01.553078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1080/2197] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:28:01 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:28:01.557387 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7bf08-f481-440e-ab4e-c6704a24b3b5 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:01.568217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7bf08-f481-440e-ab4e-c6704a24b3b5 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:01.573110 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb58e0-b1f4-41ec-bd4e-6cdd2aa21039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:01.573797 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb58e0-b1f4-41ec-bd4e-6cdd2aa21039 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:01.574100 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb58e0-b1f4-41ec-bd4e-6cdd2aa21039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:01.574375 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb58e0-b1f4-41ec-bd4e-6cdd2aa21039 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:01.575031 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb58e0-b1f4-41ec-bd4e-6cdd2aa21039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:01.576928 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb58e0-b1f4-41ec-bd4e-6cdd2aa21039 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:01.594234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1118/2198] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:28:01.596141 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c8335-b414-4558-a87f-9b32a6e9812a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:01.607371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c8335-b414-4558-a87f-9b32a6e9812a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:01.612223 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db1eaa-ead0-49f8-8f71-9eb9127c7e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:01.612887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db1eaa-ead0-49f8-8f71-9eb9127c7e64 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:01.613175 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db1eaa-ead0-49f8-8f71-9eb9127c7e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:01.613466 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db1eaa-ead0-49f8-8f71-9eb9127c7e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:01.614110 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db1eaa-ead0-49f8-8f71-9eb9127c7e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:01.615846 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db1eaa-ead0-49f8-8f71-9eb9127c7e64 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:01.626380 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1081/2199] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:28:01.630626 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb58e0-b1f4-41ec-bd4e-6cdd2aa21039 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:01.640957 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb58e0-b1f4-41ec-bd4e-6cdd2aa21039 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:01.647008 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce599ea2-9d9b-4193-92e3-f3714b6a74b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:01.647659 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce599ea2-9d9b-4193-92e3-f3714b6a74b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:01.647941 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce599ea2-9d9b-4193-92e3-f3714b6a74b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:01.648217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce599ea2-9d9b-4193-92e3-f3714b6a74b6 admin admin] PATH_INFO: `/v3/projects/ae1e678c74834e0e8142f387f82b732a/users/a5904acc61984515aea5d359b616c070/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:01.664699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce599ea2-9d9b-4193-92e3-f3714b6a74b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae1e678c74834e0e8142f387f82b732a, user_id=a5904acc61984515aea5d359b616c070, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:01.667427 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce599ea2-9d9b-4193-92e3-f3714b6a74b6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:01.681320 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1119/2200] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:28:01 2022] PUT /identity/v3/projects/ae1e678c74834e0e8142f387f82b732a/users/a5904acc61984515aea5d359b616c070/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:01.692935 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa039d25-1fdb-453f-97b2-26f4867a95dd None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:01.693874 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa039d25-1fdb-453f-97b2-26f4867a95dd None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:01.694156 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa039d25-1fdb-453f-97b2-26f4867a95dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:01.723515 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-fa039d25-1fdb-453f-97b2-26f4867a95dd None None] MFA Rules not processed for user `a5904acc61984515aea5d359b616c070`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:01.724655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fa039d25-1fdb-453f-97b2-26f4867a95dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:01.796422 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1082/2201] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:01.808242 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce599ea2-9d9b-4193-92e3-f3714b6a74b6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:01.810053 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ce599ea2-9d9b-4193-92e3-f3714b6a74b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:01.846611 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:01.874472 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce599ea2-9d9b-4193-92e3-f3714b6a74b6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:01.878171 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d1c77-f58b-4345-87b9-4bc2e9483363 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:01.879331 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d1c77-f58b-4345-87b9-4bc2e9483363 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:01.879612 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d1c77-f58b-4345-87b9-4bc2e9483363 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:01.879883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d1c77-f58b-4345-87b9-4bc2e9483363 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:01.890354 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d1c77-f58b-4345-87b9-4bc2e9483363 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:01.891787 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d1c77-f58b-4345-87b9-4bc2e9483363 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:01.909179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1120/2202] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:28:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:28:01.936979 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa039d25-1fdb-453f-97b2-26f4867a95dd None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:01.958387 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:02.006289 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa039d25-1fdb-453f-97b2-26f4867a95dd None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:02.010951 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f38154-80b7-46a7-aa3d-97e7d045fee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:02.011586 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f38154-80b7-46a7-aa3d-97e7d045fee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:02.011867 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f38154-80b7-46a7-aa3d-97e7d045fee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:02.012141 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f38154-80b7-46a7-aa3d-97e7d045fee4 admin admin] PATH_INFO: `/v3/users/a5904acc61984515aea5d359b616c070` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:02.013308 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f38154-80b7-46a7-aa3d-97e7d045fee4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5904acc61984515aea5d359b616c070)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:02.015250 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f38154-80b7-46a7-aa3d-97e7d045fee4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:02.072661 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-76f38154-80b7-46a7-aa3d-97e7d045fee4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5904acc61984515aea5d359b616c070'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:02.073366 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-76f38154-80b7-46a7-aa3d-97e7d045fee4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5904acc61984515aea5d359b616c070'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:02.081523 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-76f38154-80b7-46a7-aa3d-97e7d045fee4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5904acc61984515aea5d359b616c070'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:02.082199 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-76f38154-80b7-46a7-aa3d-97e7d045fee4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5904acc61984515aea5d359b616c070'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:02.089288 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-76f38154-80b7-46a7-aa3d-97e7d045fee4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5904acc61984515aea5d359b616c070'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:02.110048 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1083/2203] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:28:01 2022] DELETE /identity/v3/users/a5904acc61984515aea5d359b616c070 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:02.115189 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eadb52-6298-46ac-8847-ef0d8fb297d8 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:02.115675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eadb52-6298-46ac-8847-ef0d8fb297d8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:02.115895 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eadb52-6298-46ac-8847-ef0d8fb297d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:02.139867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e7eadb52-6298-46ac-8847-ef0d8fb297d8 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:02.141135 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e7eadb52-6298-46ac-8847-ef0d8fb297d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:02.213455 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1121/2204] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:02.231526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f38154-80b7-46a7-aa3d-97e7d045fee4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:02.233173 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-76f38154-80b7-46a7-aa3d-97e7d045fee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:02.296542 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f38154-80b7-46a7-aa3d-97e7d045fee4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:02.302144 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c751e4-0b94-47bc-8b7b-03f663fbb05d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:02.302817 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c751e4-0b94-47bc-8b7b-03f663fbb05d service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:02.303084 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c751e4-0b94-47bc-8b7b-03f663fbb05d service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:02.303840 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c751e4-0b94-47bc-8b7b-03f663fbb05d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:02.315110 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c751e4-0b94-47bc-8b7b-03f663fbb05d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:02.316826 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c751e4-0b94-47bc-8b7b-03f663fbb05d service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:02.329293 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1084/2205] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:28:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:28:03.468712 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eadb52-6298-46ac-8847-ef0d8fb297d8 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:03.470753 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e7eadb52-6298-46ac-8847-ef0d8fb297d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:03.486752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eadb52-6298-46ac-8847-ef0d8fb297d8 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:03.528236 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0d530-2eb4-4bb1-9863-ffd8aab20c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:03.528869 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0d530-2eb4-4bb1-9863-ffd8aab20c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:03.532689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0d530-2eb4-4bb1-9863-ffd8aab20c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:03.532689 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0d530-2eb4-4bb1-9863-ffd8aab20c0d admin admin] PATH_INFO: `/v3/projects/ae1e678c74834e0e8142f387f82b732a` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:03.533010 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc0d530-2eb4-4bb1-9863-ffd8aab20c0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae1e678c74834e0e8142f387f82b732a)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:03.537946 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc0d530-2eb4-4bb1-9863-ffd8aab20c0d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:03.614272 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ccc0d530-2eb4-4bb1-9863-ffd8aab20c0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae1e678c74834e0e8142f387f82b732a', 'request_id': 'req-ccc0d530-2eb4-4bb1-9863-ffd8aab20c0d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:03.627328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ccc0d530-2eb4-4bb1-9863-ffd8aab20c0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae1e678c74834e0e8142f387f82b732a', 'request_id': 'req-ccc0d530-2eb4-4bb1-9863-ffd8aab20c0d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:03.635195 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ccc0d530-2eb4-4bb1-9863-ffd8aab20c0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae1e678c74834e0e8142f387f82b732a', 'request_id': 'req-ccc0d530-2eb4-4bb1-9863-ffd8aab20c0d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:03.652222 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ccc0d530-2eb4-4bb1-9863-ffd8aab20c0d admin admin] The token cache is being invalidate because project ae1e678c74834e0e8142f387f82b732a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:28:03.652511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ccc0d530-2eb4-4bb1-9863-ffd8aab20c0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:03.653192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ccc0d530-2eb4-4bb1-9863-ffd8aab20c0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:03.654783 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1122/2206] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:28:03 2022] DELETE /identity/v3/projects/ae1e678c74834e0e8142f387f82b732a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:03.660721 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f09b08-4704-4e5c-8967-c9beabfd90a2 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:03.661614 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f09b08-4704-4e5c-8967-c9beabfd90a2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:03.662091 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f09b08-4704-4e5c-8967-c9beabfd90a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:03.684681 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-89f09b08-4704-4e5c-8967-c9beabfd90a2 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:03.686294 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-89f09b08-4704-4e5c-8967-c9beabfd90a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:03.738225 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:03.785786 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1085/2207] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:03.787645 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83d530-05f8-4516-9328-426dee27ca84 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:03.787934 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83d530-05f8-4516-9328-426dee27ca84 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:03.788209 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83d530-05f8-4516-9328-426dee27ca84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:03.814801 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-af83d530-05f8-4516-9328-426dee27ca84 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:03.819349 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-af83d530-05f8-4516-9328-426dee27ca84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:03.832752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1123/2208] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:28:03.838259 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f09b08-4704-4e5c-8967-c9beabfd90a2 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:03.857640 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f09b08-4704-4e5c-8967-c9beabfd90a2 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:03.869521 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16770f2a-a8ce-49ad-b479-c8ed2d1615a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:03.870210 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16770f2a-a8ce-49ad-b479-c8ed2d1615a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:03.870492 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16770f2a-a8ce-49ad-b479-c8ed2d1615a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:03.870759 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16770f2a-a8ce-49ad-b479-c8ed2d1615a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:03.871419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16770f2a-a8ce-49ad-b479-c8ed2d1615a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:28:03.871717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16770f2a-a8ce-49ad-b479-c8ed2d1615a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:03.874016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16770f2a-a8ce-49ad-b479-c8ed2d1615a3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:03.890170 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1086/2209] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:28:03.894942 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83d530-05f8-4516-9328-426dee27ca84 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:03.906469 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83d530-05f8-4516-9328-426dee27ca84 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:03.912356 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a7b70-2c0a-4604-a03e-b3ad26448132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:03.913040 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a7b70-2c0a-4604-a03e-b3ad26448132 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:03.913301 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a7b70-2c0a-4604-a03e-b3ad26448132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:03.913714 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a7b70-2c0a-4604-a03e-b3ad26448132 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:03.914304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a7b70-2c0a-4604-a03e-b3ad26448132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:03.916387 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a7b70-2c0a-4604-a03e-b3ad26448132 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:03.946797 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1124/2210] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:28:03 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:28:03.951033 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16770f2a-a8ce-49ad-b479-c8ed2d1615a3 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:03.961715 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16770f2a-a8ce-49ad-b479-c8ed2d1615a3 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:04.020659 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1494d0-b826-434f-87dc-dba63c42054c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:04.021421 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1494d0-b826-434f-87dc-dba63c42054c admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:04.022155 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1494d0-b826-434f-87dc-dba63c42054c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:04.022155 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1494d0-b826-434f-87dc-dba63c42054c admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:04.022591 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1494d0-b826-434f-87dc-dba63c42054c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:04.024819 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1494d0-b826-434f-87dc-dba63c42054c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:04.057545 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1087/2211] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:28:03 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:28:04.061756 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a7b70-2c0a-4604-a03e-b3ad26448132 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:04.073023 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a7b70-2c0a-4604-a03e-b3ad26448132 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:04.078165 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e471a-7c5a-426c-8f2d-d6abbc72dd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:04.078761 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e471a-7c5a-426c-8f2d-d6abbc72dd97 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:04.079039 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e471a-7c5a-426c-8f2d-d6abbc72dd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:04.079305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e471a-7c5a-426c-8f2d-d6abbc72dd97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:04.079954 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e471a-7c5a-426c-8f2d-d6abbc72dd97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:04.082174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e471a-7c5a-426c-8f2d-d6abbc72dd97 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:04.097603 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1125/2212] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:28:04.099584 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1494d0-b826-434f-87dc-dba63c42054c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:04.109727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1494d0-b826-434f-87dc-dba63c42054c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:04.114573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5677b9-1ecc-4c1f-9c21-693f3ea30b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:04.115266 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5677b9-1ecc-4c1f-9c21-693f3ea30b99 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:04.115606 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5677b9-1ecc-4c1f-9c21-693f3ea30b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:04.115966 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5677b9-1ecc-4c1f-9c21-693f3ea30b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:04.116676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5677b9-1ecc-4c1f-9c21-693f3ea30b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:04.118375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5677b9-1ecc-4c1f-9c21-693f3ea30b99 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:04.131919 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1088/2213] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:28:04.135600 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e471a-7c5a-426c-8f2d-d6abbc72dd97 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:04.148511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e471a-7c5a-426c-8f2d-d6abbc72dd97 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:04.153608 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f86c96-b22f-4396-b0d8-de3b97c302ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:04.154298 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f86c96-b22f-4396-b0d8-de3b97c302ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:04.154582 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f86c96-b22f-4396-b0d8-de3b97c302ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:04.155270 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f86c96-b22f-4396-b0d8-de3b97c302ed admin admin] PATH_INFO: `/v3/projects/0bb1817d3fce4be6b3de057df15291b0/users/bf4b1166b4414791b490fe90615766e5/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:04.169002 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:04.172723 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f86c96-b22f-4396-b0d8-de3b97c302ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bb1817d3fce4be6b3de057df15291b0, user_id=bf4b1166b4414791b490fe90615766e5, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:04.175415 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f86c96-b22f-4396-b0d8-de3b97c302ed admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:04.195439 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1126/2214] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:28:04 2022] PUT /identity/v3/projects/0bb1817d3fce4be6b3de057df15291b0/users/bf4b1166b4414791b490fe90615766e5/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:04.205845 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64c249-665a-43f2-aa9c-f7058ede9e3b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:04.206157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64c249-665a-43f2-aa9c-f7058ede9e3b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:04.206992 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64c249-665a-43f2-aa9c-f7058ede9e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:04.244934 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ec64c249-665a-43f2-aa9c-f7058ede9e3b None None] MFA Rules not processed for user `bf4b1166b4414791b490fe90615766e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:04.246801 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ec64c249-665a-43f2-aa9c-f7058ede9e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:04.338493 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1089/2215] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:04.345906 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f86c96-b22f-4396-b0d8-de3b97c302ed admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:04.347672 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-43f86c96-b22f-4396-b0d8-de3b97c302ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:04.406216 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f86c96-b22f-4396-b0d8-de3b97c302ed admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:04.409914 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7aefaf-3b4d-4bcb-ad83-d3419f8c25c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:04.410515 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7aefaf-3b4d-4bcb-ad83-d3419f8c25c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:04.410795 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7aefaf-3b4d-4bcb-ad83-d3419f8c25c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:04.411066 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7aefaf-3b4d-4bcb-ad83-d3419f8c25c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:04.419189 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7aefaf-3b4d-4bcb-ad83-d3419f8c25c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:04.420616 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7aefaf-3b4d-4bcb-ad83-d3419f8c25c1 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:04.429357 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1127/2216] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:28:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:28:05.368206 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f9d8e-c53c-4f8c-844f-aba1348c1752 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:05.369032 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f9d8e-c53c-4f8c-844f-aba1348c1752 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:05.369312 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f9d8e-c53c-4f8c-844f-aba1348c1752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:05.391250 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-986f9d8e-c53c-4f8c-844f-aba1348c1752 None None] MFA Rules not processed for user `f87c6d0e007d44c1a935c73404a9b619`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:05.392462 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-986f9d8e-c53c-4f8c-844f-aba1348c1752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:05.435694 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:05.464363 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1090/2217] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:14.425484 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=29,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:14.558651 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7aefaf-3b4d-4bcb-ad83-d3419f8c25c1 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:14.620316 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7aefaf-3b4d-4bcb-ad83-d3419f8c25c1 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:14.624709 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec2be0-33e7-42b6-93f0-28b2c36937da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:14.625325 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec2be0-33e7-42b6-93f0-28b2c36937da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:14.625634 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec2be0-33e7-42b6-93f0-28b2c36937da admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:14.625907 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec2be0-33e7-42b6-93f0-28b2c36937da admin admin] PATH_INFO: `/v3/users/bf4b1166b4414791b490fe90615766e5` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:14.627007 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec2be0-33e7-42b6-93f0-28b2c36937da admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf4b1166b4414791b490fe90615766e5)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:14.629576 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec2be0-33e7-42b6-93f0-28b2c36937da admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:14.675716 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f9ec2be0-33e7-42b6-93f0-28b2c36937da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf4b1166b4414791b490fe90615766e5'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:14.676377 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f9ec2be0-33e7-42b6-93f0-28b2c36937da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf4b1166b4414791b490fe90615766e5'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:14.688838 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f9ec2be0-33e7-42b6-93f0-28b2c36937da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf4b1166b4414791b490fe90615766e5'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:14.696833 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f9ec2be0-33e7-42b6-93f0-28b2c36937da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf4b1166b4414791b490fe90615766e5'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:14.704238 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f9ec2be0-33e7-42b6-93f0-28b2c36937da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf4b1166b4414791b490fe90615766e5'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:14.710258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1128/2218] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:28:14 2022] DELETE /identity/v3/users/bf4b1166b4414791b490fe90615766e5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:14.715393 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a62ea5-7f2b-40db-8efb-2c37d2bb14f5 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:14.715927 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a62ea5-7f2b-40db-8efb-2c37d2bb14f5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:14.716097 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a62ea5-7f2b-40db-8efb-2c37d2bb14f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:14.735588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a1a62ea5-7f2b-40db-8efb-2c37d2bb14f5 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:14.736804 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a1a62ea5-7f2b-40db-8efb-2c37d2bb14f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:14.811423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1091/2219] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:28:14.821306 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec2be0-33e7-42b6-93f0-28b2c36937da admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:14.822869 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f9ec2be0-33e7-42b6-93f0-28b2c36937da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:14.908208 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec2be0-33e7-42b6-93f0-28b2c36937da admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:14.913334 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01866a-cb26-46dd-a3af-76d00672da77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:14.914211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01866a-cb26-46dd-a3af-76d00672da77 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:14.914664 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01866a-cb26-46dd-a3af-76d00672da77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:14.915108 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01866a-cb26-46dd-a3af-76d00672da77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:14.930253 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01866a-cb26-46dd-a3af-76d00672da77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:14.931558 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01866a-cb26-46dd-a3af-76d00672da77 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:14.952963 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1129/2220] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:28:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:28:15.286582 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a62ea5-7f2b-40db-8efb-2c37d2bb14f5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:15.288265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a1a62ea5-7f2b-40db-8efb-2c37d2bb14f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:15.301148 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a62ea5-7f2b-40db-8efb-2c37d2bb14f5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:15.306868 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365560cc-e41f-4de8-89bb-a8ee36c1015c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:15.307583 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365560cc-e41f-4de8-89bb-a8ee36c1015c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:15.307859 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365560cc-e41f-4de8-89bb-a8ee36c1015c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:15.308127 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365560cc-e41f-4de8-89bb-a8ee36c1015c admin admin] PATH_INFO: `/v3/projects/0bb1817d3fce4be6b3de057df15291b0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:15.309496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365560cc-e41f-4de8-89bb-a8ee36c1015c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bb1817d3fce4be6b3de057df15291b0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:15.312310 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365560cc-e41f-4de8-89bb-a8ee36c1015c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:15.378097 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-365560cc-e41f-4de8-89bb-a8ee36c1015c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bb1817d3fce4be6b3de057df15291b0', 'request_id': 'req-365560cc-e41f-4de8-89bb-a8ee36c1015c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:15.383657 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-365560cc-e41f-4de8-89bb-a8ee36c1015c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bb1817d3fce4be6b3de057df15291b0', 'request_id': 'req-365560cc-e41f-4de8-89bb-a8ee36c1015c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:15.390386 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-365560cc-e41f-4de8-89bb-a8ee36c1015c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bb1817d3fce4be6b3de057df15291b0', 'request_id': 'req-365560cc-e41f-4de8-89bb-a8ee36c1015c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:15.404461 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-365560cc-e41f-4de8-89bb-a8ee36c1015c admin admin] The token cache is being invalidate because project 0bb1817d3fce4be6b3de057df15291b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:28:15.404828 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-365560cc-e41f-4de8-89bb-a8ee36c1015c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:15.405486 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-365560cc-e41f-4de8-89bb-a8ee36c1015c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:15.407372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1092/2221] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:28:15 2022] DELETE /identity/v3/projects/0bb1817d3fce4be6b3de057df15291b0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:28:20.907484 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01866a-cb26-46dd-a3af-76d00672da77 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:20.909194 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7a01866a-cb26-46dd-a3af-76d00672da77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:20.923045 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01866a-cb26-46dd-a3af-76d00672da77 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:20.941723 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:20.983641 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39db67d-5ac1-477c-861f-d9146c9ecb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:20.984278 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39db67d-5ac1-477c-861f-d9146c9ecb4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:20.984558 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39db67d-5ac1-477c-861f-d9146c9ecb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:20.984830 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39db67d-5ac1-477c-861f-d9146c9ecb4b admin admin] PATH_INFO: `/v3/users/acd8574f4f58447d96c762198e9ae077` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:20.985988 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39db67d-5ac1-477c-861f-d9146c9ecb4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=acd8574f4f58447d96c762198e9ae077)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:20.988583 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39db67d-5ac1-477c-861f-d9146c9ecb4b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:21.036202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b39db67d-5ac1-477c-861f-d9146c9ecb4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acd8574f4f58447d96c762198e9ae077'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:21.036854 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b39db67d-5ac1-477c-861f-d9146c9ecb4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acd8574f4f58447d96c762198e9ae077'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:21.049089 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b39db67d-5ac1-477c-861f-d9146c9ecb4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acd8574f4f58447d96c762198e9ae077'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:21.055875 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b39db67d-5ac1-477c-861f-d9146c9ecb4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acd8574f4f58447d96c762198e9ae077'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:21.064446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b39db67d-5ac1-477c-861f-d9146c9ecb4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acd8574f4f58447d96c762198e9ae077'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:21.071715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1130/2222] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:28:20 2022] DELETE /identity/v3/users/acd8574f4f58447d96c762198e9ae077 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:21.254662 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365560cc-e41f-4de8-89bb-a8ee36c1015c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:21.258185 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-365560cc-e41f-4de8-89bb-a8ee36c1015c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:21.289571 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365560cc-e41f-4de8-89bb-a8ee36c1015c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:21.351330 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca0783-dae1-47be-9c43-f56851c6f887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:21.351965 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca0783-dae1-47be-9c43-f56851c6f887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:21.352242 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca0783-dae1-47be-9c43-f56851c6f887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:21.352514 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca0783-dae1-47be-9c43-f56851c6f887 admin admin] PATH_INFO: `/v3/projects/dba676f305dc4b139a7ea26521c9f712` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:21.353659 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca0783-dae1-47be-9c43-f56851c6f887 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dba676f305dc4b139a7ea26521c9f712)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:21.355566 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca0783-dae1-47be-9c43-f56851c6f887 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:21.357931 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:21.401893 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-91ca0783-dae1-47be-9c43-f56851c6f887 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dba676f305dc4b139a7ea26521c9f712', 'request_id': 'req-91ca0783-dae1-47be-9c43-f56851c6f887'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:21.407381 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-91ca0783-dae1-47be-9c43-f56851c6f887 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dba676f305dc4b139a7ea26521c9f712', 'request_id': 'req-91ca0783-dae1-47be-9c43-f56851c6f887'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:21.414193 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-91ca0783-dae1-47be-9c43-f56851c6f887 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dba676f305dc4b139a7ea26521c9f712', 'request_id': 'req-91ca0783-dae1-47be-9c43-f56851c6f887'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:21.426716 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-91ca0783-dae1-47be-9c43-f56851c6f887 admin admin] The token cache is being invalidate because project dba676f305dc4b139a7ea26521c9f712 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:28:21.427006 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-91ca0783-dae1-47be-9c43-f56851c6f887 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:21.427661 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-91ca0783-dae1-47be-9c43-f56851c6f887 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:21.429140 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1093/2223] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:28:21 2022] DELETE /identity/v3/projects/dba676f305dc4b139a7ea26521c9f712 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:28:21.433133 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39db67d-5ac1-477c-861f-d9146c9ecb4b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:21.434544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b39db67d-5ac1-477c-861f-d9146c9ecb4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:21.447716 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39db67d-5ac1-477c-861f-d9146c9ecb4b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:21.502781 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18357d5f-99cc-461b-a68d-af24149b3391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:21.503405 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18357d5f-99cc-461b-a68d-af24149b3391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:21.503686 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18357d5f-99cc-461b-a68d-af24149b3391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:21.503963 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18357d5f-99cc-461b-a68d-af24149b3391 admin admin] PATH_INFO: `/v3/users/6134c54d4895427099fe7dec08c20292` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:21.505073 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18357d5f-99cc-461b-a68d-af24149b3391 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6134c54d4895427099fe7dec08c20292)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:21.507039 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18357d5f-99cc-461b-a68d-af24149b3391 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:21.551545 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:21.554603 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-18357d5f-99cc-461b-a68d-af24149b3391 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6134c54d4895427099fe7dec08c20292'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:21.555480 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-18357d5f-99cc-461b-a68d-af24149b3391 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6134c54d4895427099fe7dec08c20292'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:21.568656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-18357d5f-99cc-461b-a68d-af24149b3391 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6134c54d4895427099fe7dec08c20292'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:21.575529 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-18357d5f-99cc-461b-a68d-af24149b3391 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6134c54d4895427099fe7dec08c20292'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:21.582010 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-18357d5f-99cc-461b-a68d-af24149b3391 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6134c54d4895427099fe7dec08c20292'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:21.587949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1131/2224] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:28:21 2022] DELETE /identity/v3/users/6134c54d4895427099fe7dec08c20292 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:21.631270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca0783-dae1-47be-9c43-f56851c6f887 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:21.632767 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-91ca0783-dae1-47be-9c43-f56851c6f887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:21.645547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca0783-dae1-47be-9c43-f56851c6f887 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:21.707686 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b66aeb-b217-4720-ac64-c842171d03e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:21.708361 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b66aeb-b217-4720-ac64-c842171d03e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:21.708641 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b66aeb-b217-4720-ac64-c842171d03e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:21.708916 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b66aeb-b217-4720-ac64-c842171d03e8 admin admin] PATH_INFO: `/v3/users/c7f88239641542139eed7c0c10cad19b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:21.710294 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b66aeb-b217-4720-ac64-c842171d03e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7f88239641542139eed7c0c10cad19b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:21.713498 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b66aeb-b217-4720-ac64-c842171d03e8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:21.763381 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-30b66aeb-b217-4720-ac64-c842171d03e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7f88239641542139eed7c0c10cad19b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:21.764127 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-30b66aeb-b217-4720-ac64-c842171d03e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7f88239641542139eed7c0c10cad19b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:21.772293 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-30b66aeb-b217-4720-ac64-c842171d03e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7f88239641542139eed7c0c10cad19b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:21.773035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-30b66aeb-b217-4720-ac64-c842171d03e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7f88239641542139eed7c0c10cad19b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:21.781420 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-30b66aeb-b217-4720-ac64-c842171d03e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7f88239641542139eed7c0c10cad19b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:21.789214 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18357d5f-99cc-461b-a68d-af24149b3391 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:21.795289 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-18357d5f-99cc-461b-a68d-af24149b3391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:21.807355 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1094/2225] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:28:21 2022] DELETE /identity/v3/users/c7f88239641542139eed7c0c10cad19b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:21.811834 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aff276-5ab4-4765-8695-63ffba4013b4 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:21.813092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aff276-5ab4-4765-8695-63ffba4013b4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:21.813471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aff276-5ab4-4765-8695-63ffba4013b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:21.817502 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18357d5f-99cc-461b-a68d-af24149b3391 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:21.836937 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b5aff276-5ab4-4765-8695-63ffba4013b4 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:21.838259 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b5aff276-5ab4-4765-8695-63ffba4013b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:21.844062 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:21.900011 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ba519-e689-4694-ad2d-9719182ba97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:21.900672 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ba519-e689-4694-ad2d-9719182ba97d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:21.900941 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ba519-e689-4694-ad2d-9719182ba97d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:21.901217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ba519-e689-4694-ad2d-9719182ba97d admin admin] PATH_INFO: `/v3/projects/a4d6d57909484b17939d74c1cd38a610` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:21.902774 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ba519-e689-4694-ad2d-9719182ba97d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4d6d57909484b17939d74c1cd38a610)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:21.904693 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ba519-e689-4694-ad2d-9719182ba97d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:21.912122 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1095/2226] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:28:21.922737 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aff276-5ab4-4765-8695-63ffba4013b4 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:21.926258 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b5aff276-5ab4-4765-8695-63ffba4013b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:21.958081 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5d4ba519-e689-4694-ad2d-9719182ba97d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4d6d57909484b17939d74c1cd38a610', 'request_id': 'req-5d4ba519-e689-4694-ad2d-9719182ba97d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:21.963809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5d4ba519-e689-4694-ad2d-9719182ba97d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4d6d57909484b17939d74c1cd38a610', 'request_id': 'req-5d4ba519-e689-4694-ad2d-9719182ba97d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:21.970295 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5d4ba519-e689-4694-ad2d-9719182ba97d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4d6d57909484b17939d74c1cd38a610', 'request_id': 'req-5d4ba519-e689-4694-ad2d-9719182ba97d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:21.987190 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5d4ba519-e689-4694-ad2d-9719182ba97d admin admin] The token cache is being invalidate because project a4d6d57909484b17939d74c1cd38a610 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:28:21.988252 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5d4ba519-e689-4694-ad2d-9719182ba97d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:21.989314 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5d4ba519-e689-4694-ad2d-9719182ba97d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:21.992399 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1132/2227] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:28:21 2022] DELETE /identity/v3/projects/a4d6d57909484b17939d74c1cd38a610 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:21.997237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2462ea-1294-424a-8e97-5619d374ed0d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:21.997747 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2462ea-1294-424a-8e97-5619d374ed0d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:21.998130 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2462ea-1294-424a-8e97-5619d374ed0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:22.009270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aff276-5ab4-4765-8695-63ffba4013b4 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:22.019745 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-be2462ea-1294-424a-8e97-5619d374ed0d None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:22.020961 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-be2462ea-1294-424a-8e97-5619d374ed0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:22.067068 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff98d32-4162-4cde-811f-38aa1db183ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:22.067785 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff98d32-4162-4cde-811f-38aa1db183ca service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:22.068337 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff98d32-4162-4cde-811f-38aa1db183ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:22.068503 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff98d32-4162-4cde-811f-38aa1db183ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:22.071784 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1ff98d32-4162-4cde-811f-38aa1db183ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:22.083867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:22.105079 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1133/2228] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:28:22.114355 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068139a-349c-4daf-9797-ec359a477185 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:22.114355 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068139a-349c-4daf-9797-ec359a477185 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:22.114606 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068139a-349c-4daf-9797-ec359a477185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:22.144819 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5068139a-349c-4daf-9797-ec359a477185 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:22.146160 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5068139a-349c-4daf-9797-ec359a477185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:22.154407 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1134/2229] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:28:22.158832 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068139a-349c-4daf-9797-ec359a477185 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:22.160348 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff98d32-4162-4cde-811f-38aa1db183ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:22.161896 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff98d32-4162-4cde-811f-38aa1db183ca service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:22.167983 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068139a-349c-4daf-9797-ec359a477185 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:22.171971 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1096/2230] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:28:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:28:22.173052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ad998-e5fb-495e-8e5c-3207696f854d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:22.173748 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ad998-e5fb-495e-8e5c-3207696f854d admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:22.174058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ad998-e5fb-495e-8e5c-3207696f854d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:22.174324 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ad998-e5fb-495e-8e5c-3207696f854d admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:22.174970 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ad998-e5fb-495e-8e5c-3207696f854d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:28:22.175273 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ad998-e5fb-495e-8e5c-3207696f854d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:22.176942 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ad998-e5fb-495e-8e5c-3207696f854d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:22.189308 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1135/2231] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:28:22.193983 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff98d32-4162-4cde-811f-38aa1db183ca service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:22.203427 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff98d32-4162-4cde-811f-38aa1db183ca service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:22.209760 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f8ec2-59af-40a5-8d2a-0c6ba15b40ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:22.210406 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f8ec2-59af-40a5-8d2a-0c6ba15b40ad admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:22.210683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f8ec2-59af-40a5-8d2a-0c6ba15b40ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:22.211003 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f8ec2-59af-40a5-8d2a-0c6ba15b40ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:22.211715 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f8ec2-59af-40a5-8d2a-0c6ba15b40ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:22.214044 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f8ec2-59af-40a5-8d2a-0c6ba15b40ad admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:22.230038 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:22.243449 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1097/2232] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:28:22 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:28:22.247994 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ad998-e5fb-495e-8e5c-3207696f854d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:22.258891 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ad998-e5fb-495e-8e5c-3207696f854d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:22.340986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242134b0-8763-49f0-bd34-db9a5c1110e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:22.342874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242134b0-8763-49f0-bd34-db9a5c1110e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:22.342874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242134b0-8763-49f0-bd34-db9a5c1110e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:22.342874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242134b0-8763-49f0-bd34-db9a5c1110e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:22.343484 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242134b0-8763-49f0-bd34-db9a5c1110e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:22.345816 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242134b0-8763-49f0-bd34-db9a5c1110e5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:22.371983 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1136/2233] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:28:22 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:28:22.376864 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f8ec2-59af-40a5-8d2a-0c6ba15b40ad admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:22.397027 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f8ec2-59af-40a5-8d2a-0c6ba15b40ad admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:22.402846 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4672b1-0beb-4615-8868-d330f34961f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:22.403317 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4672b1-0beb-4615-8868-d330f34961f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:22.403642 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4672b1-0beb-4615-8868-d330f34961f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:22.403983 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4672b1-0beb-4615-8868-d330f34961f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:22.404729 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4672b1-0beb-4615-8868-d330f34961f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:22.407223 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4672b1-0beb-4615-8868-d330f34961f1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:22.419862 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1098/2234] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:28:22.424151 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242134b0-8763-49f0-bd34-db9a5c1110e5 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:22.441188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242134b0-8763-49f0-bd34-db9a5c1110e5 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:22.446686 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568b773-8459-43dd-ac4f-8f7e6f795772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:22.447363 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568b773-8459-43dd-ac4f-8f7e6f795772 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:22.447709 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568b773-8459-43dd-ac4f-8f7e6f795772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:22.448042 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568b773-8459-43dd-ac4f-8f7e6f795772 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:22.448754 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568b773-8459-43dd-ac4f-8f7e6f795772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:22.450374 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568b773-8459-43dd-ac4f-8f7e6f795772 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:22.465457 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1137/2235] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:28:22.466984 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4672b1-0beb-4615-8868-d330f34961f1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:22.478638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4672b1-0beb-4615-8868-d330f34961f1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:22.484368 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f37c50-c742-4b1b-ba62-ec69c079d421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:22.485152 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f37c50-c742-4b1b-ba62-ec69c079d421 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:22.485655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f37c50-c742-4b1b-ba62-ec69c079d421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:22.486007 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f37c50-c742-4b1b-ba62-ec69c079d421 admin admin] PATH_INFO: `/v3/projects/d0681f4419c04838a10c754c8005fc30/users/482a3eaac3c44c789a85d43368f25892/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:22.500198 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568b773-8459-43dd-ac4f-8f7e6f795772 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:22.503617 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b568b773-8459-43dd-ac4f-8f7e6f795772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:22.513659 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f37c50-c742-4b1b-ba62-ec69c079d421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0681f4419c04838a10c754c8005fc30, user_id=482a3eaac3c44c789a85d43368f25892, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:22.516980 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f37c50-c742-4b1b-ba62-ec69c079d421 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:22.539371 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568b773-8459-43dd-ac4f-8f7e6f795772 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:22.560246 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1099/2236] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:28:22 2022] PUT /identity/v3/projects/d0681f4419c04838a10c754c8005fc30/users/482a3eaac3c44c789a85d43368f25892/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:28:22.572733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b7272-0008-4448-ade1-13cf04465687 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:22.573023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b7272-0008-4448-ade1-13cf04465687 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:22.573291 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b7272-0008-4448-ade1-13cf04465687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:22.602961 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-421b7272-0008-4448-ade1-13cf04465687 None None] MFA Rules not processed for user `482a3eaac3c44c789a85d43368f25892`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:22.604251 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-421b7272-0008-4448-ade1-13cf04465687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:22.615014 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e79f5-b3e7-4dfe-b5a6-22978b67f19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:22.615641 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e79f5-b3e7-4dfe-b5a6-22978b67f19f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:22.615924 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e79f5-b3e7-4dfe-b5a6-22978b67f19f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:22.616196 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e79f5-b3e7-4dfe-b5a6-22978b67f19f admin admin] PATH_INFO: `/v3/projects/6dba1b7b50dd49159379caf60dbcdd19` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:22.617317 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e79f5-b3e7-4dfe-b5a6-22978b67f19f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dba1b7b50dd49159379caf60dbcdd19)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:22.619264 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e79f5-b3e7-4dfe-b5a6-22978b67f19f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:22.665179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-781e79f5-b3e7-4dfe-b5a6-22978b67f19f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dba1b7b50dd49159379caf60dbcdd19', 'request_id': 'req-781e79f5-b3e7-4dfe-b5a6-22978b67f19f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:22.667273 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:22.670327 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1100/2237] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:22.672442 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-781e79f5-b3e7-4dfe-b5a6-22978b67f19f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dba1b7b50dd49159379caf60dbcdd19', 'request_id': 'req-781e79f5-b3e7-4dfe-b5a6-22978b67f19f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:22.680166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-781e79f5-b3e7-4dfe-b5a6-22978b67f19f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dba1b7b50dd49159379caf60dbcdd19', 'request_id': 'req-781e79f5-b3e7-4dfe-b5a6-22978b67f19f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:22.683399 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b7272-0008-4448-ade1-13cf04465687 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:22.685220 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-421b7272-0008-4448-ade1-13cf04465687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:22.695210 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-781e79f5-b3e7-4dfe-b5a6-22978b67f19f admin admin] The token cache is being invalidate because project 6dba1b7b50dd49159379caf60dbcdd19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:28:22.695504 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-781e79f5-b3e7-4dfe-b5a6-22978b67f19f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:22.696259 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-781e79f5-b3e7-4dfe-b5a6-22978b67f19f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:22.701491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1138/2238] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:28:22 2022] DELETE /identity/v3/projects/6dba1b7b50dd49159379caf60dbcdd19 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:22.703037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad21efc-0044-4a63-a7b8-928403eaf593 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:22.703395 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad21efc-0044-4a63-a7b8-928403eaf593 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:22.703742 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad21efc-0044-4a63-a7b8-928403eaf593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:22.724875 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-dad21efc-0044-4a63-a7b8-928403eaf593 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:22.726122 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-dad21efc-0044-4a63-a7b8-928403eaf593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:22.742656 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b7272-0008-4448-ade1-13cf04465687 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:22.785870 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1139/2239] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:28:22.792235 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a1edc-047c-41cf-a56d-bd826c362041 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:22.792987 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a1edc-047c-41cf-a56d-bd826c362041 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:22.793288 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a1edc-047c-41cf-a56d-bd826c362041 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:22.793585 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a1edc-047c-41cf-a56d-bd826c362041 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:22.794475 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b516dc-1124-43c9-b167-daeef0b1603f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:22.794786 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b516dc-1124-43c9-b167-daeef0b1603f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:22.795067 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b516dc-1124-43c9-b167-daeef0b1603f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:22.795375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f91a1edc-047c-41cf-a56d-bd826c362041 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:22.815220 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:22.815394 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c9b516dc-1124-43c9-b167-daeef0b1603f None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:22.816440 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c9b516dc-1124-43c9-b167-daeef0b1603f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:22.825254 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1140/2240] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:28:22.829417 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b516dc-1124-43c9-b167-daeef0b1603f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:22.838809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b516dc-1124-43c9-b167-daeef0b1603f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:22.843401 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a52ba-1513-4686-8f8f-b79904b876d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:22.843981 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a52ba-1513-4686-8f8f-b79904b876d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:22.844261 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a52ba-1513-4686-8f8f-b79904b876d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:22.844539 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a52ba-1513-4686-8f8f-b79904b876d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:22.845173 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a52ba-1513-4686-8f8f-b79904b876d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:28:22.845506 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a52ba-1513-4686-8f8f-b79904b876d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:22.847660 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a52ba-1513-4686-8f8f-b79904b876d0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:22.856031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a1edc-047c-41cf-a56d-bd826c362041 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:22.857501 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a1edc-047c-41cf-a56d-bd826c362041 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:22.859545 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1141/2241] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:28:22.863696 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a52ba-1513-4686-8f8f-b79904b876d0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:22.867124 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1101/2242] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:28:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:28:22.873122 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a52ba-1513-4686-8f8f-b79904b876d0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:22.878842 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd103dfc-ac12-48f6-82ea-3e34be0c9ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:22.879542 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd103dfc-ac12-48f6-82ea-3e34be0c9ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:22.879823 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd103dfc-ac12-48f6-82ea-3e34be0c9ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:22.880093 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd103dfc-ac12-48f6-82ea-3e34be0c9ab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:22.880748 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd103dfc-ac12-48f6-82ea-3e34be0c9ab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:22.885867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd103dfc-ac12-48f6-82ea-3e34be0c9ab2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:22.886772 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a1edc-047c-41cf-a56d-bd826c362041 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:22.888362 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f91a1edc-047c-41cf-a56d-bd826c362041 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:22.903284 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a1edc-047c-41cf-a56d-bd826c362041 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:22.908692 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd7d74-b5d8-4273-9e70-5a5874057c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:22.909325 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd7d74-b5d8-4273-9e70-5a5874057c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:22.909635 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd7d74-b5d8-4273-9e70-5a5874057c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:22.909907 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd7d74-b5d8-4273-9e70-5a5874057c08 admin admin] PATH_INFO: `/v3/users/482a3eaac3c44c789a85d43368f25892` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:22.911145 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd7d74-b5d8-4273-9e70-5a5874057c08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=482a3eaac3c44c789a85d43368f25892)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:22.911983 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1142/2243] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:28:22 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:28:22.913277 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd7d74-b5d8-4273-9e70-5a5874057c08 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:22.915985 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd103dfc-ac12-48f6-82ea-3e34be0c9ab2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:22.968006 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3bbd7d74-b5d8-4273-9e70-5a5874057c08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '482a3eaac3c44c789a85d43368f25892'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:22.968821 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3bbd7d74-b5d8-4273-9e70-5a5874057c08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '482a3eaac3c44c789a85d43368f25892'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:22.977532 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3bbd7d74-b5d8-4273-9e70-5a5874057c08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '482a3eaac3c44c789a85d43368f25892'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:22.978177 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3bbd7d74-b5d8-4273-9e70-5a5874057c08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '482a3eaac3c44c789a85d43368f25892'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:22.985267 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3bbd7d74-b5d8-4273-9e70-5a5874057c08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '482a3eaac3c44c789a85d43368f25892'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:22.985851 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd103dfc-ac12-48f6-82ea-3e34be0c9ab2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:22.990727 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10e52b-e626-4a46-950b-f4bbf6233094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:22.991325 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10e52b-e626-4a46-950b-f4bbf6233094 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:22.991605 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10e52b-e626-4a46-950b-f4bbf6233094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:22.991878 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10e52b-e626-4a46-950b-f4bbf6233094 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:22.992511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10e52b-e626-4a46-950b-f4bbf6233094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:22.994479 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10e52b-e626-4a46-950b-f4bbf6233094 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:23.003299 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1102/2244] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:28:22 2022] DELETE /identity/v3/users/482a3eaac3c44c789a85d43368f25892 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:28:23.008052 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c82d0-86ea-410c-843f-e022c465e5d2 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:23.008365 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c82d0-86ea-410c-843f-e022c465e5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:23.008640 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c82d0-86ea-410c-843f-e022c465e5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:23.019695 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1143/2245] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:28:22 2022] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:28:23.021200 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10e52b-e626-4a46-950b-f4bbf6233094 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:23.023367 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7b10e52b-e626-4a46-950b-f4bbf6233094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:23.031364 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e78c82d0-86ea-410c-843f-e022c465e5d2 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:23.032553 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e78c82d0-86ea-410c-843f-e022c465e5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:23.037904 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10e52b-e626-4a46-950b-f4bbf6233094 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:23.063960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:23.105079 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d675d-a4ba-4955-a30e-07351c37fa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:23.105632 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d675d-a4ba-4955-a30e-07351c37fa6d admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:23.105916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d675d-a4ba-4955-a30e-07351c37fa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:23.106197 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d675d-a4ba-4955-a30e-07351c37fa6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:23.107046 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d675d-a4ba-4955-a30e-07351c37fa6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:23.107160 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1103/2246] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:23.108597 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d675d-a4ba-4955-a30e-07351c37fa6d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:23.116570 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c82d0-86ea-410c-843f-e022c465e5d2 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:23.117939 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e78c82d0-86ea-410c-843f-e022c465e5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:23.118741 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1144/2247] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:28:23.123870 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d675d-a4ba-4955-a30e-07351c37fa6d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:23.134138 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d675d-a4ba-4955-a30e-07351c37fa6d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:23.138790 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e8071-7099-43fc-835f-1d7a795b1cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:23.139374 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e8071-7099-43fc-835f-1d7a795b1cdf admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:23.139657 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e8071-7099-43fc-835f-1d7a795b1cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:23.139945 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e8071-7099-43fc-835f-1d7a795b1cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:23.140560 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e8071-7099-43fc-835f-1d7a795b1cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:23.142196 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e8071-7099-43fc-835f-1d7a795b1cdf admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:23.155945 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:23.157632 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1145/2248] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:28:23.160757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e8071-7099-43fc-835f-1d7a795b1cdf admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:23.171854 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e8071-7099-43fc-835f-1d7a795b1cdf admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:23.176974 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4cd1e0-c8d4-4124-915c-a06a6ef6358d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:23.177907 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cd1e0-c8d4-4124-915c-a06a6ef6358d admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:23.178060 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cd1e0-c8d4-4124-915c-a06a6ef6358d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:23.178334 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cd1e0-c8d4-4124-915c-a06a6ef6358d admin admin] PATH_INFO: `/v3/projects/496437b9154a44049b685c71621bc565/users/b66bb5ea816f440ba50ab2a5c0271e32/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:23.184560 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c82d0-86ea-410c-843f-e022c465e5d2 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:23.188722 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee8893-8e40-4537-96e2-b851721edadb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:23.189337 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee8893-8e40-4537-96e2-b851721edadb service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:23.190165 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee8893-8e40-4537-96e2-b851721edadb service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:23.190440 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee8893-8e40-4537-96e2-b851721edadb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:23.202346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4cd1e0-c8d4-4124-915c-a06a6ef6358d admin admin] RBAC: Authorizing `identity:create_grant(project_id=496437b9154a44049b685c71621bc565, user_id=b66bb5ea816f440ba50ab2a5c0271e32, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:23.202553 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee8893-8e40-4537-96e2-b851721edadb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:23.204019 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee8893-8e40-4537-96e2-b851721edadb service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:23.204615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4cd1e0-c8d4-4124-915c-a06a6ef6358d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:23.215866 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1104/2249] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:28:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:28:23.219392 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1146/2250] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:28:23 2022] PUT /identity/v3/projects/496437b9154a44049b685c71621bc565/users/b66bb5ea816f440ba50ab2a5c0271e32/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:23.235244 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c072c29-3e30-4d81-9e9e-e043edef1a03 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:23.235586 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c072c29-3e30-4d81-9e9e-e043edef1a03 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:23.235870 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c072c29-3e30-4d81-9e9e-e043edef1a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:23.269341 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3c072c29-3e30-4d81-9e9e-e043edef1a03 None None] MFA Rules not processed for user `b66bb5ea816f440ba50ab2a5c0271e32`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:23.270895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3c072c29-3e30-4d81-9e9e-e043edef1a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:23.353038 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1105/2251] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:23.365908 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4cd1e0-c8d4-4124-915c-a06a6ef6358d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:23.370075 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9e4cd1e0-c8d4-4124-915c-a06a6ef6358d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:23.446592 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4cd1e0-c8d4-4124-915c-a06a6ef6358d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:23.450691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8ea3c-6c8a-4de4-bc40-a72ed1c6fdf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:23.451380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8ea3c-6c8a-4de4-bc40-a72ed1c6fdf3 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:23.451826 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8ea3c-6c8a-4de4-bc40-a72ed1c6fdf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:23.452230 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8ea3c-6c8a-4de4-bc40-a72ed1c6fdf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:23.464456 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8ea3c-6c8a-4de4-bc40-a72ed1c6fdf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:23.466244 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8ea3c-6c8a-4de4-bc40-a72ed1c6fdf3 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:23.478002 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1147/2252] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:28:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:28:23.520226 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c072c29-3e30-4d81-9e9e-e043edef1a03 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:23.521708 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3c072c29-3e30-4d81-9e9e-e043edef1a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:23.614791 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8ea3c-6c8a-4de4-bc40-a72ed1c6fdf3 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:23.618782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-67a8ea3c-6c8a-4de4-bc40-a72ed1c6fdf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:23.645778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c072c29-3e30-4d81-9e9e-e043edef1a03 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:23.650216 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8ea3c-6c8a-4de4-bc40-a72ed1c6fdf3 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:23.660157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4017268-c870-484a-9a48-5d1564747a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:23.661223 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4017268-c870-484a-9a48-5d1564747a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:23.661531 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4017268-c870-484a-9a48-5d1564747a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:23.661811 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4017268-c870-484a-9a48-5d1564747a15 admin admin] PATH_INFO: `/v3/projects/d0681f4419c04838a10c754c8005fc30` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:23.662372 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4907f-bd9f-4e11-9d69-81c0c2a248bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:23.663117 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4907f-bd9f-4e11-9d69-81c0c2a248bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:23.663406 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4907f-bd9f-4e11-9d69-81c0c2a248bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:23.663685 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4907f-bd9f-4e11-9d69-81c0c2a248bc admin admin] PATH_INFO: `/v3/users/1313b21bb0604f08822728547913cec2` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:23.667096 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4017268-c870-484a-9a48-5d1564747a15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0681f4419c04838a10c754c8005fc30)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:23.667880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4907f-bd9f-4e11-9d69-81c0c2a248bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1313b21bb0604f08822728547913cec2)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:23.669060 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4017268-c870-484a-9a48-5d1564747a15 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:23.670064 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4907f-bd9f-4e11-9d69-81c0c2a248bc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:23.757941 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-79d4907f-bd9f-4e11-9d69-81c0c2a248bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1313b21bb0604f08822728547913cec2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:23.759730 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-79d4907f-bd9f-4e11-9d69-81c0c2a248bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1313b21bb0604f08822728547913cec2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:23.767504 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f4017268-c870-484a-9a48-5d1564747a15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0681f4419c04838a10c754c8005fc30', 'request_id': 'req-f4017268-c870-484a-9a48-5d1564747a15'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:23.774571 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f4017268-c870-484a-9a48-5d1564747a15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0681f4419c04838a10c754c8005fc30', 'request_id': 'req-f4017268-c870-484a-9a48-5d1564747a15'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:23.781943 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f4017268-c870-484a-9a48-5d1564747a15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0681f4419c04838a10c754c8005fc30', 'request_id': 'req-f4017268-c870-484a-9a48-5d1564747a15'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:23.782468 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-79d4907f-bd9f-4e11-9d69-81c0c2a248bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1313b21bb0604f08822728547913cec2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:23.788166 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:23.793315 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-79d4907f-bd9f-4e11-9d69-81c0c2a248bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1313b21bb0604f08822728547913cec2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:23.803172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f4017268-c870-484a-9a48-5d1564747a15 admin admin] The token cache is being invalidate because project d0681f4419c04838a10c754c8005fc30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:28:23.803503 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f4017268-c870-484a-9a48-5d1564747a15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:23.804169 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f4017268-c870-484a-9a48-5d1564747a15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:23.805179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-79d4907f-bd9f-4e11-9d69-81c0c2a248bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1313b21bb0604f08822728547913cec2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:23.806915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1106/2253] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:28:23 2022] DELETE /identity/v3/projects/d0681f4419c04838a10c754c8005fc30 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:23.811308 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20184f80-553d-4e1a-b881-b3a20cd7ecf5 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:23.813572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20184f80-553d-4e1a-b881-b3a20cd7ecf5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:23.814153 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20184f80-553d-4e1a-b881-b3a20cd7ecf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:23.818501 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1148/2254] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:28:23 2022] DELETE /identity/v3/users/1313b21bb0604f08822728547913cec2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:23.820808 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4018a78-bdbe-4efe-97c4-f26a4950ef3b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:23.821539 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4018a78-bdbe-4efe-97c4-f26a4950ef3b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:23.821821 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4018a78-bdbe-4efe-97c4-f26a4950ef3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:23.843865 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:23.866759 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-20184f80-553d-4e1a-b881-b3a20cd7ecf5 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:23.869933 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-20184f80-553d-4e1a-b881-b3a20cd7ecf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:23.872732 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e4018a78-bdbe-4efe-97c4-f26a4950ef3b None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:23.875521 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e4018a78-bdbe-4efe-97c4-f26a4950ef3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:23.992059 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1107/2255] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:24.001504 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8198ab6-e1ad-4a8a-8391-153478f4f0c5 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:24.001889 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8198ab6-e1ad-4a8a-8391-153478f4f0c5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:24.002157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8198ab6-e1ad-4a8a-8391-153478f4f0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:24.037004 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1149/2256] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:24.040943 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f8198ab6-e1ad-4a8a-8391-153478f4f0c5 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:24.042220 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f8198ab6-e1ad-4a8a-8391-153478f4f0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:24.049361 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4018a78-bdbe-4efe-97c4-f26a4950ef3b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:24.051232 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e4018a78-bdbe-4efe-97c4-f26a4950ef3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:24.057557 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1108/2257] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:24.059964 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8198ab6-e1ad-4a8a-8391-153478f4f0c5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:24.073907 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8198ab6-e1ad-4a8a-8391-153478f4f0c5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:24.080771 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bca7c9-bbb0-4ae6-a0a6-0b16ab349e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:24.081875 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bca7c9-bbb0-4ae6-a0a6-0b16ab349e2c admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:24.082458 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bca7c9-bbb0-4ae6-a0a6-0b16ab349e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:24.083130 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bca7c9-bbb0-4ae6-a0a6-0b16ab349e2c admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:24.084160 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bca7c9-bbb0-4ae6-a0a6-0b16ab349e2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:28:24.084676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bca7c9-bbb0-4ae6-a0a6-0b16ab349e2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:24.086615 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bca7c9-bbb0-4ae6-a0a6-0b16ab349e2c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:24.104809 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1109/2258] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:28:24.110132 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bca7c9-bbb0-4ae6-a0a6-0b16ab349e2c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:24.126298 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bca7c9-bbb0-4ae6-a0a6-0b16ab349e2c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:24.136437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25074853-ab7e-4ddd-96b1-c5ff951ee653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:24.138154 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25074853-ab7e-4ddd-96b1-c5ff951ee653 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:24.139842 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25074853-ab7e-4ddd-96b1-c5ff951ee653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:24.140371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25074853-ab7e-4ddd-96b1-c5ff951ee653 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:24.142027 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25074853-ab7e-4ddd-96b1-c5ff951ee653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:24.147758 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25074853-ab7e-4ddd-96b1-c5ff951ee653 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:24.154861 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4018a78-bdbe-4efe-97c4-f26a4950ef3b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:24.159362 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31311022-c39a-463e-ae6e-2f89555e0b91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:24.160394 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31311022-c39a-463e-ae6e-2f89555e0b91 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:24.160674 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31311022-c39a-463e-ae6e-2f89555e0b91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:24.161105 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31311022-c39a-463e-ae6e-2f89555e0b91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:24.175312 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31311022-c39a-463e-ae6e-2f89555e0b91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:24.177475 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31311022-c39a-463e-ae6e-2f89555e0b91 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:24.189024 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1150/2259] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:28:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:28:24.200596 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1110/2260] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:28:24 2022] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:28:24.202534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31311022-c39a-463e-ae6e-2f89555e0b91 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:24.227204 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31311022-c39a-463e-ae6e-2f89555e0b91 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:24.314451 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd184e4-55dc-4a1b-9bfa-417cc08f92ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:24.315879 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd184e4-55dc-4a1b-9bfa-417cc08f92ed admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:24.316235 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd184e4-55dc-4a1b-9bfa-417cc08f92ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:24.316584 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd184e4-55dc-4a1b-9bfa-417cc08f92ed admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:24.317305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd184e4-55dc-4a1b-9bfa-417cc08f92ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:24.319484 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd184e4-55dc-4a1b-9bfa-417cc08f92ed admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:24.345462 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1151/2261] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:28:24 2022] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:28:24.346916 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25074853-ab7e-4ddd-96b1-c5ff951ee653 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:24.358471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25074853-ab7e-4ddd-96b1-c5ff951ee653 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:24.364711 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc132946-4edd-4067-9e97-7189e13221a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:24.365618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc132946-4edd-4067-9e97-7189e13221a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:24.365977 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc132946-4edd-4067-9e97-7189e13221a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:24.366357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc132946-4edd-4067-9e97-7189e13221a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:24.367045 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc132946-4edd-4067-9e97-7189e13221a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:24.368739 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc132946-4edd-4067-9e97-7189e13221a9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:24.381273 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1111/2262] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:28:24.385374 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd184e4-55dc-4a1b-9bfa-417cc08f92ed admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:24.395903 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd184e4-55dc-4a1b-9bfa-417cc08f92ed admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:24.401481 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f6928-5343-46dc-9195-8ea5cb02d655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:24.402574 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f6928-5343-46dc-9195-8ea5cb02d655 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:24.402574 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f6928-5343-46dc-9195-8ea5cb02d655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:24.402777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f6928-5343-46dc-9195-8ea5cb02d655 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:24.403416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f6928-5343-46dc-9195-8ea5cb02d655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:24.405072 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f6928-5343-46dc-9195-8ea5cb02d655 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:24.418123 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1152/2263] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:28:24.422549 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc132946-4edd-4067-9e97-7189e13221a9 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:24.433267 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc132946-4edd-4067-9e97-7189e13221a9 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:24.438247 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281c752-33fb-4c93-8129-2d0c772c1996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:24.438908 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281c752-33fb-4c93-8129-2d0c772c1996 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:24.439191 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281c752-33fb-4c93-8129-2d0c772c1996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:24.439497 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281c752-33fb-4c93-8129-2d0c772c1996 admin admin] PATH_INFO: `/v3/projects/48c00138f43544dab8b07e5c31c04126/users/b31e2b3c227c4689bee203a16244f58b/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:24.457534 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281c752-33fb-4c93-8129-2d0c772c1996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48c00138f43544dab8b07e5c31c04126, user_id=b31e2b3c227c4689bee203a16244f58b, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:24.460975 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281c752-33fb-4c93-8129-2d0c772c1996 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:24.475988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1112/2264] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:28:24 2022] PUT /identity/v3/projects/48c00138f43544dab8b07e5c31c04126/users/b31e2b3c227c4689bee203a16244f58b/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:24.487519 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804cb13-18a7-403d-a0ca-f35e303fb8c6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:24.487900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804cb13-18a7-403d-a0ca-f35e303fb8c6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:24.488176 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804cb13-18a7-403d-a0ca-f35e303fb8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:24.517302 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d804cb13-18a7-403d-a0ca-f35e303fb8c6 None None] MFA Rules not processed for user `b31e2b3c227c4689bee203a16244f58b`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:24.518642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d804cb13-18a7-403d-a0ca-f35e303fb8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:24.539905 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:24.608419 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1153/2265] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:24.613181 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281c752-33fb-4c93-8129-2d0c772c1996 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:24.679963 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281c752-33fb-4c93-8129-2d0c772c1996 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:24.685908 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c65580-91ee-487f-bba0-18428357345a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:24.686532 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c65580-91ee-487f-bba0-18428357345a admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:24.686824 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c65580-91ee-487f-bba0-18428357345a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:24.687112 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c65580-91ee-487f-bba0-18428357345a admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:24.688027 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c65580-91ee-487f-bba0-18428357345a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:24.689997 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c65580-91ee-487f-bba0-18428357345a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:24.727291 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1113/2266] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:28:24 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:28:24.731573 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804cb13-18a7-403d-a0ca-f35e303fb8c6 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:24.748583 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804cb13-18a7-403d-a0ca-f35e303fb8c6 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:24.818470 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072d4b8-c470-4c76-9f52-95de52174d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:24.819110 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072d4b8-c470-4c76-9f52-95de52174d86 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:24.819378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072d4b8-c470-4c76-9f52-95de52174d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:24.819646 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072d4b8-c470-4c76-9f52-95de52174d86 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:24.820313 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072d4b8-c470-4c76-9f52-95de52174d86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:24.822326 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072d4b8-c470-4c76-9f52-95de52174d86 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:24.847614 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1154/2267] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:28:24 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:28:24.852061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c65580-91ee-487f-bba0-18428357345a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:24.860061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:24.864558 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c65580-91ee-487f-bba0-18428357345a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:24.872724 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bfa36-5951-440c-9011-47e733663524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:24.873335 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bfa36-5951-440c-9011-47e733663524 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:24.874977 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bfa36-5951-440c-9011-47e733663524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:24.875484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bfa36-5951-440c-9011-47e733663524 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:24.876323 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3bfa36-5951-440c-9011-47e733663524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:24.878213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3bfa36-5951-440c-9011-47e733663524 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:24.886156 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072d4b8-c470-4c76-9f52-95de52174d86 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:24.888513 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0072d4b8-c470-4c76-9f52-95de52174d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:24.893547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1114/2268] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:28:24.897230 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bfa36-5951-440c-9011-47e733663524 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:24.911055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bfa36-5951-440c-9011-47e733663524 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:24.911430 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072d4b8-c470-4c76-9f52-95de52174d86 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:24.916672 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdbad3-e15f-4146-85e0-cfbe8f3c28e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:24.917515 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3ac24-dd64-4253-bfdd-4f86978836c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:24.917649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdbad3-e15f-4146-85e0-cfbe8f3c28e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:24.918906 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3ac24-dd64-4253-bfdd-4f86978836c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:24.919125 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdbad3-e15f-4146-85e0-cfbe8f3c28e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:24.919539 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdbad3-e15f-4146-85e0-cfbe8f3c28e2 admin admin] PATH_INFO: `/v3/projects/1366951be0994b8ca5c8c17373ffcaad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:24.919923 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3ac24-dd64-4253-bfdd-4f86978836c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:24.920495 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3ac24-dd64-4253-bfdd-4f86978836c1 admin admin] PATH_INFO: `/v3/projects/225e63f1e2094ccb8584773feec4b0b7/users/e705c1f144e7487a8c600a08d242c08c/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:24.921364 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cdbad3-e15f-4146-85e0-cfbe8f3c28e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1366951be0994b8ca5c8c17373ffcaad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:24.923549 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cdbad3-e15f-4146-85e0-cfbe8f3c28e2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:24.939100 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3ac24-dd64-4253-bfdd-4f86978836c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=225e63f1e2094ccb8584773feec4b0b7, user_id=e705c1f144e7487a8c600a08d242c08c, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:24.942053 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3ac24-dd64-4253-bfdd-4f86978836c1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:24.963235 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1115/2269] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:28:24 2022] PUT /identity/v3/projects/225e63f1e2094ccb8584773feec4b0b7/users/e705c1f144e7487a8c600a08d242c08c/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:28:24.968127 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3ac24-dd64-4253-bfdd-4f86978836c1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:24.985311 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-14cdbad3-e15f-4146-85e0-cfbe8f3c28e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1366951be0994b8ca5c8c17373ffcaad', 'request_id': 'req-14cdbad3-e15f-4146-85e0-cfbe8f3c28e2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:24.995967 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-14cdbad3-e15f-4146-85e0-cfbe8f3c28e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1366951be0994b8ca5c8c17373ffcaad', 'request_id': 'req-14cdbad3-e15f-4146-85e0-cfbe8f3c28e2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:25.006817 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-14cdbad3-e15f-4146-85e0-cfbe8f3c28e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1366951be0994b8ca5c8c17373ffcaad', 'request_id': 'req-14cdbad3-e15f-4146-85e0-cfbe8f3c28e2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:25.029451 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-14cdbad3-e15f-4146-85e0-cfbe8f3c28e2 admin admin] The token cache is being invalidate because project 1366951be0994b8ca5c8c17373ffcaad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:28:25.029597 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-14cdbad3-e15f-4146-85e0-cfbe8f3c28e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:25.030748 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-14cdbad3-e15f-4146-85e0-cfbe8f3c28e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:25.038127 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1155/2270] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:28:24 2022] DELETE /identity/v3/projects/1366951be0994b8ca5c8c17373ffcaad => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:28:25.040618 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdbad3-e15f-4146-85e0-cfbe8f3c28e2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:25.043648 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-14cdbad3-e15f-4146-85e0-cfbe8f3c28e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:25.045759 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3ac24-dd64-4253-bfdd-4f86978836c1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:25.097996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:25.129562 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a41a92-ee11-4687-9bf5-0624ed0cd83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:25.130576 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a41a92-ee11-4687-9bf5-0624ed0cd83e admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:25.130863 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a41a92-ee11-4687-9bf5-0624ed0cd83e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:25.131389 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a41a92-ee11-4687-9bf5-0624ed0cd83e admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:25.133176 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a41a92-ee11-4687-9bf5-0624ed0cd83e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:25.135533 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a41a92-ee11-4687-9bf5-0624ed0cd83e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:25.137442 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdbad3-e15f-4146-85e0-cfbe8f3c28e2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:25.145973 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cdc70-15cf-4d72-81e0-5adf148bb368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:25.146609 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cdc70-15cf-4d72-81e0-5adf148bb368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:25.146962 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cdc70-15cf-4d72-81e0-5adf148bb368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:25.147299 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cdc70-15cf-4d72-81e0-5adf148bb368 admin admin] PATH_INFO: `/v3/users/09290539522442a78069c1a6d5b36ac0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:25.148276 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1116/2271] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:28:25.148499 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215cdc70-15cf-4d72-81e0-5adf148bb368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09290539522442a78069c1a6d5b36ac0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:25.150776 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215cdc70-15cf-4d72-81e0-5adf148bb368 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:25.152471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a41a92-ee11-4687-9bf5-0624ed0cd83e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:25.162108 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f6a41a92-ee11-4687-9bf5-0624ed0cd83e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:25.177084 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a41a92-ee11-4687-9bf5-0624ed0cd83e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:25.183043 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6f18d-75b7-4674-9144-cc969ab75009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:25.183808 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6f18d-75b7-4674-9144-cc969ab75009 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:25.184552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6f18d-75b7-4674-9144-cc969ab75009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:25.184552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6f18d-75b7-4674-9144-cc969ab75009 admin admin] PATH_INFO: `/v3/projects/225e63f1e2094ccb8584773feec4b0b7/users/e705c1f144e7487a8c600a08d242c08c/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:25.186527 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6f18d-75b7-4674-9144-cc969ab75009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=225e63f1e2094ccb8584773feec4b0b7, user_id=e705c1f144e7487a8c600a08d242c08c, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:25.190469 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6f18d-75b7-4674-9144-cc969ab75009 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:25.201570 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1117/2272] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:28:25 2022] PUT /identity/v3/projects/225e63f1e2094ccb8584773feec4b0b7/users/e705c1f144e7487a8c600a08d242c08c/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:28:25.212037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-215cdc70-15cf-4d72-81e0-5adf148bb368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09290539522442a78069c1a6d5b36ac0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:25.212037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-215cdc70-15cf-4d72-81e0-5adf148bb368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09290539522442a78069c1a6d5b36ac0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:25.214091 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac1483-06d1-4b05-ac05-1750b9b32ed1 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:25.214379 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac1483-06d1-4b05-ac05-1750b9b32ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:25.214714 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac1483-06d1-4b05-ac05-1750b9b32ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:25.223856 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-215cdc70-15cf-4d72-81e0-5adf148bb368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09290539522442a78069c1a6d5b36ac0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:25.231241 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-215cdc70-15cf-4d72-81e0-5adf148bb368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09290539522442a78069c1a6d5b36ac0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:25.238561 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-215cdc70-15cf-4d72-81e0-5adf148bb368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09290539522442a78069c1a6d5b36ac0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:25.244984 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1156/2273] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:28:25 2022] DELETE /identity/v3/users/09290539522442a78069c1a6d5b36ac0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:25.253736 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d7ac1483-06d1-4b05-ac05-1750b9b32ed1 None None] MFA Rules not processed for user `e705c1f144e7487a8c600a08d242c08c`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:25.255156 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d7ac1483-06d1-4b05-ac05-1750b9b32ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:25.336556 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:25.377835 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1118/2274] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:25.390128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cdc70-15cf-4d72-81e0-5adf148bb368 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:25.391691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-215cdc70-15cf-4d72-81e0-5adf148bb368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:25.527911 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cdc70-15cf-4d72-81e0-5adf148bb368 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:25.534315 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564b8c3-0cb1-4ebe-a423-8113e77fb3ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:25.535877 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564b8c3-0cb1-4ebe-a423-8113e77fb3ef service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:25.536128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564b8c3-0cb1-4ebe-a423-8113e77fb3ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:25.536482 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564b8c3-0cb1-4ebe-a423-8113e77fb3ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:25.538785 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0564b8c3-0cb1-4ebe-a423-8113e77fb3ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:25.699521 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564b8c3-0cb1-4ebe-a423-8113e77fb3ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:25.701283 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564b8c3-0cb1-4ebe-a423-8113e77fb3ef service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:25.715419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac1483-06d1-4b05-ac05-1750b9b32ed1 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:25.718805 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d7ac1483-06d1-4b05-ac05-1750b9b32ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:25.731105 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1157/2275] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:28:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:28:25.871109 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac1483-06d1-4b05-ac05-1750b9b32ed1 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:25.878028 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48681566-6315-4b54-9e69-17bcb0afb6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:25.878701 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48681566-6315-4b54-9e69-17bcb0afb6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:25.880483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48681566-6315-4b54-9e69-17bcb0afb6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:25.880483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48681566-6315-4b54-9e69-17bcb0afb6f7 admin admin] PATH_INFO: `/v3/projects/7f1044050e0b44ba9347b761b2ee7e0b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:25.881159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48681566-6315-4b54-9e69-17bcb0afb6f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f1044050e0b44ba9347b761b2ee7e0b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:25.884161 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48681566-6315-4b54-9e69-17bcb0afb6f7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:25.943396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-48681566-6315-4b54-9e69-17bcb0afb6f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f1044050e0b44ba9347b761b2ee7e0b', 'request_id': 'req-48681566-6315-4b54-9e69-17bcb0afb6f7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:25.951190 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-48681566-6315-4b54-9e69-17bcb0afb6f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f1044050e0b44ba9347b761b2ee7e0b', 'request_id': 'req-48681566-6315-4b54-9e69-17bcb0afb6f7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:25.958731 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-48681566-6315-4b54-9e69-17bcb0afb6f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f1044050e0b44ba9347b761b2ee7e0b', 'request_id': 'req-48681566-6315-4b54-9e69-17bcb0afb6f7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:25.981425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-48681566-6315-4b54-9e69-17bcb0afb6f7 admin admin] The token cache is being invalidate because project 7f1044050e0b44ba9347b761b2ee7e0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:28:25.981778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-48681566-6315-4b54-9e69-17bcb0afb6f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:25.982551 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-48681566-6315-4b54-9e69-17bcb0afb6f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:25.987956 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1119/2276] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:28:25 2022] DELETE /identity/v3/projects/7f1044050e0b44ba9347b761b2ee7e0b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:28:25.989753 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b4abb-eb54-417c-84d2-84fba5db0f54 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:25.990078 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b4abb-eb54-417c-84d2-84fba5db0f54 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:25.990363 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b4abb-eb54-417c-84d2-84fba5db0f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:25.998877 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:26.013259 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3d6b4abb-eb54-417c-84d2-84fba5db0f54 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:26.015649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3d6b4abb-eb54-417c-84d2-84fba5db0f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:26.085525 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1158/2277] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:26.096404 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c07dd0-ffbf-4865-822b-c5c81f407017 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:26.097099 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c07dd0-ffbf-4865-822b-c5c81f407017 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:26.097564 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c07dd0-ffbf-4865-822b-c5c81f407017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:26.138388 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-49c07dd0-ffbf-4865-822b-c5c81f407017 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:26.139755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-49c07dd0-ffbf-4865-822b-c5c81f407017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:26.149013 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1120/2278] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:26.153508 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b4abb-eb54-417c-84d2-84fba5db0f54 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:26.171245 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b4abb-eb54-417c-84d2-84fba5db0f54 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:26.182476 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56eec6-4c7e-4600-88ae-4573d688e5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:26.182476 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56eec6-4c7e-4600-88ae-4573d688e5f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:26.182476 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56eec6-4c7e-4600-88ae-4573d688e5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:26.182476 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56eec6-4c7e-4600-88ae-4573d688e5f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:26.186270 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56eec6-4c7e-4600-88ae-4573d688e5f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:28:26.186928 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56eec6-4c7e-4600-88ae-4573d688e5f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:26.188937 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56eec6-4c7e-4600-88ae-4573d688e5f1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:26.206994 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1159/2279] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:28:26.209242 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c07dd0-ffbf-4865-822b-c5c81f407017 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:26.221556 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c07dd0-ffbf-4865-822b-c5c81f407017 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:26.229922 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f696e2-78ff-400b-b2d0-8bf71d7d84e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:26.230612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f696e2-78ff-400b-b2d0-8bf71d7d84e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:26.230851 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f696e2-78ff-400b-b2d0-8bf71d7d84e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:26.231117 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f696e2-78ff-400b-b2d0-8bf71d7d84e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:26.231772 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f696e2-78ff-400b-b2d0-8bf71d7d84e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:26.233764 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f696e2-78ff-400b-b2d0-8bf71d7d84e1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:26.265454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1121/2280] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:28:26 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:28:26.271661 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56eec6-4c7e-4600-88ae-4573d688e5f1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:26.292825 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56eec6-4c7e-4600-88ae-4573d688e5f1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:26.366701 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1507ca2-2975-4e89-af17-bf3ac5feb5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:26.367418 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1507ca2-2975-4e89-af17-bf3ac5feb5d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:26.367994 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1507ca2-2975-4e89-af17-bf3ac5feb5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:26.368385 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1507ca2-2975-4e89-af17-bf3ac5feb5d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:26.369666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1507ca2-2975-4e89-af17-bf3ac5feb5d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:26.372551 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1507ca2-2975-4e89-af17-bf3ac5feb5d1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:26.399493 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1160/2281] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:28:26 2022] POST /identity/v3/users => generated 287 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:28:26.404071 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f696e2-78ff-400b-b2d0-8bf71d7d84e1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:26.415619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f696e2-78ff-400b-b2d0-8bf71d7d84e1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:26.422656 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155757ce-39b4-46a1-9c81-d30b38213fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:26.423345 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155757ce-39b4-46a1-9c81-d30b38213fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:26.424246 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155757ce-39b4-46a1-9c81-d30b38213fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:26.424605 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155757ce-39b4-46a1-9c81-d30b38213fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:26.425723 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155757ce-39b4-46a1-9c81-d30b38213fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:26.427381 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155757ce-39b4-46a1-9c81-d30b38213fb0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:26.443202 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1122/2282] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:28:26.444813 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1507ca2-2975-4e89-af17-bf3ac5feb5d1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:26.456709 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1507ca2-2975-4e89-af17-bf3ac5feb5d1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:26.461805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07322d9-1a23-41ad-96ed-3c220962a5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:26.462809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07322d9-1a23-41ad-96ed-3c220962a5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:26.462809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07322d9-1a23-41ad-96ed-3c220962a5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:26.463129 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07322d9-1a23-41ad-96ed-3c220962a5d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:26.463851 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07322d9-1a23-41ad-96ed-3c220962a5d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:26.465715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07322d9-1a23-41ad-96ed-3c220962a5d4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:26.483113 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1161/2283] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:28:26.488370 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155757ce-39b4-46a1-9c81-d30b38213fb0 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:26.500178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155757ce-39b4-46a1-9c81-d30b38213fb0 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:26.506821 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f968bd9-6954-45b9-a4c7-39aef2c69c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:26.507635 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f968bd9-6954-45b9-a4c7-39aef2c69c1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:26.508495 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f968bd9-6954-45b9-a4c7-39aef2c69c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:26.508495 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f968bd9-6954-45b9-a4c7-39aef2c69c1b admin admin] PATH_INFO: `/v3/projects/2c354491f0bc4f508aacb24e7605bbbb/users/7cfe0ecab1364e70a2646693d655f25f/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:26.525584 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f968bd9-6954-45b9-a4c7-39aef2c69c1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c354491f0bc4f508aacb24e7605bbbb, user_id=7cfe0ecab1364e70a2646693d655f25f, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:26.531304 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f968bd9-6954-45b9-a4c7-39aef2c69c1b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:26.546554 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1123/2284] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:28:26 2022] PUT /identity/v3/projects/2c354491f0bc4f508aacb24e7605bbbb/users/7cfe0ecab1364e70a2646693d655f25f/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:26.556717 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3461f5-71a5-4eb7-82c1-374a12f99f97 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:26.557010 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3461f5-71a5-4eb7-82c1-374a12f99f97 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:26.557285 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3461f5-71a5-4eb7-82c1-374a12f99f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:26.589704 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ed3461f5-71a5-4eb7-82c1-374a12f99f97 None None] MFA Rules not processed for user `7cfe0ecab1364e70a2646693d655f25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:26.591431 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ed3461f5-71a5-4eb7-82c1-374a12f99f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:26.677029 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:26.681163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1162/2285] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:26.685429 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f968bd9-6954-45b9-a4c7-39aef2c69c1b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:26.701752 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:26.770604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f968bd9-6954-45b9-a4c7-39aef2c69c1b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:26.778669 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18bf8e-19e1-4749-996d-facb36afe35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:26.779325 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18bf8e-19e1-4749-996d-facb36afe35e admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:26.779620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18bf8e-19e1-4749-996d-facb36afe35e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:26.779878 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18bf8e-19e1-4749-996d-facb36afe35e admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:26.780630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18bf8e-19e1-4749-996d-facb36afe35e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:26.783709 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18bf8e-19e1-4749-996d-facb36afe35e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:26.823752 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1124/2286] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:28:26 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:28:26.827411 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3461f5-71a5-4eb7-82c1-374a12f99f97 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:26.842929 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3461f5-71a5-4eb7-82c1-374a12f99f97 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:26.933731 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78718420-b61d-4a60-9790-452169d61ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:26.934507 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78718420-b61d-4a60-9790-452169d61ef9 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:26.934925 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78718420-b61d-4a60-9790-452169d61ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:26.935258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78718420-b61d-4a60-9790-452169d61ef9 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:26.936013 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78718420-b61d-4a60-9790-452169d61ef9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:26.938677 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78718420-b61d-4a60-9790-452169d61ef9 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:26.979852 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1163/2287] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:28:26 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:28:26.983974 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18bf8e-19e1-4749-996d-facb36afe35e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:26.995369 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18bf8e-19e1-4749-996d-facb36afe35e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:27.000605 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9476a-99a0-4a14-9888-63273fa993dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:27.001217 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9476a-99a0-4a14-9888-63273fa993dd admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:27.001536 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9476a-99a0-4a14-9888-63273fa993dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:27.001869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9476a-99a0-4a14-9888-63273fa993dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:27.002522 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9476a-99a0-4a14-9888-63273fa993dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:27.004137 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9476a-99a0-4a14-9888-63273fa993dd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:27.023099 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1125/2288] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:28:27.024663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78718420-b61d-4a60-9790-452169d61ef9 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:27.040357 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78718420-b61d-4a60-9790-452169d61ef9 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:27.045889 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca78236-a133-4c43-83a4-9c6f39d34825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:27.046986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca78236-a133-4c43-83a4-9c6f39d34825 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:27.047268 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca78236-a133-4c43-83a4-9c6f39d34825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:27.047697 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca78236-a133-4c43-83a4-9c6f39d34825 admin admin] PATH_INFO: `/v3/projects/7723d4327c0f458bb4bc84f38a7e4102/users/83cdd9078de649dda27a56d1c6168ca7/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:27.068792 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca78236-a133-4c43-83a4-9c6f39d34825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7723d4327c0f458bb4bc84f38a7e4102, user_id=83cdd9078de649dda27a56d1c6168ca7, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:27.071344 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca78236-a133-4c43-83a4-9c6f39d34825 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:27.098713 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1164/2289] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:28:27 2022] PUT /identity/v3/projects/7723d4327c0f458bb4bc84f38a7e4102/users/83cdd9078de649dda27a56d1c6168ca7/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:27.105640 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9476a-99a0-4a14-9888-63273fa993dd admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:27.116249 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9476a-99a0-4a14-9888-63273fa993dd admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:27.178805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e4f26-3e7e-4538-ba2a-bfa2f72b5c3b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:27.179175 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e4f26-3e7e-4538-ba2a-bfa2f72b5c3b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:27.179547 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e4f26-3e7e-4538-ba2a-bfa2f72b5c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:27.192192 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4dc49-62d1-4a38-9935-8fa56c6fa6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:27.192843 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4dc49-62d1-4a38-9935-8fa56c6fa6aa admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:27.193124 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4dc49-62d1-4a38-9935-8fa56c6fa6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:27.193415 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4dc49-62d1-4a38-9935-8fa56c6fa6aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:27.194188 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4dc49-62d1-4a38-9935-8fa56c6fa6aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:27.195790 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4dc49-62d1-4a38-9935-8fa56c6fa6aa admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:27.201933 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ff3e4f26-3e7e-4538-ba2a-bfa2f72b5c3b None None] MFA Rules not processed for user `eb6bfd9c259748d0a705cf2780b5c194`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:27.203436 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ff3e4f26-3e7e-4538-ba2a-bfa2f72b5c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:27.206543 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1126/2290] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:28:27.211329 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4dc49-62d1-4a38-9935-8fa56c6fa6aa admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:27.222340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4dc49-62d1-4a38-9935-8fa56c6fa6aa admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:27.227276 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8ddde-d15d-444e-9283-00c9b90b0abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:27.228010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8ddde-d15d-444e-9283-00c9b90b0abd admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:27.228522 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8ddde-d15d-444e-9283-00c9b90b0abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:27.228870 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8ddde-d15d-444e-9283-00c9b90b0abd admin admin] PATH_INFO: `/v3/projects/7723d4327c0f458bb4bc84f38a7e4102/users/83cdd9078de649dda27a56d1c6168ca7/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:27.230955 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8ddde-d15d-444e-9283-00c9b90b0abd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7723d4327c0f458bb4bc84f38a7e4102, user_id=83cdd9078de649dda27a56d1c6168ca7, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:27.233856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8ddde-d15d-444e-9283-00c9b90b0abd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:27.245436 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1127/2291] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:28:27 2022] PUT /identity/v3/projects/7723d4327c0f458bb4bc84f38a7e4102/users/83cdd9078de649dda27a56d1c6168ca7/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:27.256627 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5773d83-17e4-4805-9975-a90849b8a730 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:27.256914 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5773d83-17e4-4805-9975-a90849b8a730 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:27.257184 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5773d83-17e4-4805-9975-a90849b8a730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:27.275286 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1165/2292] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:27.288549 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f5773d83-17e4-4805-9975-a90849b8a730 None None] MFA Rules not processed for user `83cdd9078de649dda27a56d1c6168ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:27.289993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f5773d83-17e4-4805-9975-a90849b8a730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:27.371221 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:27.386248 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1128/2293] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:27.398723 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e4f26-3e7e-4538-ba2a-bfa2f72b5c3b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:27.400211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ff3e4f26-3e7e-4538-ba2a-bfa2f72b5c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:27.460659 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e4f26-3e7e-4538-ba2a-bfa2f72b5c3b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:27.483987 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:27.524288 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b870a7-3ac7-444d-b4f5-4e79b0647fe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:27.525069 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b870a7-3ac7-444d-b4f5-4e79b0647fe2 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:27.525502 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b870a7-3ac7-444d-b4f5-4e79b0647fe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:27.525843 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b870a7-3ac7-444d-b4f5-4e79b0647fe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:27.536344 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b870a7-3ac7-444d-b4f5-4e79b0647fe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:27.537808 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b870a7-3ac7-444d-b4f5-4e79b0647fe2 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:27.548343 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1166/2294] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:28:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:28:27.967553 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5773d83-17e4-4805-9975-a90849b8a730 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:28.053424 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5773d83-17e4-4805-9975-a90849b8a730 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:28.058319 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30a6d6-081a-4dda-9359-4c3cab033526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:28.059105 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30a6d6-081a-4dda-9359-4c3cab033526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:28.059444 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30a6d6-081a-4dda-9359-4c3cab033526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:28.059779 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30a6d6-081a-4dda-9359-4c3cab033526 admin admin] PATH_INFO: `/v3/users/7cfe0ecab1364e70a2646693d655f25f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:28.061311 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30a6d6-081a-4dda-9359-4c3cab033526 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cfe0ecab1364e70a2646693d655f25f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:28.063752 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30a6d6-081a-4dda-9359-4c3cab033526 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:28.077138 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1f640-88b2-42d4-8e8b-dc9123872336 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:28.077496 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1f640-88b2-42d4-8e8b-dc9123872336 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:28.077894 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1f640-88b2-42d4-8e8b-dc9123872336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:28.099974 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-bbc1f640-88b2-42d4-8e8b-dc9123872336 None None] MFA Rules not processed for user `9e7444bc40314e73b282217bbb94798d`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:28.101993 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bbc1f640-88b2-42d4-8e8b-dc9123872336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:28.128629 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ea30a6d6-081a-4dda-9359-4c3cab033526 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cfe0ecab1364e70a2646693d655f25f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:28.129378 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ea30a6d6-081a-4dda-9359-4c3cab033526 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cfe0ecab1364e70a2646693d655f25f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:28.138630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ea30a6d6-081a-4dda-9359-4c3cab033526 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cfe0ecab1364e70a2646693d655f25f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:28.139421 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ea30a6d6-081a-4dda-9359-4c3cab033526 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cfe0ecab1364e70a2646693d655f25f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:28.148603 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ea30a6d6-081a-4dda-9359-4c3cab033526 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cfe0ecab1364e70a2646693d655f25f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:28.170442 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1129/2295] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:28:27 2022] DELETE /identity/v3/users/7cfe0ecab1364e70a2646693d655f25f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:28.175577 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9f13b-d583-4552-9a03-3c87c167e4db None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:28.176159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9f13b-d583-4552-9a03-3c87c167e4db None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:28.176488 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9f13b-d583-4552-9a03-3c87c167e4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:28.194861 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1167/2296] 10.222.0.94 () {58 vars in 1009 bytes} [Thu Sep 1 17:28:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:28:28.202172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-80e9f13b-d583-4552-9a03-3c87c167e4db None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:28.203755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-80e9f13b-d583-4552-9a03-3c87c167e4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:28.261676 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1f640-88b2-42d4-8e8b-dc9123872336 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:28.263595 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bbc1f640-88b2-42d4-8e8b-dc9123872336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:28.294573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1130/2297] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:28.306557 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9f13b-d583-4552-9a03-3c87c167e4db None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:28.308264 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-80e9f13b-d583-4552-9a03-3c87c167e4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:28.327662 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:28.350569 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1f640-88b2-42d4-8e8b-dc9123872336 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:28.379435 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9f13b-d583-4552-9a03-3c87c167e4db None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:28.384267 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7599b1-3425-40ac-a3d9-7246ad3ce86f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:28.384901 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7599b1-3425-40ac-a3d9-7246ad3ce86f service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:28.385219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7599b1-3425-40ac-a3d9-7246ad3ce86f service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:28.385587 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7599b1-3425-40ac-a3d9-7246ad3ce86f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:28.397961 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7599b1-3425-40ac-a3d9-7246ad3ce86f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:28.400930 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7599b1-3425-40ac-a3d9-7246ad3ce86f service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:28.413211 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1131/2298] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:28:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:28:28.425149 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7599b1-3425-40ac-a3d9-7246ad3ce86f service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:28.426685 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-de7599b1-3425-40ac-a3d9-7246ad3ce86f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:28.434552 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2bc926-ad34-44da-bf00-336b17f94b2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7ebf43f36c4862a3c527941e033666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:28.435441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bc926-ad34-44da-bf00-336b17f94b2d service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:28.435728 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bc926-ad34-44da-bf00-336b17f94b2d service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:28.436059 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bc926-ad34-44da-bf00-336b17f94b2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:28.445847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7599b1-3425-40ac-a3d9-7246ad3ce86f service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:28.450789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc4000-1f35-4a3d-94fa-d5e1f1aee2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:28.451425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc4000-1f35-4a3d-94fa-d5e1f1aee2b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:28.451704 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc4000-1f35-4a3d-94fa-d5e1f1aee2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:28.451968 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc4000-1f35-4a3d-94fa-d5e1f1aee2b6 admin admin] PATH_INFO: `/v3/users/b31e2b3c227c4689bee203a16244f58b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:28.453184 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc4000-1f35-4a3d-94fa-d5e1f1aee2b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b31e2b3c227c4689bee203a16244f58b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:28.455353 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc4000-1f35-4a3d-94fa-d5e1f1aee2b6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:28.464437 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:28.523714 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1bfc4000-1f35-4a3d-94fa-d5e1f1aee2b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b31e2b3c227c4689bee203a16244f58b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:28.524195 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1bfc4000-1f35-4a3d-94fa-d5e1f1aee2b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b31e2b3c227c4689bee203a16244f58b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:28.527935 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2bc926-ad34-44da-bf00-336b17f94b2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:28.529670 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2bc926-ad34-44da-bf00-336b17f94b2d service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:28.540711 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1168/2299] 10.222.0.94 () {60 vars in 1384 bytes} [Thu Sep 1 17:28:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 17:28:28.558025 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1bfc4000-1f35-4a3d-94fa-d5e1f1aee2b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b31e2b3c227c4689bee203a16244f58b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:28.558690 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1bfc4000-1f35-4a3d-94fa-d5e1f1aee2b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b31e2b3c227c4689bee203a16244f58b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:28.568421 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1bfc4000-1f35-4a3d-94fa-d5e1f1aee2b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b31e2b3c227c4689bee203a16244f58b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:28.613039 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1132/2300] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:28:28 2022] DELETE /identity/v3/users/b31e2b3c227c4689bee203a16244f58b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:28.617716 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60988a-9ee6-4c5e-b942-9ed8de5cbf57 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:28.618136 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60988a-9ee6-4c5e-b942-9ed8de5cbf57 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:28.618607 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60988a-9ee6-4c5e-b942-9ed8de5cbf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:28.645151 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-dc60988a-9ee6-4c5e-b942-9ed8de5cbf57 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:28.646745 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-dc60988a-9ee6-4c5e-b942-9ed8de5cbf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:28.735134 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1169/2301] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:28.750424 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc4000-1f35-4a3d-94fa-d5e1f1aee2b6 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:28.758476 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1bfc4000-1f35-4a3d-94fa-d5e1f1aee2b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:28.778746 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60988a-9ee6-4c5e-b942-9ed8de5cbf57 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:28.780874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-dc60988a-9ee6-4c5e-b942-9ed8de5cbf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:28.801440 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60988a-9ee6-4c5e-b942-9ed8de5cbf57 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:28.825247 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ed2b7-09d6-4463-be74-5cd86ad70325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:28.830832 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ed2b7-09d6-4463-be74-5cd86ad70325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:28.831333 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ed2b7-09d6-4463-be74-5cd86ad70325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:28.831895 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ed2b7-09d6-4463-be74-5cd86ad70325 admin admin] PATH_INFO: `/v3/projects/2c354491f0bc4f508aacb24e7605bbbb` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:28.834347 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ed2b7-09d6-4463-be74-5cd86ad70325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c354491f0bc4f508aacb24e7605bbbb)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:28.838925 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ed2b7-09d6-4463-be74-5cd86ad70325 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:28.862471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc4000-1f35-4a3d-94fa-d5e1f1aee2b6 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:28.868160 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2afff-b80e-4c63-bc44-ace19c9ad05d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:28.869357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2afff-b80e-4c63-bc44-ace19c9ad05d service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:28.869787 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2afff-b80e-4c63-bc44-ace19c9ad05d service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:28.870153 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2afff-b80e-4c63-bc44-ace19c9ad05d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:28.890690 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2afff-b80e-4c63-bc44-ace19c9ad05d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:28.894832 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2afff-b80e-4c63-bc44-ace19c9ad05d service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:28.904123 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5d8ed2b7-09d6-4463-be74-5cd86ad70325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c354491f0bc4f508aacb24e7605bbbb', 'request_id': 'req-5d8ed2b7-09d6-4463-be74-5cd86ad70325'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:28.912675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5d8ed2b7-09d6-4463-be74-5cd86ad70325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c354491f0bc4f508aacb24e7605bbbb', 'request_id': 'req-5d8ed2b7-09d6-4463-be74-5cd86ad70325'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:28.917368 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1133/2302] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:28:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:28:28.946108 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5d8ed2b7-09d6-4463-be74-5cd86ad70325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c354491f0bc4f508aacb24e7605bbbb', 'request_id': 'req-5d8ed2b7-09d6-4463-be74-5cd86ad70325'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:28.983120 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5d8ed2b7-09d6-4463-be74-5cd86ad70325 admin admin] The token cache is being invalidate because project 2c354491f0bc4f508aacb24e7605bbbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:28:28.983120 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5d8ed2b7-09d6-4463-be74-5cd86ad70325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:28.983745 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5d8ed2b7-09d6-4463-be74-5cd86ad70325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:28.987473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1170/2303] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:28:28 2022] DELETE /identity/v3/projects/2c354491f0bc4f508aacb24e7605bbbb => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:28.991649 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2afff-b80e-4c63-bc44-ace19c9ad05d service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:29.009180 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2afff-b80e-4c63-bc44-ace19c9ad05d service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:29.074474 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:29.177879 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b16393-e40d-4a28-a242-1d9acc85f03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:29.178543 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b16393-e40d-4a28-a242-1d9acc85f03f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:29.178813 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b16393-e40d-4a28-a242-1d9acc85f03f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:29.179084 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b16393-e40d-4a28-a242-1d9acc85f03f admin admin] PATH_INFO: `/v3/users/83cdd9078de649dda27a56d1c6168ca7` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:29.182556 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b16393-e40d-4a28-a242-1d9acc85f03f admin admin] RBAC: Authorizing `identity:delete_user(user_id=83cdd9078de649dda27a56d1c6168ca7)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:29.186046 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b16393-e40d-4a28-a242-1d9acc85f03f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:29.271278 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-94b16393-e40d-4a28-a242-1d9acc85f03f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83cdd9078de649dda27a56d1c6168ca7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:29.272050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-94b16393-e40d-4a28-a242-1d9acc85f03f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83cdd9078de649dda27a56d1c6168ca7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:29.300730 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-94b16393-e40d-4a28-a242-1d9acc85f03f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83cdd9078de649dda27a56d1c6168ca7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:29.303633 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-94b16393-e40d-4a28-a242-1d9acc85f03f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83cdd9078de649dda27a56d1c6168ca7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:29.338725 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-94b16393-e40d-4a28-a242-1d9acc85f03f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83cdd9078de649dda27a56d1c6168ca7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:29.384526 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ed2b7-09d6-4463-be74-5cd86ad70325 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:29.386581 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5d8ed2b7-09d6-4463-be74-5cd86ad70325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:29.396539 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1134/2304] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:28:28 2022] DELETE /identity/v3/users/83cdd9078de649dda27a56d1c6168ca7 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:29.436476 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ed2b7-09d6-4463-be74-5cd86ad70325 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:29.551293 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:29.619291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a865d35-b28e-41f6-9c67-7fe31ca00513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:29.619994 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a865d35-b28e-41f6-9c67-7fe31ca00513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:29.620317 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a865d35-b28e-41f6-9c67-7fe31ca00513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:29.620647 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a865d35-b28e-41f6-9c67-7fe31ca00513 admin admin] PATH_INFO: `/v3/projects/48c00138f43544dab8b07e5c31c04126` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:29.622925 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a865d35-b28e-41f6-9c67-7fe31ca00513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48c00138f43544dab8b07e5c31c04126)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:29.625004 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a865d35-b28e-41f6-9c67-7fe31ca00513 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:29.796996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2a865d35-b28e-41f6-9c67-7fe31ca00513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48c00138f43544dab8b07e5c31c04126', 'request_id': 'req-2a865d35-b28e-41f6-9c67-7fe31ca00513'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:29.833647 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2a865d35-b28e-41f6-9c67-7fe31ca00513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48c00138f43544dab8b07e5c31c04126', 'request_id': 'req-2a865d35-b28e-41f6-9c67-7fe31ca00513'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:29.858515 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2a865d35-b28e-41f6-9c67-7fe31ca00513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48c00138f43544dab8b07e5c31c04126', 'request_id': 'req-2a865d35-b28e-41f6-9c67-7fe31ca00513'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:29.921867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2a865d35-b28e-41f6-9c67-7fe31ca00513 admin admin] The token cache is being invalidate because project 48c00138f43544dab8b07e5c31c04126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:28:29.922166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2a865d35-b28e-41f6-9c67-7fe31ca00513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:29.923022 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2a865d35-b28e-41f6-9c67-7fe31ca00513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:29.925436 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1171/2305] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:28:29 2022] DELETE /identity/v3/projects/48c00138f43544dab8b07e5c31c04126 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:29.929253 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b16393-e40d-4a28-a242-1d9acc85f03f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:29.930966 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-94b16393-e40d-4a28-a242-1d9acc85f03f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:29.957871 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b16393-e40d-4a28-a242-1d9acc85f03f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:30.048084 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2fc20-3f06-4128-9157-4b27bc02e291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:30.049592 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2fc20-3f06-4128-9157-4b27bc02e291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:30.049872 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2fc20-3f06-4128-9157-4b27bc02e291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:30.050021 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2fc20-3f06-4128-9157-4b27bc02e291 admin admin] PATH_INFO: `/v3/users/e705c1f144e7487a8c600a08d242c08c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:30.051266 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2fc20-3f06-4128-9157-4b27bc02e291 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e705c1f144e7487a8c600a08d242c08c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:30.053297 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2fc20-3f06-4128-9157-4b27bc02e291 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:30.134930 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-90b2fc20-3f06-4128-9157-4b27bc02e291 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e705c1f144e7487a8c600a08d242c08c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:30.135898 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-90b2fc20-3f06-4128-9157-4b27bc02e291 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e705c1f144e7487a8c600a08d242c08c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:30.141184 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:30.151195 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-90b2fc20-3f06-4128-9157-4b27bc02e291 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e705c1f144e7487a8c600a08d242c08c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:30.152802 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-90b2fc20-3f06-4128-9157-4b27bc02e291 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e705c1f144e7487a8c600a08d242c08c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:30.167503 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-90b2fc20-3f06-4128-9157-4b27bc02e291 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e705c1f144e7487a8c600a08d242c08c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:30.217508 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1135/2306] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:28:29 2022] DELETE /identity/v3/users/e705c1f144e7487a8c600a08d242c08c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:30.312534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a865d35-b28e-41f6-9c67-7fe31ca00513 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:30.314933 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2a865d35-b28e-41f6-9c67-7fe31ca00513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:30.364648 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a865d35-b28e-41f6-9c67-7fe31ca00513 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:30.464956 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5effc-c416-4750-b34a-c3fb40a0cc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:30.465831 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5effc-c416-4750-b34a-c3fb40a0cc90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:30.466213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5effc-c416-4750-b34a-c3fb40a0cc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:30.466586 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5effc-c416-4750-b34a-c3fb40a0cc90 admin admin] PATH_INFO: `/v3/projects/7723d4327c0f458bb4bc84f38a7e4102` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:30.468030 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5effc-c416-4750-b34a-c3fb40a0cc90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7723d4327c0f458bb4bc84f38a7e4102)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:30.470099 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5effc-c416-4750-b34a-c3fb40a0cc90 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:30.573082 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-abd5effc-c416-4750-b34a-c3fb40a0cc90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7723d4327c0f458bb4bc84f38a7e4102', 'request_id': 'req-abd5effc-c416-4750-b34a-c3fb40a0cc90'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:30.587421 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-abd5effc-c416-4750-b34a-c3fb40a0cc90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7723d4327c0f458bb4bc84f38a7e4102', 'request_id': 'req-abd5effc-c416-4750-b34a-c3fb40a0cc90'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:30.598439 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-abd5effc-c416-4750-b34a-c3fb40a0cc90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7723d4327c0f458bb4bc84f38a7e4102', 'request_id': 'req-abd5effc-c416-4750-b34a-c3fb40a0cc90'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:30.620107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:30.629447 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-abd5effc-c416-4750-b34a-c3fb40a0cc90 admin admin] The token cache is being invalidate because project 7723d4327c0f458bb4bc84f38a7e4102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:28:30.629934 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-abd5effc-c416-4750-b34a-c3fb40a0cc90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:30.632135 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-abd5effc-c416-4750-b34a-c3fb40a0cc90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:30.634663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1172/2307] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:28:30 2022] DELETE /identity/v3/projects/7723d4327c0f458bb4bc84f38a7e4102 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:30.642775 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4aa089-c34b-4d58-a961-b28754e2fb6d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:30.643402 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4aa089-c34b-4d58-a961-b28754e2fb6d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:30.644146 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4aa089-c34b-4d58-a961-b28754e2fb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:30.722494 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-4f4aa089-c34b-4d58-a961-b28754e2fb6d None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:30.739255 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4f4aa089-c34b-4d58-a961-b28754e2fb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:30.779591 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5effc-c416-4750-b34a-c3fb40a0cc90 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:30.793121 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-abd5effc-c416-4750-b34a-c3fb40a0cc90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:30.903514 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1136/2308] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:30.916904 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5effc-c416-4750-b34a-c3fb40a0cc90 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:30.920608 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e1e1e-52f6-43da-8d4e-733251c2ef13 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:30.920895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e1e1e-52f6-43da-8d4e-733251c2ef13 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:30.921173 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e1e1e-52f6-43da-8d4e-733251c2ef13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:30.925105 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041a001-f4ba-4522-a29d-3ad824ae1db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:30.926112 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041a001-f4ba-4522-a29d-3ad824ae1db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:30.926997 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041a001-f4ba-4522-a29d-3ad824ae1db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:30.927569 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041a001-f4ba-4522-a29d-3ad824ae1db2 admin admin] PATH_INFO: `/v3/projects/225e63f1e2094ccb8584773feec4b0b7` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:30.929318 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041a001-f4ba-4522-a29d-3ad824ae1db2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=225e63f1e2094ccb8584773feec4b0b7)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:30.932139 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041a001-f4ba-4522-a29d-3ad824ae1db2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:30.959369 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-437e1e1e-52f6-43da-8d4e-733251c2ef13 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:30.961932 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-437e1e1e-52f6-43da-8d4e-733251c2ef13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:30.983533 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1137/2309] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:28:30.989674 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e1e1e-52f6-43da-8d4e-733251c2ef13 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:31.012492 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e1e1e-52f6-43da-8d4e-733251c2ef13 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:31.060933 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f041a001-f4ba-4522-a29d-3ad824ae1db2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '225e63f1e2094ccb8584773feec4b0b7', 'request_id': 'req-f041a001-f4ba-4522-a29d-3ad824ae1db2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:31.076033 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f041a001-f4ba-4522-a29d-3ad824ae1db2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '225e63f1e2094ccb8584773feec4b0b7', 'request_id': 'req-f041a001-f4ba-4522-a29d-3ad824ae1db2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:31.087031 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f041a001-f4ba-4522-a29d-3ad824ae1db2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '225e63f1e2094ccb8584773feec4b0b7', 'request_id': 'req-f041a001-f4ba-4522-a29d-3ad824ae1db2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:31.112462 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f041a001-f4ba-4522-a29d-3ad824ae1db2 admin admin] The token cache is being invalidate because project 225e63f1e2094ccb8584773feec4b0b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:28:31.112770 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f041a001-f4ba-4522-a29d-3ad824ae1db2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:31.115144 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f041a001-f4ba-4522-a29d-3ad824ae1db2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:31.119782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1173/2310] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:28:30 2022] DELETE /identity/v3/projects/225e63f1e2094ccb8584773feec4b0b7 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:31.136562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911c738-7dc9-4a7e-ada2-ca290de2ddac None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:31.137007 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911c738-7dc9-4a7e-ada2-ca290de2ddac None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:31.137309 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911c738-7dc9-4a7e-ada2-ca290de2ddac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:31.187711 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f911c738-7dc9-4a7e-ada2-ca290de2ddac None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:31.189512 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f911c738-7dc9-4a7e-ada2-ca290de2ddac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:31.224071 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6829f-af44-4d20-ace9-955936b6c1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:31.230368 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6829f-af44-4d20-ace9-955936b6c1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:31.231450 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6829f-af44-4d20-ace9-955936b6c1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:31.232016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6829f-af44-4d20-ace9-955936b6c1d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:31.233332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6829f-af44-4d20-ace9-955936b6c1d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:28:31.233960 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6829f-af44-4d20-ace9-955936b6c1d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:31.236588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6829f-af44-4d20-ace9-955936b6c1d6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:31.277815 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1138/2311] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:28:31.280176 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6829f-af44-4d20-ace9-955936b6c1d6 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:31.283279 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-79d6829f-af44-4d20-ace9-955936b6c1d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:31.315826 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6829f-af44-4d20-ace9-955936b6c1d6 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:31.336107 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e4851-b8e4-4ae5-bb6a-c290c6898d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:31.337091 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e4851-b8e4-4ae5-bb6a-c290c6898d3a admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:31.337661 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e4851-b8e4-4ae5-bb6a-c290c6898d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:31.338178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e4851-b8e4-4ae5-bb6a-c290c6898d3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:31.339464 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e4851-b8e4-4ae5-bb6a-c290c6898d3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:31.361379 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e4851-b8e4-4ae5-bb6a-c290c6898d3a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:31.369343 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1174/2312] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:28:31.386314 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f9c35-8551-400b-8752-b4d7d80429d8 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:31.386692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f9c35-8551-400b-8752-b4d7d80429d8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:31.386901 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f9c35-8551-400b-8752-b4d7d80429d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:31.462781 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f44f9c35-8551-400b-8752-b4d7d80429d8 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:31.464027 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f44f9c35-8551-400b-8752-b4d7d80429d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:31.474923 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1175/2313] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:31.483294 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f9c35-8551-400b-8752-b4d7d80429d8 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:31.503291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f9c35-8551-400b-8752-b4d7d80429d8 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:31.527269 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c15beb-9a67-4af3-b626-0de14778e6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:31.527910 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c15beb-9a67-4af3-b626-0de14778e6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:31.528353 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c15beb-9a67-4af3-b626-0de14778e6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:31.528637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c15beb-9a67-4af3-b626-0de14778e6d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:31.529302 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c15beb-9a67-4af3-b626-0de14778e6d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:28:31.529638 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c15beb-9a67-4af3-b626-0de14778e6d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:31.531277 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c15beb-9a67-4af3-b626-0de14778e6d6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:31.543418 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1139/2314] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:28:31 2022] POST /identity/v3/projects => generated 385 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:28:31.544768 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e4851-b8e4-4ae5-bb6a-c290c6898d3a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:31.551884 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1176/2315] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:28:31.579267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c15beb-9a67-4af3-b626-0de14778e6d6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:31.619587 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c15beb-9a67-4af3-b626-0de14778e6d6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:31.647945 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:31.684048 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:31.768476 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e4851-b8e4-4ae5-bb6a-c290c6898d3a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:31.784455 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f61a4-7d8a-4d97-9aea-82c3c1aff6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:31.785092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f61a4-7d8a-4d97-9aea-82c3c1aff6b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:31.785373 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f61a4-7d8a-4d97-9aea-82c3c1aff6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:31.785670 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f61a4-7d8a-4d97-9aea-82c3c1aff6b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:31.786315 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f61a4-7d8a-4d97-9aea-82c3c1aff6b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:31.788261 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f61a4-7d8a-4d97-9aea-82c3c1aff6b1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:31.790160 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfdceb7-aac3-4cb3-995a-3f24ac11dacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:31.793021 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdceb7-aac3-4cb3-995a-3f24ac11dacd admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:31.793437 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdceb7-aac3-4cb3-995a-3f24ac11dacd admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:31.793855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdceb7-aac3-4cb3-995a-3f24ac11dacd admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:31.794610 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfdceb7-aac3-4cb3-995a-3f24ac11dacd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:31.800322 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfdceb7-aac3-4cb3-995a-3f24ac11dacd admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:31.862233 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1140/2316] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:28:31 2022] POST /identity/v3/users => generated 293 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:28:31.866377 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f61a4-7d8a-4d97-9aea-82c3c1aff6b1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:31.867079 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1177/2317] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:28:31 2022] POST /identity/v3/projects => generated 367 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:28:31.871619 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfdceb7-aac3-4cb3-995a-3f24ac11dacd admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:31.894012 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f61a4-7d8a-4d97-9aea-82c3c1aff6b1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:32.039259 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfdceb7-aac3-4cb3-995a-3f24ac11dacd admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:32.047277 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab535b-33f5-45c1-bbd0-27ff13d4d750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:32.048407 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab535b-33f5-45c1-bbd0-27ff13d4d750 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:32.049476 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab535b-33f5-45c1-bbd0-27ff13d4d750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:32.050333 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0c9ea-a43d-4c4d-bc04-8efc84465730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:32.050874 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab535b-33f5-45c1-bbd0-27ff13d4d750 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:32.051718 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0c9ea-a43d-4c4d-bc04-8efc84465730 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:32.052632 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab535b-33f5-45c1-bbd0-27ff13d4d750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:32.053156 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0c9ea-a43d-4c4d-bc04-8efc84465730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:32.053671 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0c9ea-a43d-4c4d-bc04-8efc84465730 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:32.055557 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab535b-33f5-45c1-bbd0-27ff13d4d750 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:32.056722 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0c9ea-a43d-4c4d-bc04-8efc84465730 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:32.059026 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0c9ea-a43d-4c4d-bc04-8efc84465730 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:32.084263 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1141/2318] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:28:32.094489 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab535b-33f5-45c1-bbd0-27ff13d4d750 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:32.110780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab535b-33f5-45c1-bbd0-27ff13d4d750 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:32.111605 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1178/2319] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:28:31 2022] POST /identity/v3/users => generated 284 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:28:32.117728 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0c9ea-a43d-4c4d-bc04-8efc84465730 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:32.120623 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d468b16-1c91-49d9-be37-b0fcd924c600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:32.121778 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d468b16-1c91-49d9-be37-b0fcd924c600 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:32.122268 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d468b16-1c91-49d9-be37-b0fcd924c600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:32.122756 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d468b16-1c91-49d9-be37-b0fcd924c600 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:32.123596 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d468b16-1c91-49d9-be37-b0fcd924c600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:32.128012 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d468b16-1c91-49d9-be37-b0fcd924c600 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:32.131039 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0c9ea-a43d-4c4d-bc04-8efc84465730 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:32.141843 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f6b2a-9302-47f7-9a3c-27ea17b3bda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:32.143291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f6b2a-9302-47f7-9a3c-27ea17b3bda1 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:32.145630 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f6b2a-9302-47f7-9a3c-27ea17b3bda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:32.145928 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f6b2a-9302-47f7-9a3c-27ea17b3bda1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:32.146603 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f6b2a-9302-47f7-9a3c-27ea17b3bda1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:32.151389 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f6b2a-9302-47f7-9a3c-27ea17b3bda1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:32.155976 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1142/2320] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:28:32.156879 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d468b16-1c91-49d9-be37-b0fcd924c600 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:32.167454 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1179/2321] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:28:32.174600 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f6b2a-9302-47f7-9a3c-27ea17b3bda1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:32.174788 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d468b16-1c91-49d9-be37-b0fcd924c600 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:32.181642 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517c281-0056-496e-aab7-8cb12fa27535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:32.182330 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517c281-0056-496e-aab7-8cb12fa27535 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:32.182614 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517c281-0056-496e-aab7-8cb12fa27535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:32.182890 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517c281-0056-496e-aab7-8cb12fa27535 admin admin] PATH_INFO: `/v3/projects/d190a36da5474811a8f2aacb6441c049/users/08cd2f59705a4e2b9e993691962880b3/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:32.196422 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f6b2a-9302-47f7-9a3c-27ea17b3bda1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:32.203068 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a96338-accf-45cd-b412-99108f279131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:32.204258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a96338-accf-45cd-b412-99108f279131 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:32.205210 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a96338-accf-45cd-b412-99108f279131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:32.205653 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a96338-accf-45cd-b412-99108f279131 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:32.206658 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a96338-accf-45cd-b412-99108f279131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:32.207188 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517c281-0056-496e-aab7-8cb12fa27535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d190a36da5474811a8f2aacb6441c049, user_id=08cd2f59705a4e2b9e993691962880b3, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:32.208855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a96338-accf-45cd-b412-99108f279131 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:32.210968 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517c281-0056-496e-aab7-8cb12fa27535 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:32.223827 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1180/2322] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:28:32.229303 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a96338-accf-45cd-b412-99108f279131 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:32.238356 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1143/2323] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:28:32 2022] PUT /identity/v3/projects/d190a36da5474811a8f2aacb6441c049/users/08cd2f59705a4e2b9e993691962880b3/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:32.248950 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d19f0-ae71-402f-a703-a61e11413dcd None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:32.249249 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d19f0-ae71-402f-a703-a61e11413dcd None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:32.249618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d19f0-ae71-402f-a703-a61e11413dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:32.249870 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a96338-accf-45cd-b412-99108f279131 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:32.281270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8e9d19f0-ae71-402f-a703-a61e11413dcd None None] MFA Rules not processed for user `08cd2f59705a4e2b9e993691962880b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:32.282563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8e9d19f0-ae71-402f-a703-a61e11413dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:32.332336 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4ae97-4a83-456f-ae93-b5529d09bd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:32.333104 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4ae97-4a83-456f-ae93-b5529d09bd91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:32.333962 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4ae97-4a83-456f-ae93-b5529d09bd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:32.333962 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4ae97-4a83-456f-ae93-b5529d09bd91 admin admin] PATH_INFO: `/v3/projects/0edbd0609ac047d19c0e1eb3ad001636/users/1877ab5d300543999a730ad4d199f300/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:32.343135 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:32.355362 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4ae97-4a83-456f-ae93-b5529d09bd91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0edbd0609ac047d19c0e1eb3ad001636, user_id=1877ab5d300543999a730ad4d199f300, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:32.358563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4ae97-4a83-456f-ae93-b5529d09bd91 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:32.378998 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1181/2324] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:28:32 2022] PUT /identity/v3/projects/0edbd0609ac047d19c0e1eb3ad001636/users/1877ab5d300543999a730ad4d199f300/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:32.390385 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45c848-bac6-469f-8b5f-c1535c4f5a66 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:32.391169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45c848-bac6-469f-8b5f-c1535c4f5a66 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:32.391680 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45c848-bac6-469f-8b5f-c1535c4f5a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:32.424274 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1144/2325] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:32.425574 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-fe45c848-bac6-469f-8b5f-c1535c4f5a66 None None] MFA Rules not processed for user `1877ab5d300543999a730ad4d199f300`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:32.426396 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fe45c848-bac6-469f-8b5f-c1535c4f5a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:32.428933 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d19f0-ae71-402f-a703-a61e11413dcd None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:32.455520 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d19f0-ae71-402f-a703-a61e11413dcd None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:32.475769 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:32.497899 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1182/2326] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:32.509908 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45c848-bac6-469f-8b5f-c1535c4f5a66 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:32.511552 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fe45c848-bac6-469f-8b5f-c1535c4f5a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:32.596298 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45c848-bac6-469f-8b5f-c1535c4f5a66 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:32.600512 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6861c22-2f36-4628-bd86-8406cc95012f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6647f3aa54dc68e888b3adb8c28b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:32.601146 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6861c22-2f36-4628-bd86-8406cc95012f service glance] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:32.601454 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6861c22-2f36-4628-bd86-8406cc95012f service glance] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:32.601834 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6861c22-2f36-4628-bd86-8406cc95012f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:32.614950 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6861c22-2f36-4628-bd86-8406cc95012f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:32.616429 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6861c22-2f36-4628-bd86-8406cc95012f service glance] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:32.628510 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1183/2327] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:28:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:28:32.715691 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbedb7-4566-430e-8d3e-51898d91295d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:32.716605 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbedb7-4566-430e-8d3e-51898d91295d admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:32.716605 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbedb7-4566-430e-8d3e-51898d91295d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:32.716868 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbedb7-4566-430e-8d3e-51898d91295d admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:32.717715 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fbedb7-4566-430e-8d3e-51898d91295d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:32.719659 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fbedb7-4566-430e-8d3e-51898d91295d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:32.761229 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1145/2328] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:28:32 2022] POST /identity/v3/projects => generated 387 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:28:32.765694 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6861c22-2f36-4628-bd86-8406cc95012f service glance] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:32.790926 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6861c22-2f36-4628-bd86-8406cc95012f service glance] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:32.902164 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb28c0-fdc4-426e-a918-f1d3e6075c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:32.903064 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb28c0-fdc4-426e-a918-f1d3e6075c7f admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:32.903504 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb28c0-fdc4-426e-a918-f1d3e6075c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:32.904082 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb28c0-fdc4-426e-a918-f1d3e6075c7f admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:32.904867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb28c0-fdc4-426e-a918-f1d3e6075c7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:32.907108 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb28c0-fdc4-426e-a918-f1d3e6075c7f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:32.942097 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1184/2329] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:28:32 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:28:32.949528 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbedb7-4566-430e-8d3e-51898d91295d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:32.966023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbedb7-4566-430e-8d3e-51898d91295d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:32.979472 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269bad78-bcb5-40f7-9995-95cbb50616fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:32.981464 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bad78-bcb5-40f7-9995-95cbb50616fb admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:32.981962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bad78-bcb5-40f7-9995-95cbb50616fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:32.983599 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bad78-bcb5-40f7-9995-95cbb50616fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:32.984525 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269bad78-bcb5-40f7-9995-95cbb50616fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:32.987295 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269bad78-bcb5-40f7-9995-95cbb50616fb admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:33.014040 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1146/2330] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:28:33.018594 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb28c0-fdc4-426e-a918-f1d3e6075c7f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:33.032324 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb28c0-fdc4-426e-a918-f1d3e6075c7f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:33.037262 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407fac9a-0e3b-44ac-91b2-d94dc7a49af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:33.037907 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fac9a-0e3b-44ac-91b2-d94dc7a49af7 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:33.038186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fac9a-0e3b-44ac-91b2-d94dc7a49af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:33.038458 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fac9a-0e3b-44ac-91b2-d94dc7a49af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:33.039223 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407fac9a-0e3b-44ac-91b2-d94dc7a49af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:33.041029 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407fac9a-0e3b-44ac-91b2-d94dc7a49af7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:33.043533 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:33.060058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1185/2331] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:28:33.061300 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269bad78-bcb5-40f7-9995-95cbb50616fb admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:33.075910 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269bad78-bcb5-40f7-9995-95cbb50616fb admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:33.088440 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b233e0-aea0-40bd-bb05-3b1e2e5c44ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:33.089417 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b233e0-aea0-40bd-bb05-3b1e2e5c44ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:33.094263 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b233e0-aea0-40bd-bb05-3b1e2e5c44ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:33.094546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b233e0-aea0-40bd-bb05-3b1e2e5c44ed admin admin] PATH_INFO: `/v3/projects/3befc05237e54e4192a60579f3c83484/users/7d502fe0d20643bfa753ddcc86edf92c/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:33.132096 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b233e0-aea0-40bd-bb05-3b1e2e5c44ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=3befc05237e54e4192a60579f3c83484, user_id=7d502fe0d20643bfa753ddcc86edf92c, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:33.134807 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b233e0-aea0-40bd-bb05-3b1e2e5c44ed admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:33.165418 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1147/2332] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:28:33 2022] PUT /identity/v3/projects/3befc05237e54e4192a60579f3c83484/users/7d502fe0d20643bfa753ddcc86edf92c/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:28:33.179574 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac933dfc-0eb5-4a5b-92fe-87fbf55d2978 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:33.179857 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac933dfc-0eb5-4a5b-92fe-87fbf55d2978 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:33.180130 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac933dfc-0eb5-4a5b-92fe-87fbf55d2978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:33.256805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ac933dfc-0eb5-4a5b-92fe-87fbf55d2978 None None] MFA Rules not processed for user `7d502fe0d20643bfa753ddcc86edf92c`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:33.258067 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ac933dfc-0eb5-4a5b-92fe-87fbf55d2978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:33.406577 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1186/2333] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:33.413470 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b233e0-aea0-40bd-bb05-3b1e2e5c44ed admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:33.566325 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b233e0-aea0-40bd-bb05-3b1e2e5c44ed admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:33.582129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147169dc-4693-4bdc-860f-221d22b5ecd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:33.583285 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147169dc-4693-4bdc-860f-221d22b5ecd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:33.583611 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147169dc-4693-4bdc-860f-221d22b5ecd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:33.584210 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147169dc-4693-4bdc-860f-221d22b5ecd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:33.585710 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147169dc-4693-4bdc-860f-221d22b5ecd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:33.588583 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147169dc-4693-4bdc-860f-221d22b5ecd9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:33.642011 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1148/2334] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:28:33 2022] POST /identity/v3/projects => generated 385 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:28:33.646740 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac933dfc-0eb5-4a5b-92fe-87fbf55d2978 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:33.663283 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac933dfc-0eb5-4a5b-92fe-87fbf55d2978 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:33.767545 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4d81f-69bc-4965-9ac4-263aa4f40c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:33.768637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4d81f-69bc-4965-9ac4-263aa4f40c0d admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:33.769097 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4d81f-69bc-4965-9ac4-263aa4f40c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:33.769366 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4d81f-69bc-4965-9ac4-263aa4f40c0d admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:33.770041 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4d81f-69bc-4965-9ac4-263aa4f40c0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:33.772042 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4d81f-69bc-4965-9ac4-263aa4f40c0d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:33.838818 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1187/2335] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:28:33 2022] POST /identity/v3/users => generated 299 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:28:33.842657 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147169dc-4693-4bdc-860f-221d22b5ecd9 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:33.857275 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147169dc-4693-4bdc-860f-221d22b5ecd9 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:33.872514 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122baa0-8482-43d7-98a8-e261c18feb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:33.873170 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122baa0-8482-43d7-98a8-e261c18feb4f admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:33.873528 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122baa0-8482-43d7-98a8-e261c18feb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:33.873772 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122baa0-8482-43d7-98a8-e261c18feb4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:33.874412 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122baa0-8482-43d7-98a8-e261c18feb4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:33.876061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122baa0-8482-43d7-98a8-e261c18feb4f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:33.905293 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1149/2336] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:28:33.910195 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4d81f-69bc-4965-9ac4-263aa4f40c0d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:33.922778 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4d81f-69bc-4965-9ac4-263aa4f40c0d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:33.935050 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94bcb6-7605-471b-be35-55fbe5bb5e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:33.936909 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94bcb6-7605-471b-be35-55fbe5bb5e47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:33.939347 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94bcb6-7605-471b-be35-55fbe5bb5e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:33.939705 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94bcb6-7605-471b-be35-55fbe5bb5e47 admin admin] PATH_INFO: `/v3/projects/de5b1f2b120f436da3ecc62297be0f41/users/8ee2972354e645b4959e9ac48d67a505/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:33.976500 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94bcb6-7605-471b-be35-55fbe5bb5e47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5b1f2b120f436da3ecc62297be0f41, user_id=8ee2972354e645b4959e9ac48d67a505, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:33.982152 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94bcb6-7605-471b-be35-55fbe5bb5e47 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:34.019950 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1188/2337] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:28:33 2022] PUT /identity/v3/projects/de5b1f2b120f436da3ecc62297be0f41/users/8ee2972354e645b4959e9ac48d67a505/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:28:34.027225 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122baa0-8482-43d7-98a8-e261c18feb4f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:34.044582 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122baa0-8482-43d7-98a8-e261c18feb4f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:34.123293 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:34.169440 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320b34d-9177-4168-8975-54bb201c244f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:34.170095 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320b34d-9177-4168-8975-54bb201c244f admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:34.170370 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320b34d-9177-4168-8975-54bb201c244f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:34.170828 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320b34d-9177-4168-8975-54bb201c244f admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:34.171483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320b34d-9177-4168-8975-54bb201c244f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:34.173792 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320b34d-9177-4168-8975-54bb201c244f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:34.186372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1150/2338] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:28:34.190738 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94bcb6-7605-471b-be35-55fbe5bb5e47 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:34.203694 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94bcb6-7605-471b-be35-55fbe5bb5e47 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:34.211608 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1169f-5cc5-4d50-bb96-955d95aebc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:34.212311 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1169f-5cc5-4d50-bb96-955d95aebc45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:34.212591 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1169f-5cc5-4d50-bb96-955d95aebc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:34.212864 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1169f-5cc5-4d50-bb96-955d95aebc45 admin admin] PATH_INFO: `/v3/projects/de5b1f2b120f436da3ecc62297be0f41/users/8ee2972354e645b4959e9ac48d67a505/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:34.215568 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1169f-5cc5-4d50-bb96-955d95aebc45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5b1f2b120f436da3ecc62297be0f41, user_id=8ee2972354e645b4959e9ac48d67a505, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:34.218316 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1169f-5cc5-4d50-bb96-955d95aebc45 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:34.270461 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1189/2339] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:28:34 2022] PUT /identity/v3/projects/de5b1f2b120f436da3ecc62297be0f41/users/8ee2972354e645b4959e9ac48d67a505/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:34.314852 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e65081-c661-4371-afbe-fcdc84fba36b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:34.315154 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e65081-c661-4371-afbe-fcdc84fba36b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:34.315429 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e65081-c661-4371-afbe-fcdc84fba36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:34.369737 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-84e65081-c661-4371-afbe-fcdc84fba36b None None] MFA Rules not processed for user `8ee2972354e645b4959e9ac48d67a505`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:34.373170 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-84e65081-c661-4371-afbe-fcdc84fba36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:34.499775 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1151/2340] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:34.511608 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1169f-5cc5-4d50-bb96-955d95aebc45 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:34.513466 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-51f1169f-5cc5-4d50-bb96-955d95aebc45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:34.577790 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:34.596503 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1169f-5cc5-4d50-bb96-955d95aebc45 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:34.600603 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f5dc4-6ad0-49a4-8151-b476ba1ff7ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:34.601448 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f5dc4-6ad0-49a4-8151-b476ba1ff7ba service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:34.601806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f5dc4-6ad0-49a4-8151-b476ba1ff7ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:34.602149 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f5dc4-6ad0-49a4-8151-b476ba1ff7ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:34.615250 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f5dc4-6ad0-49a4-8151-b476ba1ff7ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:34.616797 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f5dc4-6ad0-49a4-8151-b476ba1ff7ba service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:34.627826 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1190/2341] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:28:34 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:28:35.375765 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e65081-c661-4371-afbe-fcdc84fba36b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:35.399428 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e65081-c661-4371-afbe-fcdc84fba36b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:35.412757 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89faf1-fa87-44a9-9fcd-f64aa6ff70fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:35.414004 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89faf1-fa87-44a9-9fcd-f64aa6ff70fa service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:35.414947 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89faf1-fa87-44a9-9fcd-f64aa6ff70fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:35.414947 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89faf1-fa87-44a9-9fcd-f64aa6ff70fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:35.622999 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89faf1-fa87-44a9-9fcd-f64aa6ff70fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:35.624930 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89faf1-fa87-44a9-9fcd-f64aa6ff70fa service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:35.650944 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1152/2342] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:28:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:28:37.506132 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448e81b-a2a0-4a1c-b842-fc31469748e6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:37.506853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448e81b-a2a0-4a1c-b842-fc31469748e6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:37.506853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448e81b-a2a0-4a1c-b842-fc31469748e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:37.544232 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5448e81b-a2a0-4a1c-b842-fc31469748e6 None None] MFA Rules not processed for user `754c17cea670481bb43938aaf2e8d7d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:37.545880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5448e81b-a2a0-4a1c-b842-fc31469748e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:37.618650 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1191/2343] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:40.253570 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89faf1-fa87-44a9-9fcd-f64aa6ff70fa service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:40.255116 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ce89faf1-fa87-44a9-9fcd-f64aa6ff70fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:40.268269 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89faf1-fa87-44a9-9fcd-f64aa6ff70fa service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:40.272366 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ddbf8-2e34-41cf-b1b2-216921bdd898 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:40.273125 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ddbf8-2e34-41cf-b1b2-216921bdd898 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:40.273433 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ddbf8-2e34-41cf-b1b2-216921bdd898 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:40.273796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ddbf8-2e34-41cf-b1b2-216921bdd898 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:40.340421 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ddbf8-2e34-41cf-b1b2-216921bdd898 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:40.341916 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ddbf8-2e34-41cf-b1b2-216921bdd898 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:40.345795 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:40.352823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1153/2344] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:28:40 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:28:42.734256 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448e81b-a2a0-4a1c-b842-fc31469748e6 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:42.825423 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448e81b-a2a0-4a1c-b842-fc31469748e6 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:42.830877 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ff1f8-bf6c-43e5-acd5-70b72012fa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:42.831615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ff1f8-bf6c-43e5-acd5-70b72012fa82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:42.831990 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ff1f8-bf6c-43e5-acd5-70b72012fa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:42.832386 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ff1f8-bf6c-43e5-acd5-70b72012fa82 admin admin] PATH_INFO: `/v3/users/08cd2f59705a4e2b9e993691962880b3` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:42.833597 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ff1f8-bf6c-43e5-acd5-70b72012fa82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08cd2f59705a4e2b9e993691962880b3)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:42.835600 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ff1f8-bf6c-43e5-acd5-70b72012fa82 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:42.908974 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e73ff1f8-bf6c-43e5-acd5-70b72012fa82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08cd2f59705a4e2b9e993691962880b3'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:42.909696 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e73ff1f8-bf6c-43e5-acd5-70b72012fa82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08cd2f59705a4e2b9e993691962880b3'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:42.923006 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e73ff1f8-bf6c-43e5-acd5-70b72012fa82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08cd2f59705a4e2b9e993691962880b3'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:42.930914 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e73ff1f8-bf6c-43e5-acd5-70b72012fa82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08cd2f59705a4e2b9e993691962880b3'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:42.940120 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e73ff1f8-bf6c-43e5-acd5-70b72012fa82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08cd2f59705a4e2b9e993691962880b3'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:42.947848 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1192/2345] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:28:42 2022] DELETE /identity/v3/users/08cd2f59705a4e2b9e993691962880b3 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:42.952412 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be78483-05c8-4cfc-8d9a-f614cebcb9ce None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:42.952963 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be78483-05c8-4cfc-8d9a-f614cebcb9ce None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:42.952963 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be78483-05c8-4cfc-8d9a-f614cebcb9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:42.973883 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2be78483-05c8-4cfc-8d9a-f614cebcb9ce None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:42.975200 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2be78483-05c8-4cfc-8d9a-f614cebcb9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:43.049162 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1154/2346] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:43.060053 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ff1f8-bf6c-43e5-acd5-70b72012fa82 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:43.062750 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e73ff1f8-bf6c-43e5-acd5-70b72012fa82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:43.074316 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:43.131134 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ff1f8-bf6c-43e5-acd5-70b72012fa82 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:43.135720 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022ae23-92bf-44a5-99ab-7ec6aa838577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:43.136465 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022ae23-92bf-44a5-99ab-7ec6aa838577 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:43.136847 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022ae23-92bf-44a5-99ab-7ec6aa838577 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:43.137319 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022ae23-92bf-44a5-99ab-7ec6aa838577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:43.147806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022ae23-92bf-44a5-99ab-7ec6aa838577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:43.149112 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022ae23-92bf-44a5-99ab-7ec6aa838577 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:43.160567 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1193/2347] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:28:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:28:43.649782 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be78483-05c8-4cfc-8d9a-f614cebcb9ce None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:43.651267 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2be78483-05c8-4cfc-8d9a-f614cebcb9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:43.687139 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be78483-05c8-4cfc-8d9a-f614cebcb9ce None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:43.704985 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203935d-84bf-42e7-8c77-cf901aa70282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:43.706097 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203935d-84bf-42e7-8c77-cf901aa70282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:43.706097 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203935d-84bf-42e7-8c77-cf901aa70282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:43.706310 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203935d-84bf-42e7-8c77-cf901aa70282 admin admin] PATH_INFO: `/v3/projects/d190a36da5474811a8f2aacb6441c049` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:43.707643 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203935d-84bf-42e7-8c77-cf901aa70282 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d190a36da5474811a8f2aacb6441c049)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:43.711751 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203935d-84bf-42e7-8c77-cf901aa70282 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:43.814601 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2203935d-84bf-42e7-8c77-cf901aa70282 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd190a36da5474811a8f2aacb6441c049', 'request_id': 'req-2203935d-84bf-42e7-8c77-cf901aa70282'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:43.827815 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2203935d-84bf-42e7-8c77-cf901aa70282 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd190a36da5474811a8f2aacb6441c049', 'request_id': 'req-2203935d-84bf-42e7-8c77-cf901aa70282'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:43.843411 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2203935d-84bf-42e7-8c77-cf901aa70282 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd190a36da5474811a8f2aacb6441c049', 'request_id': 'req-2203935d-84bf-42e7-8c77-cf901aa70282'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:43.877595 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2203935d-84bf-42e7-8c77-cf901aa70282 admin admin] The token cache is being invalidate because project d190a36da5474811a8f2aacb6441c049 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:28:43.878203 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2203935d-84bf-42e7-8c77-cf901aa70282 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:43.879259 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2203935d-84bf-42e7-8c77-cf901aa70282 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:43.882669 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1155/2348] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:28:43 2022] DELETE /identity/v3/projects/d190a36da5474811a8f2aacb6441c049 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:43.886798 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022ae23-92bf-44a5-99ab-7ec6aa838577 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:43.906408 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022ae23-92bf-44a5-99ab-7ec6aa838577 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:44.031530 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6e4ff-5848-425f-b390-1d555f93122c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:44.032817 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6e4ff-5848-425f-b390-1d555f93122c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:44.033202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6e4ff-5848-425f-b390-1d555f93122c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:44.034378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6e4ff-5848-425f-b390-1d555f93122c admin admin] PATH_INFO: `/v3/users/7d502fe0d20643bfa753ddcc86edf92c` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:44.034993 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6e4ff-5848-425f-b390-1d555f93122c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d502fe0d20643bfa753ddcc86edf92c)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:44.038390 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6e4ff-5848-425f-b390-1d555f93122c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:44.114599 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-69b6e4ff-5848-425f-b390-1d555f93122c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d502fe0d20643bfa753ddcc86edf92c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:44.115436 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-69b6e4ff-5848-425f-b390-1d555f93122c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d502fe0d20643bfa753ddcc86edf92c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:44.137330 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-69b6e4ff-5848-425f-b390-1d555f93122c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d502fe0d20643bfa753ddcc86edf92c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:44.150138 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-69b6e4ff-5848-425f-b390-1d555f93122c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d502fe0d20643bfa753ddcc86edf92c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:44.167960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-69b6e4ff-5848-425f-b390-1d555f93122c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d502fe0d20643bfa753ddcc86edf92c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:44.177163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1194/2349] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:28:43 2022] DELETE /identity/v3/users/7d502fe0d20643bfa753ddcc86edf92c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:28:44.628682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203935d-84bf-42e7-8c77-cf901aa70282 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:44.630649 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2203935d-84bf-42e7-8c77-cf901aa70282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:44.660056 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203935d-84bf-42e7-8c77-cf901aa70282 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:44.764267 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e750ac-1bad-4906-8667-f34aca56e834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:44.765334 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e750ac-1bad-4906-8667-f34aca56e834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:44.765784 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e750ac-1bad-4906-8667-f34aca56e834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:44.766290 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e750ac-1bad-4906-8667-f34aca56e834 admin admin] PATH_INFO: `/v3/projects/3befc05237e54e4192a60579f3c83484` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:44.768573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e750ac-1bad-4906-8667-f34aca56e834 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3befc05237e54e4192a60579f3c83484)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:44.770872 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e750ac-1bad-4906-8667-f34aca56e834 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:44.816879 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:44.861465 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-96e750ac-1bad-4906-8667-f34aca56e834 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3befc05237e54e4192a60579f3c83484', 'request_id': 'req-96e750ac-1bad-4906-8667-f34aca56e834'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:44.869460 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-96e750ac-1bad-4906-8667-f34aca56e834 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3befc05237e54e4192a60579f3c83484', 'request_id': 'req-96e750ac-1bad-4906-8667-f34aca56e834'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:44.878715 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-96e750ac-1bad-4906-8667-f34aca56e834 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3befc05237e54e4192a60579f3c83484', 'request_id': 'req-96e750ac-1bad-4906-8667-f34aca56e834'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:44.899338 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-96e750ac-1bad-4906-8667-f34aca56e834 admin admin] The token cache is being invalidate because project 3befc05237e54e4192a60579f3c83484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:28:44.899545 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-96e750ac-1bad-4906-8667-f34aca56e834 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:44.900203 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-96e750ac-1bad-4906-8667-f34aca56e834 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:44.904999 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1156/2350] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:28:44 2022] DELETE /identity/v3/projects/3befc05237e54e4192a60579f3c83484 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:44.906535 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6e4ff-5848-425f-b390-1d555f93122c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:44.909211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-69b6e4ff-5848-425f-b390-1d555f93122c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:44.927539 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6e4ff-5848-425f-b390-1d555f93122c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:44.974452 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:45.039184 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50bb99-9e55-4595-8000-280833dbc344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:45.040505 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50bb99-9e55-4595-8000-280833dbc344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:45.041050 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50bb99-9e55-4595-8000-280833dbc344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:45.042256 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50bb99-9e55-4595-8000-280833dbc344 admin admin] PATH_INFO: `/v3/users/8ee2972354e645b4959e9ac48d67a505` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:45.046736 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50bb99-9e55-4595-8000-280833dbc344 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ee2972354e645b4959e9ac48d67a505)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:45.049563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50bb99-9e55-4595-8000-280833dbc344 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:45.142139 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-dc50bb99-9e55-4595-8000-280833dbc344 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ee2972354e645b4959e9ac48d67a505'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:45.143001 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-dc50bb99-9e55-4595-8000-280833dbc344 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ee2972354e645b4959e9ac48d67a505'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:45.170387 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-dc50bb99-9e55-4595-8000-280833dbc344 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ee2972354e645b4959e9ac48d67a505'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:45.183793 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-dc50bb99-9e55-4595-8000-280833dbc344 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ee2972354e645b4959e9ac48d67a505'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:45.198227 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-dc50bb99-9e55-4595-8000-280833dbc344 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ee2972354e645b4959e9ac48d67a505'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:45.213785 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1195/2351] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:28:44 2022] DELETE /identity/v3/users/8ee2972354e645b4959e9ac48d67a505 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:28:45.554315 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e750ac-1bad-4906-8667-f34aca56e834 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:45.555947 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-96e750ac-1bad-4906-8667-f34aca56e834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:45.569348 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e750ac-1bad-4906-8667-f34aca56e834 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:45.641535 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc12cd-3158-4702-a843-9cfd03e129c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:45.642206 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc12cd-3158-4702-a843-9cfd03e129c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:45.643097 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc12cd-3158-4702-a843-9cfd03e129c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:45.643379 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc12cd-3158-4702-a843-9cfd03e129c6 admin admin] PATH_INFO: `/v3/projects/de5b1f2b120f436da3ecc62297be0f41` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:45.644501 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc12cd-3158-4702-a843-9cfd03e129c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de5b1f2b120f436da3ecc62297be0f41)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:45.646463 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc12cd-3158-4702-a843-9cfd03e129c6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:45.696769 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7bdc12cd-3158-4702-a843-9cfd03e129c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de5b1f2b120f436da3ecc62297be0f41', 'request_id': 'req-7bdc12cd-3158-4702-a843-9cfd03e129c6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:45.702771 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7bdc12cd-3158-4702-a843-9cfd03e129c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de5b1f2b120f436da3ecc62297be0f41', 'request_id': 'req-7bdc12cd-3158-4702-a843-9cfd03e129c6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:45.709623 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7bdc12cd-3158-4702-a843-9cfd03e129c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de5b1f2b120f436da3ecc62297be0f41', 'request_id': 'req-7bdc12cd-3158-4702-a843-9cfd03e129c6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:45.725181 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7bdc12cd-3158-4702-a843-9cfd03e129c6 admin admin] The token cache is being invalidate because project de5b1f2b120f436da3ecc62297be0f41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:28:45.725772 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7bdc12cd-3158-4702-a843-9cfd03e129c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:45.726427 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7bdc12cd-3158-4702-a843-9cfd03e129c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:45.727918 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1157/2352] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:28:45 2022] DELETE /identity/v3/projects/de5b1f2b120f436da3ecc62297be0f41 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:45.734072 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43510f52-683a-458c-87dc-bd1cf41e00be None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:45.734375 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43510f52-683a-458c-87dc-bd1cf41e00be None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:45.734662 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43510f52-683a-458c-87dc-bd1cf41e00be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:45.755845 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-43510f52-683a-458c-87dc-bd1cf41e00be None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:45.757273 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-43510f52-683a-458c-87dc-bd1cf41e00be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:45.821191 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1196/2353] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:45.830250 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a2915-9c4a-4c70-9eaa-bb4f300b3d40 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:45.830755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a2915-9c4a-4c70-9eaa-bb4f300b3d40 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:45.830869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a2915-9c4a-4c70-9eaa-bb4f300b3d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:45.851089 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ce6a2915-9c4a-4c70-9eaa-bb4f300b3d40 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:45.852286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ce6a2915-9c4a-4c70-9eaa-bb4f300b3d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:45.860534 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1158/2354] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:45.865087 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43510f52-683a-458c-87dc-bd1cf41e00be None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:45.877339 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43510f52-683a-458c-87dc-bd1cf41e00be None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:45.882568 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365c261-43ce-4ffd-8649-7ea25ab3ba4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:45.883204 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365c261-43ce-4ffd-8649-7ea25ab3ba4c admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:45.883486 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365c261-43ce-4ffd-8649-7ea25ab3ba4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:45.883860 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365c261-43ce-4ffd-8649-7ea25ab3ba4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:45.884660 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365c261-43ce-4ffd-8649-7ea25ab3ba4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:28:45.884969 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365c261-43ce-4ffd-8649-7ea25ab3ba4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:45.886899 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365c261-43ce-4ffd-8649-7ea25ab3ba4c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:45.905113 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1197/2355] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:28:45.906287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a2915-9c4a-4c70-9eaa-bb4f300b3d40 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:45.916697 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a2915-9c4a-4c70-9eaa-bb4f300b3d40 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:45.921969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e8bbe-8ca4-4b8f-8ee6-0b3b2727fa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:45.922619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e8bbe-8ca4-4b8f-8ee6-0b3b2727fa38 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:45.922893 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e8bbe-8ca4-4b8f-8ee6-0b3b2727fa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:45.923158 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e8bbe-8ca4-4b8f-8ee6-0b3b2727fa38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:45.923946 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e8bbe-8ca4-4b8f-8ee6-0b3b2727fa38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:45.926035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e8bbe-8ca4-4b8f-8ee6-0b3b2727fa38 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:45.958719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1159/2356] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:28:45 2022] POST /identity/v3/projects => generated 361 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:28:45.959759 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365c261-43ce-4ffd-8649-7ea25ab3ba4c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:45.970819 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365c261-43ce-4ffd-8649-7ea25ab3ba4c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:46.005365 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:46.034531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecce3ce-83c0-4a2b-b127-8152b997e2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:46.035147 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecce3ce-83c0-4a2b-b127-8152b997e2d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:46.035425 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecce3ce-83c0-4a2b-b127-8152b997e2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:46.035696 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecce3ce-83c0-4a2b-b127-8152b997e2d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:46.036366 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecce3ce-83c0-4a2b-b127-8152b997e2d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:46.038388 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecce3ce-83c0-4a2b-b127-8152b997e2d0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:46.065442 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1198/2357] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:28:45 2022] POST /identity/v3/users => generated 281 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:28:46.067073 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e8bbe-8ca4-4b8f-8ee6-0b3b2727fa38 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:46.078554 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e8bbe-8ca4-4b8f-8ee6-0b3b2727fa38 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:46.084315 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0eb24d-f7b8-4769-878b-f44dfb274459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:46.084982 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0eb24d-f7b8-4769-878b-f44dfb274459 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:46.085267 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0eb24d-f7b8-4769-878b-f44dfb274459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:46.085565 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0eb24d-f7b8-4769-878b-f44dfb274459 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:46.086223 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0eb24d-f7b8-4769-878b-f44dfb274459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:46.087914 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0eb24d-f7b8-4769-878b-f44dfb274459 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:46.100471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1160/2358] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:28:46.104946 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecce3ce-83c0-4a2b-b127-8152b997e2d0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:46.116058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecce3ce-83c0-4a2b-b127-8152b997e2d0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:46.121372 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023535c0-cc2c-4edb-9491-708609d4909f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:46.122056 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023535c0-cc2c-4edb-9491-708609d4909f admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:46.122317 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023535c0-cc2c-4edb-9491-708609d4909f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:46.122590 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023535c0-cc2c-4edb-9491-708609d4909f admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:46.123252 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023535c0-cc2c-4edb-9491-708609d4909f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:46.124885 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023535c0-cc2c-4edb-9491-708609d4909f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:46.136473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1199/2359] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:28:46.140664 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0eb24d-f7b8-4769-878b-f44dfb274459 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:46.146827 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:46.154436 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0eb24d-f7b8-4769-878b-f44dfb274459 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:46.161213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c99209-b51a-4b5c-99e6-93a5e8194435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:46.161915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c99209-b51a-4b5c-99e6-93a5e8194435 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:46.162193 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c99209-b51a-4b5c-99e6-93a5e8194435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:46.162631 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c99209-b51a-4b5c-99e6-93a5e8194435 admin admin] PATH_INFO: `/v3/projects/1ea405d946cb483d9c08a91ca02a4178/users/9f6e818aa9034f039ec6001a65b06f70/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:46.180392 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c99209-b51a-4b5c-99e6-93a5e8194435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ea405d946cb483d9c08a91ca02a4178, user_id=9f6e818aa9034f039ec6001a65b06f70, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:46.184979 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c99209-b51a-4b5c-99e6-93a5e8194435 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:46.217892 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1161/2360] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:28:46 2022] PUT /identity/v3/projects/1ea405d946cb483d9c08a91ca02a4178/users/9f6e818aa9034f039ec6001a65b06f70/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:46.219728 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8733c6-920a-407e-a16b-f84b7a24dabb None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:46.220123 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8733c6-920a-407e-a16b-f84b7a24dabb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:46.220568 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8733c6-920a-407e-a16b-f84b7a24dabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:46.251159 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2e8733c6-920a-407e-a16b-f84b7a24dabb None None] MFA Rules not processed for user `9f6e818aa9034f039ec6001a65b06f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:46.252462 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2e8733c6-920a-407e-a16b-f84b7a24dabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:46.329916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1200/2361] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:46.367974 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c99209-b51a-4b5c-99e6-93a5e8194435 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:46.369718 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-26c99209-b51a-4b5c-99e6-93a5e8194435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:46.442355 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c99209-b51a-4b5c-99e6-93a5e8194435 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:46.447435 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80bf6a-f6ee-473b-95b6-2afe6213ad8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:46.448052 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80bf6a-f6ee-473b-95b6-2afe6213ad8f service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:46.448396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80bf6a-f6ee-473b-95b6-2afe6213ad8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:46.448764 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80bf6a-f6ee-473b-95b6-2afe6213ad8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:46.458248 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80bf6a-f6ee-473b-95b6-2afe6213ad8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:46.461442 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80bf6a-f6ee-473b-95b6-2afe6213ad8f service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:46.472357 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1162/2362] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:28:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:28:46.486967 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8733c6-920a-407e-a16b-f84b7a24dabb None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:46.564988 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8733c6-920a-407e-a16b-f84b7a24dabb None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:46.570861 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32286f-16d4-400c-969e-724b28a8caa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:46.571823 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32286f-16d4-400c-969e-724b28a8caa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:46.572164 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32286f-16d4-400c-969e-724b28a8caa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:46.572512 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32286f-16d4-400c-969e-724b28a8caa7 admin admin] PATH_INFO: `/v3/users/9f6e818aa9034f039ec6001a65b06f70` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:46.574022 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32286f-16d4-400c-969e-724b28a8caa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f6e818aa9034f039ec6001a65b06f70)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:46.576219 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32286f-16d4-400c-969e-724b28a8caa7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:46.632586 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:46.634484 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1e32286f-16d4-400c-969e-724b28a8caa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f6e818aa9034f039ec6001a65b06f70'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:46.635537 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1e32286f-16d4-400c-969e-724b28a8caa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f6e818aa9034f039ec6001a65b06f70'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:46.650128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1e32286f-16d4-400c-969e-724b28a8caa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f6e818aa9034f039ec6001a65b06f70'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:46.657947 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1e32286f-16d4-400c-969e-724b28a8caa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f6e818aa9034f039ec6001a65b06f70'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:46.666028 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1e32286f-16d4-400c-969e-724b28a8caa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f6e818aa9034f039ec6001a65b06f70'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:46.672222 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1201/2363] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:28:46 2022] DELETE /identity/v3/users/9f6e818aa9034f039ec6001a65b06f70 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:46.676792 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189915e-91c0-4c1b-9df4-00db4e8ef215 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:46.677527 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189915e-91c0-4c1b-9df4-00db4e8ef215 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:46.677824 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189915e-91c0-4c1b-9df4-00db4e8ef215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:46.701258 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3189915e-91c0-4c1b-9df4-00db4e8ef215 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:46.702514 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3189915e-91c0-4c1b-9df4-00db4e8ef215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:46.771312 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1163/2364] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:46.782019 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32286f-16d4-400c-969e-724b28a8caa7 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:46.784081 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1e32286f-16d4-400c-969e-724b28a8caa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:46.851938 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32286f-16d4-400c-969e-724b28a8caa7 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:46.856285 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c5fee-d54c-4efc-87cf-9273b35a3b10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:46.857006 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c5fee-d54c-4efc-87cf-9273b35a3b10 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:46.857194 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c5fee-d54c-4efc-87cf-9273b35a3b10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:46.857471 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c5fee-d54c-4efc-87cf-9273b35a3b10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:46.866968 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c5fee-d54c-4efc-87cf-9273b35a3b10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:46.868417 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c5fee-d54c-4efc-87cf-9273b35a3b10 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:46.880297 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1202/2365] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:28:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:28:47.167753 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189915e-91c0-4c1b-9df4-00db4e8ef215 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:47.169509 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3189915e-91c0-4c1b-9df4-00db4e8ef215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:47.185704 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189915e-91c0-4c1b-9df4-00db4e8ef215 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:47.191971 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1db960-7489-4056-9e71-922469fe5a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:47.192595 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1db960-7489-4056-9e71-922469fe5a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:47.193561 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1db960-7489-4056-9e71-922469fe5a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:47.193738 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1db960-7489-4056-9e71-922469fe5a96 admin admin] PATH_INFO: `/v3/projects/1ea405d946cb483d9c08a91ca02a4178` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:47.195350 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1db960-7489-4056-9e71-922469fe5a96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ea405d946cb483d9c08a91ca02a4178)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:47.197583 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1db960-7489-4056-9e71-922469fe5a96 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:47.251706 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fc1db960-7489-4056-9e71-922469fe5a96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ea405d946cb483d9c08a91ca02a4178', 'request_id': 'req-fc1db960-7489-4056-9e71-922469fe5a96'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:47.257459 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fc1db960-7489-4056-9e71-922469fe5a96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ea405d946cb483d9c08a91ca02a4178', 'request_id': 'req-fc1db960-7489-4056-9e71-922469fe5a96'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:47.263774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fc1db960-7489-4056-9e71-922469fe5a96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ea405d946cb483d9c08a91ca02a4178', 'request_id': 'req-fc1db960-7489-4056-9e71-922469fe5a96'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:47.279277 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fc1db960-7489-4056-9e71-922469fe5a96 admin admin] The token cache is being invalidate because project 1ea405d946cb483d9c08a91ca02a4178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:28:47.279672 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fc1db960-7489-4056-9e71-922469fe5a96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:47.280764 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fc1db960-7489-4056-9e71-922469fe5a96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:47.283173 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1164/2366] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:28:47 2022] DELETE /identity/v3/projects/1ea405d946cb483d9c08a91ca02a4178 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:47.288100 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba07130-2764-4641-bca8-85655c1f4d65 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:47.288628 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba07130-2764-4641-bca8-85655c1f4d65 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:47.288726 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba07130-2764-4641-bca8-85655c1f4d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:47.309043 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8ba07130-2764-4641-bca8-85655c1f4d65 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:47.310311 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8ba07130-2764-4641-bca8-85655c1f4d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:47.411658 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1203/2367] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:47.419376 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51a413-44cb-486f-9c75-f5c57b364b33 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:47.419751 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51a413-44cb-486f-9c75-f5c57b364b33 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:47.420144 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51a413-44cb-486f-9c75-f5c57b364b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:47.432612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:47.497512 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3c51a413-44cb-486f-9c75-f5c57b364b33 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:47.498994 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3c51a413-44cb-486f-9c75-f5c57b364b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:47.515247 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1165/2368] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:28:47.515501 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba07130-2764-4641-bca8-85655c1f4d65 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:47.535734 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba07130-2764-4641-bca8-85655c1f4d65 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:47.554380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc8d9b-5e08-4f9a-935a-7a27b71e896e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:47.555050 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc8d9b-5e08-4f9a-935a-7a27b71e896e admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:47.555438 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc8d9b-5e08-4f9a-935a-7a27b71e896e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:47.555714 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc8d9b-5e08-4f9a-935a-7a27b71e896e admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:47.556389 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc8d9b-5e08-4f9a-935a-7a27b71e896e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:28:47.556694 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc8d9b-5e08-4f9a-935a-7a27b71e896e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:47.558381 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc8d9b-5e08-4f9a-935a-7a27b71e896e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:47.602045 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1204/2369] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:28:47.606447 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51a413-44cb-486f-9c75-f5c57b364b33 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:47.618011 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51a413-44cb-486f-9c75-f5c57b364b33 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:47.628978 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359897f-9944-453b-b776-f3c7c62e1771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:47.630388 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359897f-9944-453b-b776-f3c7c62e1771 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:47.630635 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359897f-9944-453b-b776-f3c7c62e1771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:47.631024 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359897f-9944-453b-b776-f3c7c62e1771 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:47.631581 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359897f-9944-453b-b776-f3c7c62e1771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:47.637486 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359897f-9944-453b-b776-f3c7c62e1771 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:47.711512 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1166/2370] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:28:47 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:28:47.715585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc8d9b-5e08-4f9a-935a-7a27b71e896e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:47.728817 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc8d9b-5e08-4f9a-935a-7a27b71e896e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:47.809247 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:47.820780 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433423e-cb36-4c8d-b53d-0175def837ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:47.821485 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433423e-cb36-4c8d-b53d-0175def837ad admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:47.821766 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433423e-cb36-4c8d-b53d-0175def837ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:47.822543 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433423e-cb36-4c8d-b53d-0175def837ad admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:47.823338 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433423e-cb36-4c8d-b53d-0175def837ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:47.825537 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433423e-cb36-4c8d-b53d-0175def837ad admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:47.850059 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1205/2371] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:28:47 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:28:47.853891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359897f-9944-453b-b776-f3c7c62e1771 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:47.864907 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359897f-9944-453b-b776-f3c7c62e1771 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:47.870404 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6678d-3889-4104-a6d9-974b8462c170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:47.871243 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6678d-3889-4104-a6d9-974b8462c170 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:47.871585 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6678d-3889-4104-a6d9-974b8462c170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:47.871942 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6678d-3889-4104-a6d9-974b8462c170 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:47.872830 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6678d-3889-4104-a6d9-974b8462c170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:47.875189 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6678d-3889-4104-a6d9-974b8462c170 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:47.888175 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1167/2372] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:28:47.892917 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433423e-cb36-4c8d-b53d-0175def837ad admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:47.904109 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433423e-cb36-4c8d-b53d-0175def837ad admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:47.910357 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce683fc6-df9d-48d8-8155-2e742d0b1df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:47.911434 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce683fc6-df9d-48d8-8155-2e742d0b1df3 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:47.911902 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce683fc6-df9d-48d8-8155-2e742d0b1df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:47.912297 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce683fc6-df9d-48d8-8155-2e742d0b1df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:47.913599 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce683fc6-df9d-48d8-8155-2e742d0b1df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:47.916698 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce683fc6-df9d-48d8-8155-2e742d0b1df3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:47.937068 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1206/2373] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:28:47.942250 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6678d-3889-4104-a6d9-974b8462c170 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:47.959646 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6678d-3889-4104-a6d9-974b8462c170 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:47.966626 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8829a-4c35-4a35-8878-5e7b31eefb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:47.967831 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8829a-4c35-4a35-8878-5e7b31eefb9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:47.968233 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8829a-4c35-4a35-8878-5e7b31eefb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:47.968821 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8829a-4c35-4a35-8878-5e7b31eefb9e admin admin] PATH_INFO: `/v3/projects/23403241c28b45589dd5b235980699ad/users/b0ebf849a5bc4307b6e6142ae7be808e/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:47.992579 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8829a-4c35-4a35-8878-5e7b31eefb9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=23403241c28b45589dd5b235980699ad, user_id=b0ebf849a5bc4307b6e6142ae7be808e, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:47.995278 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8829a-4c35-4a35-8878-5e7b31eefb9e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:48.013383 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1168/2374] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:28:47 2022] PUT /identity/v3/projects/23403241c28b45589dd5b235980699ad/users/b0ebf849a5bc4307b6e6142ae7be808e/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:48.024715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd2f54-37b9-46ce-8b24-78dd2abe57e2 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:48.025447 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd2f54-37b9-46ce-8b24-78dd2abe57e2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:48.025719 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd2f54-37b9-46ce-8b24-78dd2abe57e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:48.055041 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d2fd2f54-37b9-46ce-8b24-78dd2abe57e2 None None] MFA Rules not processed for user `b0ebf849a5bc4307b6e6142ae7be808e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:48.056279 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d2fd2f54-37b9-46ce-8b24-78dd2abe57e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:48.125782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1207/2375] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:48.129954 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8829a-4c35-4a35-8878-5e7b31eefb9e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:48.197848 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8829a-4c35-4a35-8878-5e7b31eefb9e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:48.205014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726302d-37ae-4d72-a644-248d69cc9670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:48.205961 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726302d-37ae-4d72-a644-248d69cc9670 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:48.206228 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726302d-37ae-4d72-a644-248d69cc9670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:48.207067 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726302d-37ae-4d72-a644-248d69cc9670 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:48.207769 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726302d-37ae-4d72-a644-248d69cc9670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:48.210633 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726302d-37ae-4d72-a644-248d69cc9670 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:48.248575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1169/2376] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:28:48 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:28:48.252857 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd2f54-37b9-46ce-8b24-78dd2abe57e2 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:48.266531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd2f54-37b9-46ce-8b24-78dd2abe57e2 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:48.326537 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75723d49-62e1-4d98-aed4-962aebec90ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:48.327934 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75723d49-62e1-4d98-aed4-962aebec90ea admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:48.328213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75723d49-62e1-4d98-aed4-962aebec90ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:48.329013 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75723d49-62e1-4d98-aed4-962aebec90ea admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:48.329699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75723d49-62e1-4d98-aed4-962aebec90ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:48.331636 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75723d49-62e1-4d98-aed4-962aebec90ea admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:48.354301 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1208/2377] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:28:48 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:28:48.358787 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726302d-37ae-4d72-a644-248d69cc9670 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:48.371289 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726302d-37ae-4d72-a644-248d69cc9670 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:48.378316 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d81291-9951-487f-95f5-469d0e822fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:48.378984 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d81291-9951-487f-95f5-469d0e822fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:48.379390 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d81291-9951-487f-95f5-469d0e822fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:48.379662 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d81291-9951-487f-95f5-469d0e822fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:48.380308 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d81291-9951-487f-95f5-469d0e822fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:48.382360 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d81291-9951-487f-95f5-469d0e822fa2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:48.396045 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1170/2378] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:28:48.400698 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75723d49-62e1-4d98-aed4-962aebec90ea admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:48.414977 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75723d49-62e1-4d98-aed4-962aebec90ea admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:48.420473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea6153-a6fd-4213-9b9e-613f885269b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:48.421183 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea6153-a6fd-4213-9b9e-613f885269b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:48.421575 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea6153-a6fd-4213-9b9e-613f885269b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:48.421951 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea6153-a6fd-4213-9b9e-613f885269b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:48.422716 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ea6153-a6fd-4213-9b9e-613f885269b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:48.424474 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ea6153-a6fd-4213-9b9e-613f885269b9 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:48.437507 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1209/2379] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:28:48.441458 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d81291-9951-487f-95f5-469d0e822fa2 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:48.451844 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d81291-9951-487f-95f5-469d0e822fa2 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:48.457965 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c4ef8-5da9-4c9d-8469-3e0aa187d7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:48.458617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c4ef8-5da9-4c9d-8469-3e0aa187d7d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:48.458891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c4ef8-5da9-4c9d-8469-3e0aa187d7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:48.459159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c4ef8-5da9-4c9d-8469-3e0aa187d7d6 admin admin] PATH_INFO: `/v3/projects/1b742312317443998c511f481f20acdb/users/c64fa2f5648b4fd693f6bd2fd706e487/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:48.475521 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c4ef8-5da9-4c9d-8469-3e0aa187d7d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b742312317443998c511f481f20acdb, user_id=c64fa2f5648b4fd693f6bd2fd706e487, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:48.478553 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c4ef8-5da9-4c9d-8469-3e0aa187d7d6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:48.493259 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1171/2380] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:28:48 2022] PUT /identity/v3/projects/1b742312317443998c511f481f20acdb/users/c64fa2f5648b4fd693f6bd2fd706e487/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:48.505111 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b40e3-0b5d-49e0-a8e8-f558c2a4ac30 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:48.505536 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b40e3-0b5d-49e0-a8e8-f558c2a4ac30 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:48.505935 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b40e3-0b5d-49e0-a8e8-f558c2a4ac30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:48.539440 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-7e2b40e3-0b5d-49e0-a8e8-f558c2a4ac30 None None] MFA Rules not processed for user `c64fa2f5648b4fd693f6bd2fd706e487`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:48.541477 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7e2b40e3-0b5d-49e0-a8e8-f558c2a4ac30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:48.576877 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:48.623079 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1210/2381] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:48.627730 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c4ef8-5da9-4c9d-8469-3e0aa187d7d6 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:48.681507 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:48.696219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c4ef8-5da9-4c9d-8469-3e0aa187d7d6 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:48.701092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d7f9e-c55a-4c9b-8dc2-6fa2faad6513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:48.701729 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d7f9e-c55a-4c9b-8dc2-6fa2faad6513 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:48.702009 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d7f9e-c55a-4c9b-8dc2-6fa2faad6513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:48.702275 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d7f9e-c55a-4c9b-8dc2-6fa2faad6513 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:48.702965 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d7f9e-c55a-4c9b-8dc2-6fa2faad6513 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:48.705493 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d7f9e-c55a-4c9b-8dc2-6fa2faad6513 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:48.745444 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1172/2382] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:28:48 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:28:48.746874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b40e3-0b5d-49e0-a8e8-f558c2a4ac30 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:48.764431 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b40e3-0b5d-49e0-a8e8-f558c2a4ac30 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:48.832080 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c69fb-8ffa-47e4-b83b-469bc04cb59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:48.833137 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c69fb-8ffa-47e4-b83b-469bc04cb59e admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:48.833666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c69fb-8ffa-47e4-b83b-469bc04cb59e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:48.834180 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c69fb-8ffa-47e4-b83b-469bc04cb59e admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:48.835431 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c69fb-8ffa-47e4-b83b-469bc04cb59e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:48.839088 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c69fb-8ffa-47e4-b83b-469bc04cb59e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:48.868787 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1211/2383] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:28:48 2022] POST /identity/v3/users => generated 295 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:28:48.874874 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d7f9e-c55a-4c9b-8dc2-6fa2faad6513 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:48.895873 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d7f9e-c55a-4c9b-8dc2-6fa2faad6513 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:48.903892 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c6831-2648-4ec0-b1a3-4947a147ce26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:48.904709 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c6831-2648-4ec0-b1a3-4947a147ce26 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:48.905118 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c6831-2648-4ec0-b1a3-4947a147ce26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:48.905600 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c6831-2648-4ec0-b1a3-4947a147ce26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:48.906516 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c6831-2648-4ec0-b1a3-4947a147ce26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:48.910308 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c6831-2648-4ec0-b1a3-4947a147ce26 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:48.933448 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1173/2384] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:28:48.938615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c69fb-8ffa-47e4-b83b-469bc04cb59e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:48.950867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c69fb-8ffa-47e4-b83b-469bc04cb59e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:48.957612 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36f9e0-8abd-4c2a-b10f-6870a1e53092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:48.958672 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36f9e0-8abd-4c2a-b10f-6870a1e53092 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:48.959031 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36f9e0-8abd-4c2a-b10f-6870a1e53092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:48.959400 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36f9e0-8abd-4c2a-b10f-6870a1e53092 admin admin] PATH_INFO: `/v3/projects/ae322d4cbe3a42bdad2d6f3ce64e24f8/users/e141d96c6a334c6286ebf8137175aec0/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:48.976521 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36f9e0-8abd-4c2a-b10f-6870a1e53092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae322d4cbe3a42bdad2d6f3ce64e24f8, user_id=e141d96c6a334c6286ebf8137175aec0, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:48.979270 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36f9e0-8abd-4c2a-b10f-6870a1e53092 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:48.994761 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1212/2385] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:28:48 2022] PUT /identity/v3/projects/ae322d4cbe3a42bdad2d6f3ce64e24f8/users/e141d96c6a334c6286ebf8137175aec0/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:48.998996 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c6831-2648-4ec0-b1a3-4947a147ce26 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:49.011822 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c6831-2648-4ec0-b1a3-4947a147ce26 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:49.072694 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8293d54-5054-43cf-a0a8-35ff1b8a80f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:49.073211 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8293d54-5054-43cf-a0a8-35ff1b8a80f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:49.073527 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8293d54-5054-43cf-a0a8-35ff1b8a80f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:49.073794 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8293d54-5054-43cf-a0a8-35ff1b8a80f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:49.074458 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8293d54-5054-43cf-a0a8-35ff1b8a80f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:49.076045 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8293d54-5054-43cf-a0a8-35ff1b8a80f6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:49.086285 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1174/2386] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:28:49.090374 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36f9e0-8abd-4c2a-b10f-6870a1e53092 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:49.101033 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36f9e0-8abd-4c2a-b10f-6870a1e53092 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:49.105941 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e3d09-4eea-44e3-ba4e-bc3c7f2f6230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:49.106576 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e3d09-4eea-44e3-ba4e-bc3c7f2f6230 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:49.106856 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e3d09-4eea-44e3-ba4e-bc3c7f2f6230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:49.107131 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e3d09-4eea-44e3-ba4e-bc3c7f2f6230 admin admin] PATH_INFO: `/v3/projects/ae322d4cbe3a42bdad2d6f3ce64e24f8/users/e141d96c6a334c6286ebf8137175aec0/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:49.109126 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e3d09-4eea-44e3-ba4e-bc3c7f2f6230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae322d4cbe3a42bdad2d6f3ce64e24f8, user_id=e141d96c6a334c6286ebf8137175aec0, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:49.112394 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e3d09-4eea-44e3-ba4e-bc3c7f2f6230 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:49.123373 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1213/2387] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:28:49 2022] PUT /identity/v3/projects/ae322d4cbe3a42bdad2d6f3ce64e24f8/users/e141d96c6a334c6286ebf8137175aec0/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:49.134937 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a8e84-c648-4318-9f14-933d146be334 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:49.135223 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a8e84-c648-4318-9f14-933d146be334 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:49.135496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a8e84-c648-4318-9f14-933d146be334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:49.167312 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a38a8e84-c648-4318-9f14-933d146be334 None None] MFA Rules not processed for user `e141d96c6a334c6286ebf8137175aec0`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:49.168583 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a38a8e84-c648-4318-9f14-933d146be334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:49.244118 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1175/2388] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:49.256781 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e3d09-4eea-44e3-ba4e-bc3c7f2f6230 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:49.258500 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-702e3d09-4eea-44e3-ba4e-bc3c7f2f6230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:49.319150 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e3d09-4eea-44e3-ba4e-bc3c7f2f6230 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:49.323296 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d9e51-2f2f-4759-935d-720ecbce4f14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:49.323978 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d9e51-2f2f-4759-935d-720ecbce4f14 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:49.324260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d9e51-2f2f-4759-935d-720ecbce4f14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:49.324592 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d9e51-2f2f-4759-935d-720ecbce4f14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:49.362173 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:49.390346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d9e51-2f2f-4759-935d-720ecbce4f14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:49.391829 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d9e51-2f2f-4759-935d-720ecbce4f14 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:49.401423 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1214/2389] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:28:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:28:50.943937 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a8e84-c648-4318-9f14-933d146be334 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:50.945359 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a38a8e84-c648-4318-9f14-933d146be334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:50.957959 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a8e84-c648-4318-9f14-933d146be334 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:50.961638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e80cff-6ae2-43fd-acec-a425f2c4954e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:50.962359 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e80cff-6ae2-43fd-acec-a425f2c4954e service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:50.962712 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e80cff-6ae2-43fd-acec-a425f2c4954e service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:50.962997 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e80cff-6ae2-43fd-acec-a425f2c4954e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:51.010620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:51.025499 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e80cff-6ae2-43fd-acec-a425f2c4954e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:51.027056 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e80cff-6ae2-43fd-acec-a425f2c4954e service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:51.036193 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1176/2390] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:28:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:28:51.657112 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d9e51-2f2f-4759-935d-720ecbce4f14 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:51.666132 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d9e51-2f2f-4759-935d-720ecbce4f14 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:51.670039 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c134eb7-0bb0-470c-aab5-aadfd4328d4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:51.670745 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c134eb7-0bb0-470c-aab5-aadfd4328d4c service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:51.671086 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c134eb7-0bb0-470c-aab5-aadfd4328d4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:51.671452 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c134eb7-0bb0-470c-aab5-aadfd4328d4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:51.680893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c134eb7-0bb0-470c-aab5-aadfd4328d4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:51.682594 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c134eb7-0bb0-470c-aab5-aadfd4328d4c service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:51.694093 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1215/2391] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:28:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:28:55.743509 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e80cff-6ae2-43fd-acec-a425f2c4954e service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:55.817445 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e80cff-6ae2-43fd-acec-a425f2c4954e service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:55.822932 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11c85c-d3bd-43da-afbf-56930153d620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:55.824372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11c85c-d3bd-43da-afbf-56930153d620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:55.824984 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11c85c-d3bd-43da-afbf-56930153d620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:55.825431 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11c85c-d3bd-43da-afbf-56930153d620 admin admin] PATH_INFO: `/v3/users/b0ebf849a5bc4307b6e6142ae7be808e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:55.826506 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11c85c-d3bd-43da-afbf-56930153d620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0ebf849a5bc4307b6e6142ae7be808e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:55.828629 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11c85c-d3bd-43da-afbf-56930153d620 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:55.882148 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2c11c85c-d3bd-43da-afbf-56930153d620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0ebf849a5bc4307b6e6142ae7be808e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:55.882796 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2c11c85c-d3bd-43da-afbf-56930153d620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0ebf849a5bc4307b6e6142ae7be808e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:55.889959 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2c11c85c-d3bd-43da-afbf-56930153d620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0ebf849a5bc4307b6e6142ae7be808e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:55.890843 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2c11c85c-d3bd-43da-afbf-56930153d620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0ebf849a5bc4307b6e6142ae7be808e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:55.898363 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2c11c85c-d3bd-43da-afbf-56930153d620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0ebf849a5bc4307b6e6142ae7be808e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:55.917124 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1177/2392] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:28:55 2022] DELETE /identity/v3/users/b0ebf849a5bc4307b6e6142ae7be808e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:55.922432 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86924f79-8b35-4bde-b443-e84329740382 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:55.923636 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86924f79-8b35-4bde-b443-e84329740382 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:55.924299 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86924f79-8b35-4bde-b443-e84329740382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:55.949180 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-86924f79-8b35-4bde-b443-e84329740382 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:28:55.950512 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-86924f79-8b35-4bde-b443-e84329740382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:56.044137 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1216/2393] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:28:56.055904 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11c85c-d3bd-43da-afbf-56930153d620 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:56.057432 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2c11c85c-d3bd-43da-afbf-56930153d620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:56.163026 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11c85c-d3bd-43da-afbf-56930153d620 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:56.167218 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56231b6-3d78-48d0-a366-8ba7c1b16210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:56.168029 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56231b6-3d78-48d0-a366-8ba7c1b16210 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:56.168494 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56231b6-3d78-48d0-a366-8ba7c1b16210 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:56.168914 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56231b6-3d78-48d0-a366-8ba7c1b16210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:56.180649 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56231b6-3d78-48d0-a366-8ba7c1b16210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:56.182096 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56231b6-3d78-48d0-a366-8ba7c1b16210 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:56.194772 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1178/2394] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:28:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:28:56.482116 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86924f79-8b35-4bde-b443-e84329740382 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:56.483649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-86924f79-8b35-4bde-b443-e84329740382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:56.496552 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86924f79-8b35-4bde-b443-e84329740382 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:56.501557 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b334ee3-d609-4541-9783-1732f6d90431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:56.502206 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b334ee3-d609-4541-9783-1732f6d90431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:56.502482 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b334ee3-d609-4541-9783-1732f6d90431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:56.502751 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b334ee3-d609-4541-9783-1732f6d90431 admin admin] PATH_INFO: `/v3/projects/23403241c28b45589dd5b235980699ad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:56.503874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b334ee3-d609-4541-9783-1732f6d90431 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23403241c28b45589dd5b235980699ad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:56.505878 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b334ee3-d609-4541-9783-1732f6d90431 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:56.560135 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3b334ee3-d609-4541-9783-1732f6d90431 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23403241c28b45589dd5b235980699ad', 'request_id': 'req-3b334ee3-d609-4541-9783-1732f6d90431'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:56.566183 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3b334ee3-d609-4541-9783-1732f6d90431 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23403241c28b45589dd5b235980699ad', 'request_id': 'req-3b334ee3-d609-4541-9783-1732f6d90431'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:56.572661 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3b334ee3-d609-4541-9783-1732f6d90431 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23403241c28b45589dd5b235980699ad', 'request_id': 'req-3b334ee3-d609-4541-9783-1732f6d90431'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:56.586433 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3b334ee3-d609-4541-9783-1732f6d90431 admin admin] The token cache is being invalidate because project 23403241c28b45589dd5b235980699ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:28:56.586720 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3b334ee3-d609-4541-9783-1732f6d90431 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:56.587350 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3b334ee3-d609-4541-9783-1732f6d90431 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:56.588974 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1217/2395] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:28:56 2022] DELETE /identity/v3/projects/23403241c28b45589dd5b235980699ad => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:56.592908 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56231b6-3d78-48d0-a366-8ba7c1b16210 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:56.604065 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56231b6-3d78-48d0-a366-8ba7c1b16210 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:56.607672 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:56.666634 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ee9da-5871-4b0f-b87e-baa301b013f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:56.667271 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ee9da-5871-4b0f-b87e-baa301b013f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:56.667575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ee9da-5871-4b0f-b87e-baa301b013f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:56.667849 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ee9da-5871-4b0f-b87e-baa301b013f6 admin admin] PATH_INFO: `/v3/users/c64fa2f5648b4fd693f6bd2fd706e487` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:56.669066 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ee9da-5871-4b0f-b87e-baa301b013f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c64fa2f5648b4fd693f6bd2fd706e487)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:56.671084 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ee9da-5871-4b0f-b87e-baa301b013f6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:56.723577 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-352ee9da-5871-4b0f-b87e-baa301b013f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c64fa2f5648b4fd693f6bd2fd706e487'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:56.724222 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-352ee9da-5871-4b0f-b87e-baa301b013f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c64fa2f5648b4fd693f6bd2fd706e487'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:56.734075 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-352ee9da-5871-4b0f-b87e-baa301b013f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c64fa2f5648b4fd693f6bd2fd706e487'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:56.735081 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-352ee9da-5871-4b0f-b87e-baa301b013f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c64fa2f5648b4fd693f6bd2fd706e487'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:56.746109 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-352ee9da-5871-4b0f-b87e-baa301b013f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c64fa2f5648b4fd693f6bd2fd706e487'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:56.780895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1179/2396] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:28:56 2022] DELETE /identity/v3/users/c64fa2f5648b4fd693f6bd2fd706e487 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:57.454805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b334ee3-d609-4541-9783-1732f6d90431 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:57.456872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3b334ee3-d609-4541-9783-1732f6d90431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:57.475216 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b334ee3-d609-4541-9783-1732f6d90431 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:57.525254 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:57.562967 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c3793-e64e-40f7-8d7a-665c224eacad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:57.564241 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c3793-e64e-40f7-8d7a-665c224eacad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:57.565001 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c3793-e64e-40f7-8d7a-665c224eacad admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:57.565475 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c3793-e64e-40f7-8d7a-665c224eacad admin admin] PATH_INFO: `/v3/projects/1b742312317443998c511f481f20acdb` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:57.567145 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c3793-e64e-40f7-8d7a-665c224eacad admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b742312317443998c511f481f20acdb)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:57.569525 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c3793-e64e-40f7-8d7a-665c224eacad admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:57.635789 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-be2c3793-e64e-40f7-8d7a-665c224eacad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b742312317443998c511f481f20acdb', 'request_id': 'req-be2c3793-e64e-40f7-8d7a-665c224eacad'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:57.643800 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-be2c3793-e64e-40f7-8d7a-665c224eacad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b742312317443998c511f481f20acdb', 'request_id': 'req-be2c3793-e64e-40f7-8d7a-665c224eacad'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:57.654367 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-be2c3793-e64e-40f7-8d7a-665c224eacad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b742312317443998c511f481f20acdb', 'request_id': 'req-be2c3793-e64e-40f7-8d7a-665c224eacad'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:57.675555 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-be2c3793-e64e-40f7-8d7a-665c224eacad admin admin] The token cache is being invalidate because project 1b742312317443998c511f481f20acdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:28:57.675697 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-be2c3793-e64e-40f7-8d7a-665c224eacad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:57.676411 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-be2c3793-e64e-40f7-8d7a-665c224eacad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:57.678069 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1218/2397] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:28:57 2022] DELETE /identity/v3/projects/1b742312317443998c511f481f20acdb => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:57.682631 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ee9da-5871-4b0f-b87e-baa301b013f6 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:57.684175 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-352ee9da-5871-4b0f-b87e-baa301b013f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:57.697770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ee9da-5871-4b0f-b87e-baa301b013f6 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:57.760524 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccfd17-96fe-4a5d-9915-436164556dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:57.761196 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccfd17-96fe-4a5d-9915-436164556dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:57.761353 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccfd17-96fe-4a5d-9915-436164556dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:57.761656 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccfd17-96fe-4a5d-9915-436164556dca admin admin] PATH_INFO: `/v3/users/e141d96c6a334c6286ebf8137175aec0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:57.762786 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccfd17-96fe-4a5d-9915-436164556dca admin admin] RBAC: Authorizing `identity:delete_user(user_id=e141d96c6a334c6286ebf8137175aec0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:57.764694 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccfd17-96fe-4a5d-9915-436164556dca admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:57.797981 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:57.834513 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f1ccfd17-96fe-4a5d-9915-436164556dca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e141d96c6a334c6286ebf8137175aec0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:57.835533 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f1ccfd17-96fe-4a5d-9915-436164556dca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e141d96c6a334c6286ebf8137175aec0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:57.846539 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f1ccfd17-96fe-4a5d-9915-436164556dca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e141d96c6a334c6286ebf8137175aec0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:57.847622 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f1ccfd17-96fe-4a5d-9915-436164556dca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e141d96c6a334c6286ebf8137175aec0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:57.856422 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f1ccfd17-96fe-4a5d-9915-436164556dca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e141d96c6a334c6286ebf8137175aec0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:57.889633 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1180/2398] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:28:57 2022] DELETE /identity/v3/users/e141d96c6a334c6286ebf8137175aec0 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:28:58.304290 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c3793-e64e-40f7-8d7a-665c224eacad admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:28:58.306091 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-be2c3793-e64e-40f7-8d7a-665c224eacad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:28:58.329477 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c3793-e64e-40f7-8d7a-665c224eacad admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:28:58.452784 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0a03d-dfb4-45c0-8428-608b0d59530e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:28:58.453713 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0a03d-dfb4-45c0-8428-608b0d59530e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:28:58.454015 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0a03d-dfb4-45c0-8428-608b0d59530e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:28:58.454332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0a03d-dfb4-45c0-8428-608b0d59530e admin admin] PATH_INFO: `/v3/projects/ae322d4cbe3a42bdad2d6f3ce64e24f8` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:28:58.455450 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0a03d-dfb4-45c0-8428-608b0d59530e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae322d4cbe3a42bdad2d6f3ce64e24f8)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:28:58.457556 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0a03d-dfb4-45c0-8428-608b0d59530e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:28:58.513083 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d2b0a03d-dfb4-45c0-8428-608b0d59530e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae322d4cbe3a42bdad2d6f3ce64e24f8', 'request_id': 'req-d2b0a03d-dfb4-45c0-8428-608b0d59530e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:58.519775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d2b0a03d-dfb4-45c0-8428-608b0d59530e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae322d4cbe3a42bdad2d6f3ce64e24f8', 'request_id': 'req-d2b0a03d-dfb4-45c0-8428-608b0d59530e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:58.526814 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d2b0a03d-dfb4-45c0-8428-608b0d59530e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae322d4cbe3a42bdad2d6f3ce64e24f8', 'request_id': 'req-d2b0a03d-dfb4-45c0-8428-608b0d59530e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:58.550302 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d2b0a03d-dfb4-45c0-8428-608b0d59530e admin admin] The token cache is being invalidate because project ae322d4cbe3a42bdad2d6f3ce64e24f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:28:58.550666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d2b0a03d-dfb4-45c0-8428-608b0d59530e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:58.551567 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d2b0a03d-dfb4-45c0-8428-608b0d59530e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:28:58.553342 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1219/2399] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:28:58 2022] DELETE /identity/v3/projects/ae322d4cbe3a42bdad2d6f3ce64e24f8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:29:03.474666 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18004a6-6cd9-476e-9756-10237d2c9a67 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:03.475180 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18004a6-6cd9-476e-9756-10237d2c9a67 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:03.475278 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18004a6-6cd9-476e-9756-10237d2c9a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:03.495208 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f18004a6-6cd9-476e-9756-10237d2c9a67 None None] MFA Rules not processed for user `9e7444bc40314e73b282217bbb94798d`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:29:03.496541 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f18004a6-6cd9-476e-9756-10237d2c9a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:03.554927 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1181/2400] 10.222.0.94 () {58 vars in 967 bytes} [Thu Sep 1 17:29:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:29:03.568206 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0a03d-dfb4-45c0-8428-608b0d59530e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:03.569669 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d2b0a03d-dfb4-45c0-8428-608b0d59530e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:03.580803 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:03.671172 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0a03d-dfb4-45c0-8428-608b0d59530e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:03.677341 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d563aa-fcd3-41da-8dc8-fb8f7136bdda service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7ebf43f36c4862a3c527941e033666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:03.678273 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d563aa-fcd3-41da-8dc8-fb8f7136bdda service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:03.678573 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d563aa-fcd3-41da-8dc8-fb8f7136bdda service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:03.678990 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d563aa-fcd3-41da-8dc8-fb8f7136bdda service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:03.689883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d563aa-fcd3-41da-8dc8-fb8f7136bdda service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:03.691681 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d563aa-fcd3-41da-8dc8-fb8f7136bdda service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:03.716916 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1220/2401] 10.222.0.94 () {60 vars in 1384 bytes} [Thu Sep 1 17:29:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 17:29:05.732921 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18004a6-6cd9-476e-9756-10237d2c9a67 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:05.735150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f18004a6-6cd9-476e-9756-10237d2c9a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:05.813526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18004a6-6cd9-476e-9756-10237d2c9a67 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:05.818135 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29488fb9-d709-465e-9650-821e1f857738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:05.818770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29488fb9-d709-465e-9650-821e1f857738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:05.819046 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29488fb9-d709-465e-9650-821e1f857738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:05.819304 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29488fb9-d709-465e-9650-821e1f857738 admin admin] PATH_INFO: `/v3/users/f87c6d0e007d44c1a935c73404a9b619` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:05.820452 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29488fb9-d709-465e-9650-821e1f857738 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f87c6d0e007d44c1a935c73404a9b619)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:05.822398 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29488fb9-d709-465e-9650-821e1f857738 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:05.873136 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-29488fb9-d709-465e-9650-821e1f857738 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f87c6d0e007d44c1a935c73404a9b619'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:05.873826 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-29488fb9-d709-465e-9650-821e1f857738 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f87c6d0e007d44c1a935c73404a9b619'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:05.878422 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:05.884700 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-29488fb9-d709-465e-9650-821e1f857738 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f87c6d0e007d44c1a935c73404a9b619'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:05.886310 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-29488fb9-d709-465e-9650-821e1f857738 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f87c6d0e007d44c1a935c73404a9b619'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:05.898624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-29488fb9-d709-465e-9650-821e1f857738 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f87c6d0e007d44c1a935c73404a9b619'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:05.926658 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1182/2402] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:29:05 2022] DELETE /identity/v3/users/f87c6d0e007d44c1a935c73404a9b619 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:29:06.185757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d563aa-fcd3-41da-8dc8-fb8f7136bdda service swift] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:06.198194 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d563aa-fcd3-41da-8dc8-fb8f7136bdda service swift] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:06.263375 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fe1a3-1ffc-494a-9911-3e0642a68d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:06.264006 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fe1a3-1ffc-494a-9911-3e0642a68d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:06.264287 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fe1a3-1ffc-494a-9911-3e0642a68d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:06.264567 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fe1a3-1ffc-494a-9911-3e0642a68d0a admin admin] PATH_INFO: `/v3/projects/d27808985f0247b7a5934742c0f2d7e0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:06.266279 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3fe1a3-1ffc-494a-9911-3e0642a68d0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d27808985f0247b7a5934742c0f2d7e0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:06.268203 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3fe1a3-1ffc-494a-9911-3e0642a68d0a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:06.317674 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2f3fe1a3-1ffc-494a-9911-3e0642a68d0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd27808985f0247b7a5934742c0f2d7e0', 'request_id': 'req-2f3fe1a3-1ffc-494a-9911-3e0642a68d0a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:06.323089 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2f3fe1a3-1ffc-494a-9911-3e0642a68d0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd27808985f0247b7a5934742c0f2d7e0', 'request_id': 'req-2f3fe1a3-1ffc-494a-9911-3e0642a68d0a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:06.329696 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2f3fe1a3-1ffc-494a-9911-3e0642a68d0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd27808985f0247b7a5934742c0f2d7e0', 'request_id': 'req-2f3fe1a3-1ffc-494a-9911-3e0642a68d0a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:06.341757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2f3fe1a3-1ffc-494a-9911-3e0642a68d0a admin admin] The token cache is being invalidate because project d27808985f0247b7a5934742c0f2d7e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:29:06.341985 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2f3fe1a3-1ffc-494a-9911-3e0642a68d0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:06.342626 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2f3fe1a3-1ffc-494a-9911-3e0642a68d0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:06.344674 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1221/2403] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:29:06 2022] DELETE /identity/v3/projects/d27808985f0247b7a5934742c0f2d7e0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:29:06.349625 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6db14-17fc-4ed8-b736-07d85eeb4d2d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:06.349909 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6db14-17fc-4ed8-b736-07d85eeb4d2d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:06.350180 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6db14-17fc-4ed8-b736-07d85eeb4d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:06.369579 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d7b6db14-17fc-4ed8-b736-07d85eeb4d2d None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:29:06.370782 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d7b6db14-17fc-4ed8-b736-07d85eeb4d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:06.428969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1183/2404] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:29:06.437331 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e8635-f312-4524-9d72-1c62961677a1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:06.437648 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e8635-f312-4524-9d72-1c62961677a1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:06.437948 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e8635-f312-4524-9d72-1c62961677a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:06.458030 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-536e8635-f312-4524-9d72-1c62961677a1 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:29:06.459263 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-536e8635-f312-4524-9d72-1c62961677a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:06.467989 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1222/2405] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:29:06.472517 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6db14-17fc-4ed8-b736-07d85eeb4d2d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:06.482361 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6db14-17fc-4ed8-b736-07d85eeb4d2d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:06.486957 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e201b2b-95ac-4012-9b19-c623ca6b0f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:06.487587 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e201b2b-95ac-4012-9b19-c623ca6b0f60 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:06.487861 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e201b2b-95ac-4012-9b19-c623ca6b0f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:06.488127 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e201b2b-95ac-4012-9b19-c623ca6b0f60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:06.488767 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e201b2b-95ac-4012-9b19-c623ca6b0f60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:29:06.489070 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e201b2b-95ac-4012-9b19-c623ca6b0f60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:06.490690 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e201b2b-95ac-4012-9b19-c623ca6b0f60 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:06.502489 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1184/2406] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:29:06.506893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e8635-f312-4524-9d72-1c62961677a1 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:06.516848 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e8635-f312-4524-9d72-1c62961677a1 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:06.521572 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84367e5-0eed-4308-9019-d1ad1f62eaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:06.522174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84367e5-0eed-4308-9019-d1ad1f62eaf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:06.522454 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84367e5-0eed-4308-9019-d1ad1f62eaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:06.522727 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84367e5-0eed-4308-9019-d1ad1f62eaf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:06.523361 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84367e5-0eed-4308-9019-d1ad1f62eaf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:06.525259 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84367e5-0eed-4308-9019-d1ad1f62eaf3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:06.546451 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:06.555492 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1223/2407] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:29:06 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:29:06.559634 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e201b2b-95ac-4012-9b19-c623ca6b0f60 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:06.570267 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e201b2b-95ac-4012-9b19-c623ca6b0f60 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:06.623901 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a9f47-a4e0-4ede-8f3a-bf75db648a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:06.624935 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a9f47-a4e0-4ede-8f3a-bf75db648a3b admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:06.625226 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a9f47-a4e0-4ede-8f3a-bf75db648a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:06.625620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a9f47-a4e0-4ede-8f3a-bf75db648a3b admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:06.626259 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a9f47-a4e0-4ede-8f3a-bf75db648a3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:06.628308 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a9f47-a4e0-4ede-8f3a-bf75db648a3b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:06.651501 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1185/2408] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:29:06 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:29:06.655674 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84367e5-0eed-4308-9019-d1ad1f62eaf3 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:06.665989 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84367e5-0eed-4308-9019-d1ad1f62eaf3 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:06.670674 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999292ea-52c3-408b-8fcf-d9a91696fb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:06.671330 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999292ea-52c3-408b-8fcf-d9a91696fb5a admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:06.671611 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999292ea-52c3-408b-8fcf-d9a91696fb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:06.671883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999292ea-52c3-408b-8fcf-d9a91696fb5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:06.672518 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999292ea-52c3-408b-8fcf-d9a91696fb5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:06.674168 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999292ea-52c3-408b-8fcf-d9a91696fb5a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:06.683906 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1224/2409] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:29:06.688565 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a9f47-a4e0-4ede-8f3a-bf75db648a3b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:06.698438 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a9f47-a4e0-4ede-8f3a-bf75db648a3b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:06.703695 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f1aac-25c6-4ee3-aa5d-0ee123a36fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:06.704279 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f1aac-25c6-4ee3-aa5d-0ee123a36fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:06.704563 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f1aac-25c6-4ee3-aa5d-0ee123a36fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:06.704832 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f1aac-25c6-4ee3-aa5d-0ee123a36fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:06.705500 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f1aac-25c6-4ee3-aa5d-0ee123a36fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:06.707120 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f1aac-25c6-4ee3-aa5d-0ee123a36fc2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:06.717444 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1186/2410] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:29:06.721344 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999292ea-52c3-408b-8fcf-d9a91696fb5a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:06.731116 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999292ea-52c3-408b-8fcf-d9a91696fb5a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:06.736261 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60f73c-1c38-4dd4-bb77-419c907ea3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:06.736902 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60f73c-1c38-4dd4-bb77-419c907ea3b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:06.737185 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60f73c-1c38-4dd4-bb77-419c907ea3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:06.737728 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60f73c-1c38-4dd4-bb77-419c907ea3b7 admin admin] PATH_INFO: `/v3/projects/502d8f6d6b25473ba22dbe556d67098a/users/4c284b298cb34b069f8a66bcfa10b999/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:06.753297 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60f73c-1c38-4dd4-bb77-419c907ea3b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=502d8f6d6b25473ba22dbe556d67098a, user_id=4c284b298cb34b069f8a66bcfa10b999, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:06.755986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60f73c-1c38-4dd4-bb77-419c907ea3b7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:06.769098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1225/2411] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:29:06 2022] PUT /identity/v3/projects/502d8f6d6b25473ba22dbe556d67098a/users/4c284b298cb34b069f8a66bcfa10b999/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:29:06.774112 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288730b6-9d76-45af-9677-190fce15a4fe None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:06.774577 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288730b6-9d76-45af-9677-190fce15a4fe None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:06.774670 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288730b6-9d76-45af-9677-190fce15a4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:06.793683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-288730b6-9d76-45af-9677-190fce15a4fe None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:29:06.794883 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-288730b6-9d76-45af-9677-190fce15a4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:06.824317 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:06.857538 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1187/2412] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:29:06.867368 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60f73c-1c38-4dd4-bb77-419c907ea3b7 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:06.869319 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ef60f73c-1c38-4dd4-bb77-419c907ea3b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:06.930794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60f73c-1c38-4dd4-bb77-419c907ea3b7 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:06.934690 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387bfa2-1898-44a9-a003-1654f6adc7bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:06.935305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387bfa2-1898-44a9-a003-1654f6adc7bc service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:06.935587 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387bfa2-1898-44a9-a003-1654f6adc7bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:06.935860 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387bfa2-1898-44a9-a003-1654f6adc7bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:06.946092 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387bfa2-1898-44a9-a003-1654f6adc7bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:06.947543 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387bfa2-1898-44a9-a003-1654f6adc7bc service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:06.958853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1226/2413] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:29:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:29:11.618903 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cda25b-03b1-49c3-b459-2c37dfac3b61 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:11.619555 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cda25b-03b1-49c3-b459-2c37dfac3b61 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:11.619555 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cda25b-03b1-49c3-b459-2c37dfac3b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:11.652532 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-16cda25b-03b1-49c3-b459-2c37dfac3b61 None None] MFA Rules not processed for user `4c284b298cb34b069f8a66bcfa10b999`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:29:11.653831 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-16cda25b-03b1-49c3-b459-2c37dfac3b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:11.724651 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1188/2414] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:29:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:29:11.729385 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387bfa2-1898-44a9-a003-1654f6adc7bc service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:11.739425 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387bfa2-1898-44a9-a003-1654f6adc7bc service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:11.749743 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790059a9-7dfe-4944-bf42-df6aeb6930a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:11.750380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790059a9-7dfe-4944-bf42-df6aeb6930a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:11.750656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790059a9-7dfe-4944-bf42-df6aeb6930a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:11.750919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790059a9-7dfe-4944-bf42-df6aeb6930a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:11.751558 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790059a9-7dfe-4944-bf42-df6aeb6930a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:11.753516 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790059a9-7dfe-4944-bf42-df6aeb6930a9 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:11.783909 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1227/2415] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:29:11 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:29:11.788202 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cda25b-03b1-49c3-b459-2c37dfac3b61 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:11.801675 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cda25b-03b1-49c3-b459-2c37dfac3b61 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:11.869396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a63c43-479a-49a5-a2ae-015a809cbe6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:11.870038 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a63c43-479a-49a5-a2ae-015a809cbe6a admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:11.870315 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a63c43-479a-49a5-a2ae-015a809cbe6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:11.870609 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a63c43-479a-49a5-a2ae-015a809cbe6a admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:11.871240 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a63c43-479a-49a5-a2ae-015a809cbe6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:11.873206 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a63c43-479a-49a5-a2ae-015a809cbe6a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:11.900948 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1189/2416] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:29:11 2022] POST /identity/v3/users => generated 298 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:29:11.904896 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790059a9-7dfe-4944-bf42-df6aeb6930a9 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:11.921280 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790059a9-7dfe-4944-bf42-df6aeb6930a9 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:11.926265 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eaf0c9-36fd-4e5b-b05c-74798fab5dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:11.926893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eaf0c9-36fd-4e5b-b05c-74798fab5dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:11.927169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eaf0c9-36fd-4e5b-b05c-74798fab5dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:11.927435 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eaf0c9-36fd-4e5b-b05c-74798fab5dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:11.928236 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eaf0c9-36fd-4e5b-b05c-74798fab5dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:11.929867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eaf0c9-36fd-4e5b-b05c-74798fab5dd0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:11.947188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1228/2417] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:29:11.948407 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a63c43-479a-49a5-a2ae-015a809cbe6a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:11.959719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a63c43-479a-49a5-a2ae-015a809cbe6a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:11.965010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de0a74-50b1-4a00-8ac0-6ebd5ddb8d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:11.965785 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de0a74-50b1-4a00-8ac0-6ebd5ddb8d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:11.966127 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de0a74-50b1-4a00-8ac0-6ebd5ddb8d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:11.966492 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de0a74-50b1-4a00-8ac0-6ebd5ddb8d7b admin admin] PATH_INFO: `/v3/projects/62ace6d6acb34906937386d27065b868/users/12c28f82abb64d348692985276a0ab66/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:11.983959 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de0a74-50b1-4a00-8ac0-6ebd5ddb8d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=62ace6d6acb34906937386d27065b868, user_id=12c28f82abb64d348692985276a0ab66, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:11.986849 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de0a74-50b1-4a00-8ac0-6ebd5ddb8d7b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:12.004813 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1190/2418] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:29:11 2022] PUT /identity/v3/projects/62ace6d6acb34906937386d27065b868/users/12c28f82abb64d348692985276a0ab66/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:29:12.009027 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eaf0c9-36fd-4e5b-b05c-74798fab5dd0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:12.019638 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eaf0c9-36fd-4e5b-b05c-74798fab5dd0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:12.082950 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983603a3-00e8-477a-9be1-d5fdf653a43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:12.083541 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983603a3-00e8-477a-9be1-d5fdf653a43c admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:12.083817 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983603a3-00e8-477a-9be1-d5fdf653a43c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:12.084090 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983603a3-00e8-477a-9be1-d5fdf653a43c admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:12.084741 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983603a3-00e8-477a-9be1-d5fdf653a43c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:12.086458 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983603a3-00e8-477a-9be1-d5fdf653a43c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:12.098980 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1229/2419] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:29:12.106648 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de0a74-50b1-4a00-8ac0-6ebd5ddb8d7b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:12.128704 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de0a74-50b1-4a00-8ac0-6ebd5ddb8d7b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:12.136197 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241f918-0b53-4219-8272-13ae00a81644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:12.137106 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241f918-0b53-4219-8272-13ae00a81644 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:12.137422 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241f918-0b53-4219-8272-13ae00a81644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:12.137731 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241f918-0b53-4219-8272-13ae00a81644 admin admin] PATH_INFO: `/v3/projects/62ace6d6acb34906937386d27065b868/users/12c28f82abb64d348692985276a0ab66/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:12.139715 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241f918-0b53-4219-8272-13ae00a81644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62ace6d6acb34906937386d27065b868, user_id=12c28f82abb64d348692985276a0ab66, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:12.142562 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241f918-0b53-4219-8272-13ae00a81644 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:12.153265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1191/2420] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:29:12 2022] PUT /identity/v3/projects/62ace6d6acb34906937386d27065b868/users/12c28f82abb64d348692985276a0ab66/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:29:17.438573 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983603a3-00e8-477a-9be1-d5fdf653a43c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:17.440355 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-983603a3-00e8-477a-9be1-d5fdf653a43c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:17.454525 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983603a3-00e8-477a-9be1-d5fdf653a43c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:17.481576 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:17.523990 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7c45e-65d9-4aed-866e-835c28a88b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:17.524653 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7c45e-65d9-4aed-866e-835c28a88b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:17.524933 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7c45e-65d9-4aed-866e-835c28a88b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:17.525430 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7c45e-65d9-4aed-866e-835c28a88b0f admin admin] PATH_INFO: `/v3/users/1877ab5d300543999a730ad4d199f300` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:17.526624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7c45e-65d9-4aed-866e-835c28a88b0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1877ab5d300543999a730ad4d199f300)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:17.529035 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7c45e-65d9-4aed-866e-835c28a88b0f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:17.603568 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-36c7c45e-65d9-4aed-866e-835c28a88b0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1877ab5d300543999a730ad4d199f300'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:17.604245 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-36c7c45e-65d9-4aed-866e-835c28a88b0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1877ab5d300543999a730ad4d199f300'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:17.618229 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-36c7c45e-65d9-4aed-866e-835c28a88b0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1877ab5d300543999a730ad4d199f300'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:17.625801 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-36c7c45e-65d9-4aed-866e-835c28a88b0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1877ab5d300543999a730ad4d199f300'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:17.633243 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-36c7c45e-65d9-4aed-866e-835c28a88b0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1877ab5d300543999a730ad4d199f300'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:17.639673 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1230/2421] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:29:17 2022] DELETE /identity/v3/users/1877ab5d300543999a730ad4d199f300 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:29:17.644351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608670d4-d7cb-4089-a346-f55df216b3d1 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:17.645034 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608670d4-d7cb-4089-a346-f55df216b3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:17.645034 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608670d4-d7cb-4089-a346-f55df216b3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:17.666249 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-608670d4-d7cb-4089-a346-f55df216b3d1 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:29:17.667547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-608670d4-d7cb-4089-a346-f55df216b3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:17.680394 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:17.736914 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1192/2422] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:29:17.747778 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7c45e-65d9-4aed-866e-835c28a88b0f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:17.749644 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-36c7c45e-65d9-4aed-866e-835c28a88b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:17.822825 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7c45e-65d9-4aed-866e-835c28a88b0f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:17.826444 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3606d9b-455b-4659-bf79-0b78f867972e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:17.827093 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3606d9b-455b-4659-bf79-0b78f867972e service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:17.827366 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3606d9b-455b-4659-bf79-0b78f867972e service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:17.827637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3606d9b-455b-4659-bf79-0b78f867972e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:17.840091 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3606d9b-455b-4659-bf79-0b78f867972e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:17.841780 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3606d9b-455b-4659-bf79-0b78f867972e service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:17.854585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1231/2423] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:29:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:29:18.151084 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe63174-9b8d-4f4b-97a5-7a6357518d7d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:18.151686 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe63174-9b8d-4f4b-97a5-7a6357518d7d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:18.152205 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe63174-9b8d-4f4b-97a5-7a6357518d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:18.192276 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5fe63174-9b8d-4f4b-97a5-7a6357518d7d None None] MFA Rules not processed for user `12c28f82abb64d348692985276a0ab66`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:29:18.193540 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5fe63174-9b8d-4f4b-97a5-7a6357518d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:18.272302 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1193/2424] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:29:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:29:18.284425 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3606d9b-455b-4659-bf79-0b78f867972e service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:18.285953 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c3606d9b-455b-4659-bf79-0b78f867972e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:18.294328 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe63174-9b8d-4f4b-97a5-7a6357518d7d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:18.296474 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5fe63174-9b8d-4f4b-97a5-7a6357518d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:18.312372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe63174-9b8d-4f4b-97a5-7a6357518d7d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:18.317286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6ddbe-7fc9-47e0-af48-5acb1151e144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:18.317963 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6ddbe-7fc9-47e0-af48-5acb1151e144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:18.318232 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6ddbe-7fc9-47e0-af48-5acb1151e144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:18.318498 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6ddbe-7fc9-47e0-af48-5acb1151e144 admin admin] PATH_INFO: `/v3/projects/0edbd0609ac047d19c0e1eb3ad001636` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:18.319615 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6ddbe-7fc9-47e0-af48-5acb1151e144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0edbd0609ac047d19c0e1eb3ad001636)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:18.321862 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6ddbe-7fc9-47e0-af48-5acb1151e144 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:18.367726 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3606d9b-455b-4659-bf79-0b78f867972e service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:18.389383 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-83e6ddbe-7fc9-47e0-af48-5acb1151e144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0edbd0609ac047d19c0e1eb3ad001636', 'request_id': 'req-83e6ddbe-7fc9-47e0-af48-5acb1151e144'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:18.396198 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:18.410177 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-83e6ddbe-7fc9-47e0-af48-5acb1151e144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0edbd0609ac047d19c0e1eb3ad001636', 'request_id': 'req-83e6ddbe-7fc9-47e0-af48-5acb1151e144'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:18.417812 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-83e6ddbe-7fc9-47e0-af48-5acb1151e144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0edbd0609ac047d19c0e1eb3ad001636', 'request_id': 'req-83e6ddbe-7fc9-47e0-af48-5acb1151e144'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:18.438740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-83e6ddbe-7fc9-47e0-af48-5acb1151e144 admin admin] The token cache is being invalidate because project 0edbd0609ac047d19c0e1eb3ad001636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:29:18.439111 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-83e6ddbe-7fc9-47e0-af48-5acb1151e144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:18.444962 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-83e6ddbe-7fc9-47e0-af48-5acb1151e144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:18.449557 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1194/2425] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:29:18 2022] DELETE /identity/v3/projects/0edbd0609ac047d19c0e1eb3ad001636 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:29:18.451909 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cef72c-5b52-40d2-8595-b2890961ad56 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:18.452262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cef72c-5b52-40d2-8595-b2890961ad56 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:18.452470 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cef72c-5b52-40d2-8595-b2890961ad56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:18.452914 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b90c38-d341-44b8-9a4e-7605d63bbb0f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6647f3aa54dc68e888b3adb8c28b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:18.453577 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b90c38-d341-44b8-9a4e-7605d63bbb0f service glance] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:18.453862 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b90c38-d341-44b8-9a4e-7605d63bbb0f service glance] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:18.454136 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b90c38-d341-44b8-9a4e-7605d63bbb0f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:18.455917 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-76b90c38-d341-44b8-9a4e-7605d63bbb0f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:18.475983 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a5cef72c-5b52-40d2-8595-b2890961ad56 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:29:18.477497 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a5cef72c-5b52-40d2-8595-b2890961ad56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:18.500358 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:18.527573 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b90c38-d341-44b8-9a4e-7605d63bbb0f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:18.529271 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b90c38-d341-44b8-9a4e-7605d63bbb0f service glance] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:18.540914 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1232/2426] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:29:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:29:18.564001 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1195/2427] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:29:18.631990 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419278e-6aee-4a0d-8956-165cb4683a90 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:18.632167 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419278e-6aee-4a0d-8956-165cb4683a90 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:18.632443 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419278e-6aee-4a0d-8956-165cb4683a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:18.654011 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2419278e-6aee-4a0d-8956-165cb4683a90 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:29:18.656196 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2419278e-6aee-4a0d-8956-165cb4683a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:18.666451 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1233/2428] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:29:18.671345 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cef72c-5b52-40d2-8595-b2890961ad56 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:18.682455 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cef72c-5b52-40d2-8595-b2890961ad56 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:18.690340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4a069-eead-40a6-a7a4-fce3b8ec7915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:18.691424 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4a069-eead-40a6-a7a4-fce3b8ec7915 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:18.692013 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4a069-eead-40a6-a7a4-fce3b8ec7915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:18.692422 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4a069-eead-40a6-a7a4-fce3b8ec7915 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:18.693222 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4a069-eead-40a6-a7a4-fce3b8ec7915 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:29:18.693689 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4a069-eead-40a6-a7a4-fce3b8ec7915 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:18.695686 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4a069-eead-40a6-a7a4-fce3b8ec7915 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:18.712398 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1196/2429] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:29:18.713425 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419278e-6aee-4a0d-8956-165cb4683a90 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:18.718793 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bec446-8842-42ce-ab60-2f50616d413b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:18.719080 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bec446-8842-42ce-ab60-2f50616d413b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:18.719354 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bec446-8842-42ce-ab60-2f50616d413b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:18.723745 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419278e-6aee-4a0d-8956-165cb4683a90 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:18.728565 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be76d9-951f-49fb-aa39-062f6d38543e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:18.729185 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be76d9-951f-49fb-aa39-062f6d38543e admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:18.729497 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be76d9-951f-49fb-aa39-062f6d38543e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:18.729775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be76d9-951f-49fb-aa39-062f6d38543e admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:18.730426 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be76d9-951f-49fb-aa39-062f6d38543e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:18.732413 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be76d9-951f-49fb-aa39-062f6d38543e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:18.741287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c6bec446-8842-42ce-ab60-2f50616d413b None None] MFA Rules not processed for user `9e7444bc40314e73b282217bbb94798d`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:29:18.742678 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c6bec446-8842-42ce-ab60-2f50616d413b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:18.776162 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1234/2430] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:29:18 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:29:18.785845 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be76d9-951f-49fb-aa39-062f6d38543e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:18.844495 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1197/2431] 10.222.0.94 () {58 vars in 1009 bytes} [Thu Sep 1 17:29:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:29:18.860413 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bec446-8842-42ce-ab60-2f50616d413b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:18.862149 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c6bec446-8842-42ce-ab60-2f50616d413b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:18.897456 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be76d9-951f-49fb-aa39-062f6d38543e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:18.901672 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b25268-b48c-4e46-9684-a376f9c36719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:18.902202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b25268-b48c-4e46-9684-a376f9c36719 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:18.902480 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b25268-b48c-4e46-9684-a376f9c36719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:18.902798 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b25268-b48c-4e46-9684-a376f9c36719 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:18.903377 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b25268-b48c-4e46-9684-a376f9c36719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:18.905543 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b25268-b48c-4e46-9684-a376f9c36719 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:18.935192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1235/2432] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:29:18 2022] POST /identity/v3/users => generated 288 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:29:18.937182 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b25268-b48c-4e46-9684-a376f9c36719 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:18.948168 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b25268-b48c-4e46-9684-a376f9c36719 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:18.953332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9126f0b-109d-4cad-bd1e-54b9dcf00aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:18.954014 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9126f0b-109d-4cad-bd1e-54b9dcf00aad admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:18.954291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9126f0b-109d-4cad-bd1e-54b9dcf00aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:18.954558 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9126f0b-109d-4cad-bd1e-54b9dcf00aad admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:18.956303 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9126f0b-109d-4cad-bd1e-54b9dcf00aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:18.958278 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9126f0b-109d-4cad-bd1e-54b9dcf00aad admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:18.962257 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bec446-8842-42ce-ab60-2f50616d413b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:18.969822 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1236/2433] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:29:18.975150 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9126f0b-109d-4cad-bd1e-54b9dcf00aad admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:18.990219 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9126f0b-109d-4cad-bd1e-54b9dcf00aad admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:18.996512 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8082fe-7443-4619-9cd4-fd96eb32dc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:18.997130 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8082fe-7443-4619-9cd4-fd96eb32dc0a admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:18.997747 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8082fe-7443-4619-9cd4-fd96eb32dc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:18.998152 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8082fe-7443-4619-9cd4-fd96eb32dc0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:18.999426 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8082fe-7443-4619-9cd4-fd96eb32dc0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:19.001865 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8082fe-7443-4619-9cd4-fd96eb32dc0a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:19.009295 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:19.019194 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1237/2434] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:29:19.022873 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8082fe-7443-4619-9cd4-fd96eb32dc0a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:19.033733 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8082fe-7443-4619-9cd4-fd96eb32dc0a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:19.035387 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:19.042275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7bf10-cee8-484f-903e-29239523628f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:19.043033 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7bf10-cee8-484f-903e-29239523628f admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:19.043385 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7bf10-cee8-484f-903e-29239523628f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:19.043735 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7bf10-cee8-484f-903e-29239523628f admin admin] PATH_INFO: `/v3/projects/473fbab1597c404ea7c1a34e16562d03/users/89f3b9366a864327a74192a6a67b7356/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:19.043918 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0b5f8-6350-4b89-9a90-7edf8d2713ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7ebf43f36c4862a3c527941e033666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:19.044549 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0b5f8-6350-4b89-9a90-7edf8d2713ff service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:19.045007 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0b5f8-6350-4b89-9a90-7edf8d2713ff service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:19.045864 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0b5f8-6350-4b89-9a90-7edf8d2713ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:19.063578 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b7bf10-cee8-484f-903e-29239523628f admin admin] RBAC: Authorizing `identity:create_grant(project_id=473fbab1597c404ea7c1a34e16562d03, user_id=89f3b9366a864327a74192a6a67b7356, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:19.066712 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b7bf10-cee8-484f-903e-29239523628f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:19.085444 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1238/2435] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:29:19 2022] PUT /identity/v3/projects/473fbab1597c404ea7c1a34e16562d03/users/89f3b9366a864327a74192a6a67b7356/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:29:19.104784 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ca145-641d-451b-9020-641db2ed3a7f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:19.105544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ca145-641d-451b-9020-641db2ed3a7f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:19.106037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ca145-641d-451b-9020-641db2ed3a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:19.137518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0b5f8-6350-4b89-9a90-7edf8d2713ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:19.139280 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0b5f8-6350-4b89-9a90-7edf8d2713ff service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:19.142379 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-499ca145-641d-451b-9020-641db2ed3a7f None None] MFA Rules not processed for user `89f3b9366a864327a74192a6a67b7356`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:29:19.143884 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-499ca145-641d-451b-9020-641db2ed3a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:19.151819 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1198/2436] 10.222.0.94 () {60 vars in 1384 bytes} [Thu Sep 1 17:29:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 17:29:19.265427 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1239/2437] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:29:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:29:19.276386 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0b5f8-6350-4b89-9a90-7edf8d2713ff service swift] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:19.278111 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-aff0b5f8-6350-4b89-9a90-7edf8d2713ff service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:19.374731 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0b5f8-6350-4b89-9a90-7edf8d2713ff service swift] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:19.431697 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995aa557-069c-4631-81bb-ebf4fe80732d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:19.432339 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995aa557-069c-4631-81bb-ebf4fe80732d service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:19.432612 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995aa557-069c-4631-81bb-ebf4fe80732d service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:19.432879 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995aa557-069c-4631-81bb-ebf4fe80732d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:19.442052 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995aa557-069c-4631-81bb-ebf4fe80732d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:19.443533 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995aa557-069c-4631-81bb-ebf4fe80732d service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:19.453332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1199/2438] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:29:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:29:20.979189 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd2c0a-a523-438d-a811-c72c4b63ea73 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:20.980420 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd2c0a-a523-438d-a811-c72c4b63ea73 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:20.980888 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd2c0a-a523-438d-a811-c72c4b63ea73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:21.023833 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f8dd2c0a-a523-438d-a811-c72c4b63ea73 None None] MFA Rules not processed for user `89f3b9366a864327a74192a6a67b7356`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:29:21.025565 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f8dd2c0a-a523-438d-a811-c72c4b63ea73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:21.047487 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1240/2439] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:29:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:29:26.568984 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995aa557-069c-4631-81bb-ebf4fe80732d service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:26.570752 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-995aa557-069c-4631-81bb-ebf4fe80732d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:26.656638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995aa557-069c-4631-81bb-ebf4fe80732d service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:26.661910 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c573cc-9bb8-4833-8889-2895124f0aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:26.662662 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c573cc-9bb8-4833-8889-2895124f0aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:26.662943 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c573cc-9bb8-4833-8889-2895124f0aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:26.663214 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c573cc-9bb8-4833-8889-2895124f0aa0 admin admin] PATH_INFO: `/v3/users/b66bb5ea816f440ba50ab2a5c0271e32` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:26.664363 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c573cc-9bb8-4833-8889-2895124f0aa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b66bb5ea816f440ba50ab2a5c0271e32)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:26.666396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c573cc-9bb8-4833-8889-2895124f0aa0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:26.669041 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:26.726840 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b8c573cc-9bb8-4833-8889-2895124f0aa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b66bb5ea816f440ba50ab2a5c0271e32'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:26.727891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b8c573cc-9bb8-4833-8889-2895124f0aa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b66bb5ea816f440ba50ab2a5c0271e32'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:26.737497 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b8c573cc-9bb8-4833-8889-2895124f0aa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b66bb5ea816f440ba50ab2a5c0271e32'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:26.738260 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b8c573cc-9bb8-4833-8889-2895124f0aa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b66bb5ea816f440ba50ab2a5c0271e32'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:26.746090 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b8c573cc-9bb8-4833-8889-2895124f0aa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b66bb5ea816f440ba50ab2a5c0271e32'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:26.771453 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1200/2440] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:29:26 2022] DELETE /identity/v3/users/b66bb5ea816f440ba50ab2a5c0271e32 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:29:26.776075 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d15d5-8e19-4871-9f6f-788412b7546c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:26.776586 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d15d5-8e19-4871-9f6f-788412b7546c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:26.776586 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d15d5-8e19-4871-9f6f-788412b7546c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:26.796738 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1d7d15d5-8e19-4871-9f6f-788412b7546c None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:29:26.798097 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1d7d15d5-8e19-4871-9f6f-788412b7546c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:26.867231 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1241/2441] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:29:26.878301 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c573cc-9bb8-4833-8889-2895124f0aa0 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:26.879790 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b8c573cc-9bb8-4833-8889-2895124f0aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:26.947958 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c573cc-9bb8-4833-8889-2895124f0aa0 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:26.952708 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586a88d-df1a-4089-ae7f-8c48bb8fb991 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:26.953317 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586a88d-df1a-4089-ae7f-8c48bb8fb991 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:26.953629 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586a88d-df1a-4089-ae7f-8c48bb8fb991 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:26.953935 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586a88d-df1a-4089-ae7f-8c48bb8fb991 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:26.963887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8586a88d-df1a-4089-ae7f-8c48bb8fb991 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:26.965366 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8586a88d-df1a-4089-ae7f-8c48bb8fb991 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:26.975898 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1201/2442] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:29:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:29:27.300129 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d15d5-8e19-4871-9f6f-788412b7546c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:27.301642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1d7d15d5-8e19-4871-9f6f-788412b7546c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:27.322749 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d15d5-8e19-4871-9f6f-788412b7546c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:27.329740 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38553c19-4213-4364-8da4-d0be7d8625d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:27.329942 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38553c19-4213-4364-8da4-d0be7d8625d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:27.330169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38553c19-4213-4364-8da4-d0be7d8625d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:27.330350 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38553c19-4213-4364-8da4-d0be7d8625d2 admin admin] PATH_INFO: `/v3/projects/496437b9154a44049b685c71621bc565` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:27.331759 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38553c19-4213-4364-8da4-d0be7d8625d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=496437b9154a44049b685c71621bc565)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:27.333864 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38553c19-4213-4364-8da4-d0be7d8625d2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:27.387438 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-38553c19-4213-4364-8da4-d0be7d8625d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '496437b9154a44049b685c71621bc565', 'request_id': 'req-38553c19-4213-4364-8da4-d0be7d8625d2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:27.391559 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:27.395401 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-38553c19-4213-4364-8da4-d0be7d8625d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '496437b9154a44049b685c71621bc565', 'request_id': 'req-38553c19-4213-4364-8da4-d0be7d8625d2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:27.406440 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-38553c19-4213-4364-8da4-d0be7d8625d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '496437b9154a44049b685c71621bc565', 'request_id': 'req-38553c19-4213-4364-8da4-d0be7d8625d2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:27.424050 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-38553c19-4213-4364-8da4-d0be7d8625d2 admin admin] The token cache is being invalidate because project 496437b9154a44049b685c71621bc565 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:29:27.424354 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-38553c19-4213-4364-8da4-d0be7d8625d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:27.425062 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-38553c19-4213-4364-8da4-d0be7d8625d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:27.426986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1242/2443] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:29:27 2022] DELETE /identity/v3/projects/496437b9154a44049b685c71621bc565 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:29:29.182360 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c93ece-22cd-441c-8322-c78d99015635 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:29.182823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c93ece-22cd-441c-8322-c78d99015635 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:29.182937 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c93ece-22cd-441c-8322-c78d99015635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:29.202699 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e3c93ece-22cd-441c-8322-c78d99015635 None None] MFA Rules not processed for user `4c284b298cb34b069f8a66bcfa10b999`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:29:29.203995 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e3c93ece-22cd-441c-8322-c78d99015635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:29.260107 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1202/2444] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:29:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:29:31.419530 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b881ce-1f57-4e01-95c9-1355e3aaf977 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:31.420666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b881ce-1f57-4e01-95c9-1355e3aaf977 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:31.420907 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b881ce-1f57-4e01-95c9-1355e3aaf977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:31.442538 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-71b881ce-1f57-4e01-95c9-1355e3aaf977 None None] MFA Rules not processed for user `9e7444bc40314e73b282217bbb94798d`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:29:31.443763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-71b881ce-1f57-4e01-95c9-1355e3aaf977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:31.511976 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1243/2445] 10.222.0.94 () {58 vars in 1009 bytes} [Thu Sep 1 17:29:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:29:31.524892 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c93ece-22cd-441c-8322-c78d99015635 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:31.526411 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e3c93ece-22cd-441c-8322-c78d99015635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:31.564924 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:31.605418 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c93ece-22cd-441c-8322-c78d99015635 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:31.610947 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf44d1c-853f-4b48-84ab-b849bab16865 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7ebf43f36c4862a3c527941e033666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:31.611665 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf44d1c-853f-4b48-84ab-b849bab16865 service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:31.612006 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf44d1c-853f-4b48-84ab-b849bab16865 service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:31.612348 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf44d1c-853f-4b48-84ab-b849bab16865 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:31.621553 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf44d1c-853f-4b48-84ab-b849bab16865 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:31.623608 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf44d1c-853f-4b48-84ab-b849bab16865 service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:31.634610 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1203/2446] 10.222.0.94 () {60 vars in 1384 bytes} [Thu Sep 1 17:29:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 17:29:41.505099 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=2,keystone:SELECT=30,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:41.629460 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=19 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:48.571546 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b881ce-1f57-4e01-95c9-1355e3aaf977 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:48.574312 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-71b881ce-1f57-4e01-95c9-1355e3aaf977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:48.674358 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b881ce-1f57-4e01-95c9-1355e3aaf977 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:48.680567 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b429e-62da-4d17-ba47-6de3086221ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3622621761f4f18ae3e9dfb5ba99bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:48.681330 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b429e-62da-4d17-ba47-6de3086221ea service placement] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:48.681648 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b429e-62da-4d17-ba47-6de3086221ea service placement] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:48.681972 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b429e-62da-4d17-ba47-6de3086221ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:48.683688 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-422b429e-62da-4d17-ba47-6de3086221ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:48.698046 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422b429e-62da-4d17-ba47-6de3086221ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:48.711071 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422b429e-62da-4d17-ba47-6de3086221ea service placement] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:48.711071 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1244/2447] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:29:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:29:52.160217 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2b563-44b6-47bc-8994-518457a88cc0 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:52.160673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2b563-44b6-47bc-8994-518457a88cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:52.160775 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2b563-44b6-47bc-8994-518457a88cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:52.179903 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3de2b563-44b6-47bc-8994-518457a88cc0 None None] MFA Rules not processed for user `9e7444bc40314e73b282217bbb94798d`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:29:52.181109 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3de2b563-44b6-47bc-8994-518457a88cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:52.189159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1204/2448] 10.222.0.94 () {58 vars in 1009 bytes} [Thu Sep 1 17:29:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:29:52.202716 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b429e-62da-4d17-ba47-6de3086221ea service placement] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:52.214565 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b429e-62da-4d17-ba47-6de3086221ea service placement] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:52.219734 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091419b5-d0e4-4f7e-8517-a19d3282c642 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7ebf43f36c4862a3c527941e033666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:52.220336 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091419b5-d0e4-4f7e-8517-a19d3282c642 service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:52.220615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091419b5-d0e4-4f7e-8517-a19d3282c642 service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:52.220883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091419b5-d0e4-4f7e-8517-a19d3282c642 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:52.229421 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091419b5-d0e4-4f7e-8517-a19d3282c642 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:52.232511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091419b5-d0e4-4f7e-8517-a19d3282c642 service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:52.241391 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1245/2449] 10.222.0.94 () {60 vars in 1384 bytes} [Thu Sep 1 17:29:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 17:29:52.751407 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b53535-117c-4239-b111-ed9b4481ac11 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:52.751688 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b53535-117c-4239-b111-ed9b4481ac11 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:52.751958 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b53535-117c-4239-b111-ed9b4481ac11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:52.776846 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c5b53535-117c-4239-b111-ed9b4481ac11 None None] MFA Rules not processed for user `9e7444bc40314e73b282217bbb94798d`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:29:52.778646 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c5b53535-117c-4239-b111-ed9b4481ac11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:52.785770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1205/2450] 10.222.0.94 () {58 vars in 967 bytes} [Thu Sep 1 17:29:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:29:52.797779 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091419b5-d0e4-4f7e-8517-a19d3282c642 service swift] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:52.808097 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091419b5-d0e4-4f7e-8517-a19d3282c642 service swift] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:52.813270 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90199992-7fef-4471-b622-4901783fe17c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7ebf43f36c4862a3c527941e033666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:52.813914 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90199992-7fef-4471-b622-4901783fe17c service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:52.814193 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90199992-7fef-4471-b622-4901783fe17c service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:52.814470 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90199992-7fef-4471-b622-4901783fe17c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:52.822642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90199992-7fef-4471-b622-4901783fe17c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:52.824251 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90199992-7fef-4471-b622-4901783fe17c service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:52.832663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1246/2451] 10.222.0.94 () {60 vars in 1384 bytes} [Thu Sep 1 17:29:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 17:29:53.042332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6571f8-6428-4481-9805-51f6bc1b713a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:53.042619 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6571f8-6428-4481-9805-51f6bc1b713a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:53.043003 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6571f8-6428-4481-9805-51f6bc1b713a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:53.062465 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8f6571f8-6428-4481-9805-51f6bc1b713a None None] MFA Rules not processed for user `9e7444bc40314e73b282217bbb94798d`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:29:53.063654 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8f6571f8-6428-4481-9805-51f6bc1b713a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:53.070857 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1206/2452] 10.222.0.94 () {58 vars in 1009 bytes} [Thu Sep 1 17:29:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:29:53.083008 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90199992-7fef-4471-b622-4901783fe17c service swift] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:53.093384 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90199992-7fef-4471-b622-4901783fe17c service swift] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:53.098362 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0f574-6705-43b0-9fdd-1ef6a3a4c4f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7ebf43f36c4862a3c527941e033666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:53.098941 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0f574-6705-43b0-9fdd-1ef6a3a4c4f0 service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:53.099216 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0f574-6705-43b0-9fdd-1ef6a3a4c4f0 service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:53.099484 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0f574-6705-43b0-9fdd-1ef6a3a4c4f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:53.107364 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0f574-6705-43b0-9fdd-1ef6a3a4c4f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:53.108936 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0f574-6705-43b0-9fdd-1ef6a3a4c4f0 service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:53.116757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1247/2453] 10.222.0.94 () {60 vars in 1384 bytes} [Thu Sep 1 17:29:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 17:29:53.459006 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f1694-7239-437c-8496-df9cea8b5d0a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:53.460265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f1694-7239-437c-8496-df9cea8b5d0a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:53.460860 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f1694-7239-437c-8496-df9cea8b5d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:53.495154 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c83f1694-7239-437c-8496-df9cea8b5d0a None None] MFA Rules not processed for user `9e7444bc40314e73b282217bbb94798d`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:29:53.497246 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c83f1694-7239-437c-8496-df9cea8b5d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:53.512486 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1207/2454] 10.222.0.94 () {58 vars in 967 bytes} [Thu Sep 1 17:29:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:29:53.551875 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0f574-6705-43b0-9fdd-1ef6a3a4c4f0 service swift] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:53.563598 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0f574-6705-43b0-9fdd-1ef6a3a4c4f0 service swift] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:53.568892 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e9965-4a1b-49af-a66c-475c8e61e377 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7ebf43f36c4862a3c527941e033666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:53.569658 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e9965-4a1b-49af-a66c-475c8e61e377 service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:53.569958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e9965-4a1b-49af-a66c-475c8e61e377 service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:53.570224 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e9965-4a1b-49af-a66c-475c8e61e377 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:53.579402 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e9965-4a1b-49af-a66c-475c8e61e377 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:53.580988 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e9965-4a1b-49af-a66c-475c8e61e377 service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:53.589502 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1248/2455] 10.222.0.94 () {60 vars in 1384 bytes} [Thu Sep 1 17:29:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 17:29:55.693113 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f1694-7239-437c-8496-df9cea8b5d0a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:55.695218 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c83f1694-7239-437c-8496-df9cea8b5d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:55.770992 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f1694-7239-437c-8496-df9cea8b5d0a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:55.776291 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39551fb1-3c87-446b-b419-255559d2c4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:55.777104 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39551fb1-3c87-446b-b419-255559d2c4d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:55.777456 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39551fb1-3c87-446b-b419-255559d2c4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:55.778785 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39551fb1-3c87-446b-b419-255559d2c4d3 admin admin] PATH_INFO: `/v3/users/89f3b9366a864327a74192a6a67b7356` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:55.779410 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39551fb1-3c87-446b-b419-255559d2c4d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89f3b9366a864327a74192a6a67b7356)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:55.781353 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39551fb1-3c87-446b-b419-255559d2c4d3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:55.847078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-39551fb1-3c87-446b-b419-255559d2c4d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89f3b9366a864327a74192a6a67b7356'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:55.847808 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-39551fb1-3c87-446b-b419-255559d2c4d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89f3b9366a864327a74192a6a67b7356'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:55.856801 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-39551fb1-3c87-446b-b419-255559d2c4d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89f3b9366a864327a74192a6a67b7356'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:55.857704 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-39551fb1-3c87-446b-b419-255559d2c4d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89f3b9366a864327a74192a6a67b7356'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:55.865984 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-39551fb1-3c87-446b-b419-255559d2c4d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89f3b9366a864327a74192a6a67b7356'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:55.897533 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1208/2456] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:29:55 2022] DELETE /identity/v3/users/89f3b9366a864327a74192a6a67b7356 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:29:55.902056 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a678a-d726-4f1a-b1a3-ad865d349d11 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:55.902622 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a678a-d726-4f1a-b1a3-ad865d349d11 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:55.902711 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a678a-d726-4f1a-b1a3-ad865d349d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:55.935258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5e0a678a-d726-4f1a-b1a3-ad865d349d11 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:29:55.937615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5e0a678a-d726-4f1a-b1a3-ad865d349d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:56.013209 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1249/2457] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:29:56.024915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39551fb1-3c87-446b-b419-255559d2c4d3 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:56.026378 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-39551fb1-3c87-446b-b419-255559d2c4d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:56.085507 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39551fb1-3c87-446b-b419-255559d2c4d3 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:56.089271 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033e304-1ca4-473c-832b-1b23149ed914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:56.090464 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033e304-1ca4-473c-832b-1b23149ed914 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:56.090744 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033e304-1ca4-473c-832b-1b23149ed914 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:56.091023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033e304-1ca4-473c-832b-1b23149ed914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:56.101662 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:56.104457 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033e304-1ca4-473c-832b-1b23149ed914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:56.107128 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033e304-1ca4-473c-832b-1b23149ed914 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:56.120259 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1209/2458] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:29:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:29:56.323020 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a678a-d726-4f1a-b1a3-ad865d349d11 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:29:56.325201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5e0a678a-d726-4f1a-b1a3-ad865d349d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:29:56.337571 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a678a-d726-4f1a-b1a3-ad865d349d11 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:29:56.345877 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba5232-06f1-4f78-b6a3-34a7a942c995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:29:56.346644 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba5232-06f1-4f78-b6a3-34a7a942c995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:29:56.346990 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba5232-06f1-4f78-b6a3-34a7a942c995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:29:56.347448 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba5232-06f1-4f78-b6a3-34a7a942c995 admin admin] PATH_INFO: `/v3/projects/473fbab1597c404ea7c1a34e16562d03` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:29:56.349306 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba5232-06f1-4f78-b6a3-34a7a942c995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=473fbab1597c404ea7c1a34e16562d03)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:29:56.351374 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba5232-06f1-4f78-b6a3-34a7a942c995 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:29:56.402053 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:56.416138 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a0ba5232-06f1-4f78-b6a3-34a7a942c995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '473fbab1597c404ea7c1a34e16562d03', 'request_id': 'req-a0ba5232-06f1-4f78-b6a3-34a7a942c995'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:56.421508 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a0ba5232-06f1-4f78-b6a3-34a7a942c995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '473fbab1597c404ea7c1a34e16562d03', 'request_id': 'req-a0ba5232-06f1-4f78-b6a3-34a7a942c995'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:56.428153 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a0ba5232-06f1-4f78-b6a3-34a7a942c995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '473fbab1597c404ea7c1a34e16562d03', 'request_id': 'req-a0ba5232-06f1-4f78-b6a3-34a7a942c995'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:56.441638 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a0ba5232-06f1-4f78-b6a3-34a7a942c995 admin admin] The token cache is being invalidate because project 473fbab1597c404ea7c1a34e16562d03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:29:56.441931 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a0ba5232-06f1-4f78-b6a3-34a7a942c995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:56.442582 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a0ba5232-06f1-4f78-b6a3-34a7a942c995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:29:56.444096 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1250/2459] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:29:56 2022] DELETE /identity/v3/projects/473fbab1597c404ea7c1a34e16562d03 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:30:00.961871 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033e304-1ca4-473c-832b-1b23149ed914 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:30:00.963306 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8033e304-1ca4-473c-832b-1b23149ed914 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:30:00.975263 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033e304-1ca4-473c-832b-1b23149ed914 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:30:01.025843 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24df79-753b-4643-bd7b-b4294e24d61d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:30:01.026450 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24df79-753b-4643-bd7b-b4294e24d61d service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:30:01.026728 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24df79-753b-4643-bd7b-b4294e24d61d service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:30:01.029367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24df79-753b-4643-bd7b-b4294e24d61d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:30:01.031389 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8c24df79-753b-4643-bd7b-b4294e24d61d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:30:01.092674 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24df79-753b-4643-bd7b-b4294e24d61d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:30:01.094123 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24df79-753b-4643-bd7b-b4294e24d61d service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:30:01.103548 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1210/2460] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:30:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:30:06.438477 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:30:09.369599 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc17a2-d79c-42a4-922a-a6f67edcbb50 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:30:09.369599 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc17a2-d79c-42a4-922a-a6f67edcbb50 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:30:09.370234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc17a2-d79c-42a4-922a-a6f67edcbb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:30:09.389004 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e4bc17a2-d79c-42a4-922a-a6f67edcbb50 None None] MFA Rules not processed for user `eb6bfd9c259748d0a705cf2780b5c194`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:30:09.390243 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e4bc17a2-d79c-42a4-922a-a6f67edcbb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:30:09.444016 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1251/2461] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:30:09 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:30:11.099229 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=52 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:30:19.345373 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28c348-1bae-41c1-b4d7-a78e4c9bce84 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:30:19.345998 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28c348-1bae-41c1-b4d7-a78e4c9bce84 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:30:19.345998 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28c348-1bae-41c1-b4d7-a78e4c9bce84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:30:19.365794 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-cb28c348-1bae-41c1-b4d7-a78e4c9bce84 None None] MFA Rules not processed for user `754c17cea670481bb43938aaf2e8d7d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:30:19.367016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cb28c348-1bae-41c1-b4d7-a78e4c9bce84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:30:19.421265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1211/2462] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:30:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:30:19.437377 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=25 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:30:29.413847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=25 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:31:07.772416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb6faa-5c93-47c3-abec-4d074224ef26 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:31:07.772946 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb6faa-5c93-47c3-abec-4d074224ef26 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:31:07.772946 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb6faa-5c93-47c3-abec-4d074224ef26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:31:07.791978 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-96bb6faa-5c93-47c3-abec-4d074224ef26 None None] MFA Rules not processed for user `9492a32538da4b0a8dc781e3485ac892`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:31:07.793112 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-96bb6faa-5c93-47c3-abec-4d074224ef26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:31:07.847876 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1252/2463] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:31:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:31:17.841309 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=25 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:31:25.602509 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28c348-1bae-41c1-b4d7-a78e4c9bce84 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:31:25.605338 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cb28c348-1bae-41c1-b4d7-a78e4c9bce84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:31:25.683852 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28c348-1bae-41c1-b4d7-a78e4c9bce84 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:31:25.689027 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a83260-0a3a-4fc7-be58-21b453d61ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:31:25.689688 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a83260-0a3a-4fc7-be58-21b453d61ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:31:25.689972 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a83260-0a3a-4fc7-be58-21b453d61ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:31:25.690248 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a83260-0a3a-4fc7-be58-21b453d61ef0 admin admin] PATH_INFO: `/v3/users/eb6bfd9c259748d0a705cf2780b5c194` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:31:25.691400 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a83260-0a3a-4fc7-be58-21b453d61ef0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb6bfd9c259748d0a705cf2780b5c194)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:31:25.693327 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a83260-0a3a-4fc7-be58-21b453d61ef0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:31:25.741150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-32a83260-0a3a-4fc7-be58-21b453d61ef0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb6bfd9c259748d0a705cf2780b5c194'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:31:25.741932 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-32a83260-0a3a-4fc7-be58-21b453d61ef0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb6bfd9c259748d0a705cf2780b5c194'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:31:25.750200 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-32a83260-0a3a-4fc7-be58-21b453d61ef0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb6bfd9c259748d0a705cf2780b5c194'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:31:25.750880 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-32a83260-0a3a-4fc7-be58-21b453d61ef0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb6bfd9c259748d0a705cf2780b5c194'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:31:25.758423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-32a83260-0a3a-4fc7-be58-21b453d61ef0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb6bfd9c259748d0a705cf2780b5c194'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:31:25.775693 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1212/2464] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:31:25 2022] DELETE /identity/v3/users/eb6bfd9c259748d0a705cf2780b5c194 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:31:25.952319 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb6faa-5c93-47c3-abec-4d074224ef26 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:31:25.965583 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb6faa-5c93-47c3-abec-4d074224ef26 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:31:26.051025 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a8335-c702-46cf-8d47-5ed356203425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:31:26.051595 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a8335-c702-46cf-8d47-5ed356203425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:31:26.051872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a8335-c702-46cf-8d47-5ed356203425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:31:26.052144 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a8335-c702-46cf-8d47-5ed356203425 admin admin] PATH_INFO: `/v3/projects/09e77070c070487e8ff45aa73ed11e53` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:31:26.053299 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a8335-c702-46cf-8d47-5ed356203425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09e77070c070487e8ff45aa73ed11e53)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:31:26.055377 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a8335-c702-46cf-8d47-5ed356203425 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:31:26.113128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-969a8335-c702-46cf-8d47-5ed356203425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09e77070c070487e8ff45aa73ed11e53', 'request_id': 'req-969a8335-c702-46cf-8d47-5ed356203425'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:31:26.120573 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-969a8335-c702-46cf-8d47-5ed356203425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09e77070c070487e8ff45aa73ed11e53', 'request_id': 'req-969a8335-c702-46cf-8d47-5ed356203425'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:31:26.127289 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-969a8335-c702-46cf-8d47-5ed356203425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09e77070c070487e8ff45aa73ed11e53', 'request_id': 'req-969a8335-c702-46cf-8d47-5ed356203425'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:31:26.141348 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-969a8335-c702-46cf-8d47-5ed356203425 admin admin] The token cache is being invalidate because project 09e77070c070487e8ff45aa73ed11e53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:31:26.141677 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-969a8335-c702-46cf-8d47-5ed356203425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:31:26.142304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-969a8335-c702-46cf-8d47-5ed356203425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:31:26.143807 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1253/2465] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:31:25 2022] DELETE /identity/v3/projects/09e77070c070487e8ff45aa73ed11e53 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:31:26.149093 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7f06c-6419-4dc3-bb03-2673c8d28a76 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:31:26.149389 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7f06c-6419-4dc3-bb03-2673c8d28a76 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:31:26.149893 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7f06c-6419-4dc3-bb03-2673c8d28a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:31:26.170982 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-38a7f06c-6419-4dc3-bb03-2673c8d28a76 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:31:26.172499 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-38a7f06c-6419-4dc3-bb03-2673c8d28a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:31:26.244042 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1213/2466] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:31:26.252719 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e05a6e-c912-45aa-a95b-884c6b69240d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:31:26.253000 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e05a6e-c912-45aa-a95b-884c6b69240d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:31:26.253545 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e05a6e-c912-45aa-a95b-884c6b69240d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:31:26.275734 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-49e05a6e-c912-45aa-a95b-884c6b69240d None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:31:26.277024 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-49e05a6e-c912-45aa-a95b-884c6b69240d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:31:26.289362 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1254/2467] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:31:26.293814 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7f06c-6419-4dc3-bb03-2673c8d28a76 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:31:26.304299 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7f06c-6419-4dc3-bb03-2673c8d28a76 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:31:26.309662 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b18bcd-3f57-4b08-9404-c92c2d6088c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:31:26.310297 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b18bcd-3f57-4b08-9404-c92c2d6088c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:31:26.310583 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b18bcd-3f57-4b08-9404-c92c2d6088c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:31:26.310859 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b18bcd-3f57-4b08-9404-c92c2d6088c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:31:26.311522 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b18bcd-3f57-4b08-9404-c92c2d6088c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:31:26.311831 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b18bcd-3f57-4b08-9404-c92c2d6088c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:31:26.313502 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b18bcd-3f57-4b08-9404-c92c2d6088c3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:31:26.344227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1214/2468] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:31:26.348384 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e05a6e-c912-45aa-a95b-884c6b69240d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:31:26.358333 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e05a6e-c912-45aa-a95b-884c6b69240d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:31:26.363649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a5562-7721-4997-85e2-d52b225c7a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:31:26.364392 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a5562-7721-4997-85e2-d52b225c7a00 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:31:26.364773 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a5562-7721-4997-85e2-d52b225c7a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:31:26.365147 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a5562-7721-4997-85e2-d52b225c7a00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:31:26.365950 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a5562-7721-4997-85e2-d52b225c7a00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:31:26.368103 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a5562-7721-4997-85e2-d52b225c7a00 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:31:26.401441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1255/2469] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:31:26 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:31:26.404392 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b18bcd-3f57-4b08-9404-c92c2d6088c3 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:31:26.416450 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b18bcd-3f57-4b08-9404-c92c2d6088c3 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:31:26.420484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:31:26.495132 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a222e3-b2ec-46bc-8ea3-8239ce38f027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:31:26.496156 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a222e3-b2ec-46bc-8ea3-8239ce38f027 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:31:26.496287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a222e3-b2ec-46bc-8ea3-8239ce38f027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:31:26.496571 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a222e3-b2ec-46bc-8ea3-8239ce38f027 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:31:26.497995 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a222e3-b2ec-46bc-8ea3-8239ce38f027 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:31:26.499972 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a222e3-b2ec-46bc-8ea3-8239ce38f027 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:31:26.526283 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1215/2470] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:31:26 2022] POST /identity/v3/users => generated 294 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:31:26.530520 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a5562-7721-4997-85e2-d52b225c7a00 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:31:26.548041 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a5562-7721-4997-85e2-d52b225c7a00 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:31:26.552890 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813741f-2d12-4b8b-a712-df09d10bc73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:31:26.553586 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813741f-2d12-4b8b-a712-df09d10bc73f admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:31:26.553811 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813741f-2d12-4b8b-a712-df09d10bc73f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:31:26.554086 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813741f-2d12-4b8b-a712-df09d10bc73f admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:31:26.554740 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813741f-2d12-4b8b-a712-df09d10bc73f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:31:26.556369 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813741f-2d12-4b8b-a712-df09d10bc73f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:31:26.572118 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1256/2471] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:31:26.573059 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a222e3-b2ec-46bc-8ea3-8239ce38f027 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:31:26.584069 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a222e3-b2ec-46bc-8ea3-8239ce38f027 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:31:26.588774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1eb2a-e9dc-490b-b4fe-850890a39058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:31:26.589377 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1eb2a-e9dc-490b-b4fe-850890a39058 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:31:26.589730 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1eb2a-e9dc-490b-b4fe-850890a39058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:31:26.590927 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1eb2a-e9dc-490b-b4fe-850890a39058 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:31:26.590927 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1eb2a-e9dc-490b-b4fe-850890a39058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:31:26.592251 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1eb2a-e9dc-490b-b4fe-850890a39058 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:31:26.602639 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1216/2472] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:31:26.607007 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813741f-2d12-4b8b-a712-df09d10bc73f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:31:26.617149 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813741f-2d12-4b8b-a712-df09d10bc73f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:31:26.627379 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c4a94-ec76-465b-9993-c9a581233ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:31:26.628173 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c4a94-ec76-465b-9993-c9a581233ed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:31:26.628464 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c4a94-ec76-465b-9993-c9a581233ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:31:26.628756 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c4a94-ec76-465b-9993-c9a581233ed8 admin admin] PATH_INFO: `/v3/projects/fbf71d45b1ae42ef9fbac874d6dd430f/users/56157c6686714d9c976e3890f2055038/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:31:26.645049 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c4a94-ec76-465b-9993-c9a581233ed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf71d45b1ae42ef9fbac874d6dd430f, user_id=56157c6686714d9c976e3890f2055038, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:31:26.649368 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c4a94-ec76-465b-9993-c9a581233ed8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:31:26.663068 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1257/2473] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:31:26 2022] PUT /identity/v3/projects/fbf71d45b1ae42ef9fbac874d6dd430f/users/56157c6686714d9c976e3890f2055038/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:31:26.668096 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d8bf9-fd63-478c-97e5-4d85ea8383a8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:31:26.668581 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d8bf9-fd63-478c-97e5-4d85ea8383a8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:31:26.668902 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d8bf9-fd63-478c-97e5-4d85ea8383a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:31:26.689943 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a91d8bf9-fd63-478c-97e5-4d85ea8383a8 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:31:26.691283 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a91d8bf9-fd63-478c-97e5-4d85ea8383a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:31:26.764935 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1217/2474] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:31:26.774656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c4a94-ec76-465b-9993-c9a581233ed8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:31:26.777624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-186c4a94-ec76-465b-9993-c9a581233ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:31:26.812632 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:31:26.846204 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c4a94-ec76-465b-9993-c9a581233ed8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:31:26.851121 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff249022-7d0a-4574-bb5e-47431ebdc4b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:31:26.851752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff249022-7d0a-4574-bb5e-47431ebdc4b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:31:26.852034 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff249022-7d0a-4574-bb5e-47431ebdc4b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:31:26.852309 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff249022-7d0a-4574-bb5e-47431ebdc4b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:31:26.863763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff249022-7d0a-4574-bb5e-47431ebdc4b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:31:26.865226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff249022-7d0a-4574-bb5e-47431ebdc4b0 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:31:26.876668 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1258/2475] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:31:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:31:29.561460 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c6a14-0f41-4fa8-ab1c-93edc1731b3d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:31:29.561995 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c6a14-0f41-4fa8-ab1c-93edc1731b3d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:31:29.561995 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c6a14-0f41-4fa8-ab1c-93edc1731b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:31:29.581929 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-461c6a14-0f41-4fa8-ab1c-93edc1731b3d None None] MFA Rules not processed for user `754c17cea670481bb43938aaf2e8d7d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:31:29.583198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-461c6a14-0f41-4fa8-ab1c-93edc1731b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:31:29.654375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1218/2476] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:31:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:31:32.849174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c940f-ea5b-49f2-af3d-76ee5666f841 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:31:32.850803 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c940f-ea5b-49f2-af3d-76ee5666f841 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:31:32.851672 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c940f-ea5b-49f2-af3d-76ee5666f841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:31:32.887021 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e17c940f-ea5b-49f2-af3d-76ee5666f841 None None] MFA Rules not processed for user `56157c6686714d9c976e3890f2055038`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:31:32.889046 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e17c940f-ea5b-49f2-af3d-76ee5666f841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:31:32.988412 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1259/2477] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:31:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:31:33.003822 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c6a14-0f41-4fa8-ab1c-93edc1731b3d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:31:33.005459 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-461c6a14-0f41-4fa8-ab1c-93edc1731b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:31:33.063559 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:31:33.131296 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c6a14-0f41-4fa8-ab1c-93edc1731b3d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:31:33.139491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075c7b9-741a-49fb-851d-8a9e1b4d9eb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:31:33.140299 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075c7b9-741a-49fb-851d-8a9e1b4d9eb6 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:31:33.141325 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075c7b9-741a-49fb-851d-8a9e1b4d9eb6 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:31:33.141725 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075c7b9-741a-49fb-851d-8a9e1b4d9eb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:31:33.155054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075c7b9-741a-49fb-851d-8a9e1b4d9eb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:31:33.157100 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075c7b9-741a-49fb-851d-8a9e1b4d9eb6 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:31:33.171872 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1219/2478] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:31:33 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:31:33.929582 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c940f-ea5b-49f2-af3d-76ee5666f841 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:31:33.932781 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e17c940f-ea5b-49f2-af3d-76ee5666f841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:31:33.951146 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c940f-ea5b-49f2-af3d-76ee5666f841 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:31:33.955823 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad706be-2e19-4849-bed9-8110e538e316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:31:33.956448 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad706be-2e19-4849-bed9-8110e538e316 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:31:33.956879 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad706be-2e19-4849-bed9-8110e538e316 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:31:33.957206 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad706be-2e19-4849-bed9-8110e538e316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:31:33.960093 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cad706be-2e19-4849-bed9-8110e538e316 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:31:33.983445 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad706be-2e19-4849-bed9-8110e538e316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:31:33.985277 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad706be-2e19-4849-bed9-8110e538e316 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:31:34.003560 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1260/2479] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:31:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:31:34.852942 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e8bf1-eee0-4b59-8f7a-7a29ee559c68 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:31:34.854583 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e8bf1-eee0-4b59-8f7a-7a29ee559c68 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:31:34.855083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e8bf1-eee0-4b59-8f7a-7a29ee559c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:31:34.879883 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5d4e8bf1-eee0-4b59-8f7a-7a29ee559c68 None None] MFA Rules not processed for user `56157c6686714d9c976e3890f2055038`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:31:34.881176 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5d4e8bf1-eee0-4b59-8f7a-7a29ee559c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:31:34.889529 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1220/2480] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:31:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:31:36.568139 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad706be-2e19-4849-bed9-8110e538e316 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:31:36.578063 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad706be-2e19-4849-bed9-8110e538e316 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:31:36.581849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645eb18-3311-4591-ac6e-2db4eaba383f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:31:36.582455 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645eb18-3311-4591-ac6e-2db4eaba383f service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:31:36.582760 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645eb18-3311-4591-ac6e-2db4eaba383f service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:31:36.583031 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645eb18-3311-4591-ac6e-2db4eaba383f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:31:36.584763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f645eb18-3311-4591-ac6e-2db4eaba383f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:31:36.599667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645eb18-3311-4591-ac6e-2db4eaba383f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:31:36.601212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645eb18-3311-4591-ac6e-2db4eaba383f service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:31:36.613165 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1261/2481] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:31:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:31:44.874892 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=23 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:31:46.607724 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=58 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:00.085394 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e8bf1-eee0-4b59-8f7a-7a29ee559c68 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:00.097866 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e8bf1-eee0-4b59-8f7a-7a29ee559c68 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:00.102787 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60f833-14ce-4d8a-939b-bc0797d3dc00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:00.103642 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60f833-14ce-4d8a-939b-bc0797d3dc00 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:00.103642 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60f833-14ce-4d8a-939b-bc0797d3dc00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:00.103936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60f833-14ce-4d8a-939b-bc0797d3dc00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:00.106530 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ce60f833-14ce-4d8a-939b-bc0797d3dc00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:00.117805 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60f833-14ce-4d8a-939b-bc0797d3dc00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:00.119245 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60f833-14ce-4d8a-939b-bc0797d3dc00 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:00.130923 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1221/2482] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:32:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:32:06.779662 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645eb18-3311-4591-ac6e-2db4eaba383f service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:06.781355 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f645eb18-3311-4591-ac6e-2db4eaba383f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:06.798436 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645eb18-3311-4591-ac6e-2db4eaba383f service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:06.804647 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e02bb6-b956-4f24-9ab8-92e00d05e117 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:06.805645 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e02bb6-b956-4f24-9ab8-92e00d05e117 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:06.806066 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e02bb6-b956-4f24-9ab8-92e00d05e117 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:06.806494 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e02bb6-b956-4f24-9ab8-92e00d05e117 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:06.808344 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d5e02bb6-b956-4f24-9ab8-92e00d05e117 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:06.822141 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e02bb6-b956-4f24-9ab8-92e00d05e117 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:06.824271 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e02bb6-b956-4f24-9ab8-92e00d05e117 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:06.837392 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1262/2483] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:32:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:32:07.605935 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d031f2-135b-4b2a-97c6-e36513f8d6e2 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:07.606409 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d031f2-135b-4b2a-97c6-e36513f8d6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:07.606509 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d031f2-135b-4b2a-97c6-e36513f8d6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:07.625896 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-76d031f2-135b-4b2a-97c6-e36513f8d6e2 None None] MFA Rules not processed for user `9e7444bc40314e73b282217bbb94798d`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:07.627094 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-76d031f2-135b-4b2a-97c6-e36513f8d6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:07.680786 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1222/2484] 10.222.0.94 () {58 vars in 967 bytes} [Thu Sep 1 17:32:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:32:07.729873 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e02bb6-b956-4f24-9ab8-92e00d05e117 service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:07.731323 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d5e02bb6-b956-4f24-9ab8-92e00d05e117 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:07.799223 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e02bb6-b956-4f24-9ab8-92e00d05e117 service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:07.804260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56a641-bb49-4f84-b762-e168492fd72e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7ebf43f36c4862a3c527941e033666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:07.804872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56a641-bb49-4f84-b762-e168492fd72e service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:07.805446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56a641-bb49-4f84-b762-e168492fd72e service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:07.805720 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56a641-bb49-4f84-b762-e168492fd72e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:07.814511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56a641-bb49-4f84-b762-e168492fd72e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:07.816216 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56a641-bb49-4f84-b762-e168492fd72e service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:07.824321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1263/2485] 10.222.0.94 () {60 vars in 1384 bytes} [Thu Sep 1 17:32:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 17:32:12.577249 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d031f2-135b-4b2a-97c6-e36513f8d6e2 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:12.596633 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d031f2-135b-4b2a-97c6-e36513f8d6e2 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:12.603184 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9d190-17a5-4891-b9e4-64b28794a05f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:12.603959 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9d190-17a5-4891-b9e4-64b28794a05f service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:12.604336 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9d190-17a5-4891-b9e4-64b28794a05f service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:12.604708 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9d190-17a5-4891-b9e4-64b28794a05f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:12.606635 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-62f9d190-17a5-4891-b9e4-64b28794a05f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:12.677157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9d190-17a5-4891-b9e4-64b28794a05f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:12.678793 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9d190-17a5-4891-b9e4-64b28794a05f service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:12.689453 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1223/2486] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:32:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:32:14.474057 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56a641-bb49-4f84-b762-e168492fd72e service swift] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:14.476433 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-af56a641-bb49-4f84-b762-e168492fd72e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:14.499143 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56a641-bb49-4f84-b762-e168492fd72e service swift] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:14.504250 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59d718-ff8b-455f-bfd5-35bbbc65641f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:14.504891 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59d718-ff8b-455f-bfd5-35bbbc65641f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:14.505173 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59d718-ff8b-455f-bfd5-35bbbc65641f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:14.505477 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59d718-ff8b-455f-bfd5-35bbbc65641f admin admin] PATH_INFO: `/v3/users/4c284b298cb34b069f8a66bcfa10b999` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:14.506690 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59d718-ff8b-455f-bfd5-35bbbc65641f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c284b298cb34b069f8a66bcfa10b999)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:14.508718 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59d718-ff8b-455f-bfd5-35bbbc65641f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:14.569777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-af59d718-ff8b-455f-bfd5-35bbbc65641f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c284b298cb34b069f8a66bcfa10b999'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:14.570433 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-af59d718-ff8b-455f-bfd5-35bbbc65641f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c284b298cb34b069f8a66bcfa10b999'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:14.583263 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-af59d718-ff8b-455f-bfd5-35bbbc65641f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c284b298cb34b069f8a66bcfa10b999'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:14.590363 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-af59d718-ff8b-455f-bfd5-35bbbc65641f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c284b298cb34b069f8a66bcfa10b999'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:14.598405 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-af59d718-ff8b-455f-bfd5-35bbbc65641f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c284b298cb34b069f8a66bcfa10b999'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:14.604447 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1264/2487] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:32:14 2022] DELETE /identity/v3/users/4c284b298cb34b069f8a66bcfa10b999 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:14.781994 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9d190-17a5-4891-b9e4-64b28794a05f service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:14.793656 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9d190-17a5-4891-b9e4-64b28794a05f service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:14.854843 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907aa52-b312-4b7f-bcd8-ddc300ce48de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:14.855538 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907aa52-b312-4b7f-bcd8-ddc300ce48de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:14.855730 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907aa52-b312-4b7f-bcd8-ddc300ce48de admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:14.856000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907aa52-b312-4b7f-bcd8-ddc300ce48de admin admin] PATH_INFO: `/v3/projects/502d8f6d6b25473ba22dbe556d67098a` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:14.857276 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907aa52-b312-4b7f-bcd8-ddc300ce48de admin admin] RBAC: Authorizing `identity:delete_project(project_id=502d8f6d6b25473ba22dbe556d67098a)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:14.859235 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907aa52-b312-4b7f-bcd8-ddc300ce48de admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:14.897249 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:14.910332 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c907aa52-b312-4b7f-bcd8-ddc300ce48de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '502d8f6d6b25473ba22dbe556d67098a', 'request_id': 'req-c907aa52-b312-4b7f-bcd8-ddc300ce48de'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:14.916622 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c907aa52-b312-4b7f-bcd8-ddc300ce48de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '502d8f6d6b25473ba22dbe556d67098a', 'request_id': 'req-c907aa52-b312-4b7f-bcd8-ddc300ce48de'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:14.922943 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c907aa52-b312-4b7f-bcd8-ddc300ce48de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '502d8f6d6b25473ba22dbe556d67098a', 'request_id': 'req-c907aa52-b312-4b7f-bcd8-ddc300ce48de'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:14.937063 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c907aa52-b312-4b7f-bcd8-ddc300ce48de admin admin] The token cache is being invalidate because project 502d8f6d6b25473ba22dbe556d67098a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:32:14.937358 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c907aa52-b312-4b7f-bcd8-ddc300ce48de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:14.938717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c907aa52-b312-4b7f-bcd8-ddc300ce48de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:14.939837 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1224/2488] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:32:14 2022] DELETE /identity/v3/projects/502d8f6d6b25473ba22dbe556d67098a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:14.943592 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59d718-ff8b-455f-bfd5-35bbbc65641f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:14.945085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-af59d718-ff8b-455f-bfd5-35bbbc65641f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:14.958495 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59d718-ff8b-455f-bfd5-35bbbc65641f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:15.007677 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:15.021094 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743e656-cc35-4d94-9d8b-c31b6aee7429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:15.021786 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743e656-cc35-4d94-9d8b-c31b6aee7429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:15.022061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743e656-cc35-4d94-9d8b-c31b6aee7429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:15.022336 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743e656-cc35-4d94-9d8b-c31b6aee7429 admin admin] PATH_INFO: `/v3/users/12c28f82abb64d348692985276a0ab66` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:15.023480 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743e656-cc35-4d94-9d8b-c31b6aee7429 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12c28f82abb64d348692985276a0ab66)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:15.025508 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743e656-cc35-4d94-9d8b-c31b6aee7429 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:15.071045 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8743e656-cc35-4d94-9d8b-c31b6aee7429 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12c28f82abb64d348692985276a0ab66'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:15.071607 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8743e656-cc35-4d94-9d8b-c31b6aee7429 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12c28f82abb64d348692985276a0ab66'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:15.083226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8743e656-cc35-4d94-9d8b-c31b6aee7429 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12c28f82abb64d348692985276a0ab66'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:15.090202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8743e656-cc35-4d94-9d8b-c31b6aee7429 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12c28f82abb64d348692985276a0ab66'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:15.097215 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8743e656-cc35-4d94-9d8b-c31b6aee7429 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12c28f82abb64d348692985276a0ab66'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:15.103021 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1265/2489] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:32:14 2022] DELETE /identity/v3/users/12c28f82abb64d348692985276a0ab66 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:15.285211 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907aa52-b312-4b7f-bcd8-ddc300ce48de admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:15.286723 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c907aa52-b312-4b7f-bcd8-ddc300ce48de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:15.302055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907aa52-b312-4b7f-bcd8-ddc300ce48de admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:15.362214 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2023a-fb37-4d2a-b541-32bdff29c6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:15.362762 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2023a-fb37-4d2a-b541-32bdff29c6b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:15.363032 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2023a-fb37-4d2a-b541-32bdff29c6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:15.363300 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2023a-fb37-4d2a-b541-32bdff29c6b6 admin admin] PATH_INFO: `/v3/projects/62ace6d6acb34906937386d27065b868` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:15.364399 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2023a-fb37-4d2a-b541-32bdff29c6b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62ace6d6acb34906937386d27065b868)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:15.366346 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2023a-fb37-4d2a-b541-32bdff29c6b6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:15.410183 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c6d2023a-fb37-4d2a-b541-32bdff29c6b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62ace6d6acb34906937386d27065b868', 'request_id': 'req-c6d2023a-fb37-4d2a-b541-32bdff29c6b6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:15.416372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c6d2023a-fb37-4d2a-b541-32bdff29c6b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62ace6d6acb34906937386d27065b868', 'request_id': 'req-c6d2023a-fb37-4d2a-b541-32bdff29c6b6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:15.422358 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c6d2023a-fb37-4d2a-b541-32bdff29c6b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62ace6d6acb34906937386d27065b868', 'request_id': 'req-c6d2023a-fb37-4d2a-b541-32bdff29c6b6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:15.434774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c6d2023a-fb37-4d2a-b541-32bdff29c6b6 admin admin] The token cache is being invalidate because project 62ace6d6acb34906937386d27065b868 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:32:15.435066 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c6d2023a-fb37-4d2a-b541-32bdff29c6b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:15.435698 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c6d2023a-fb37-4d2a-b541-32bdff29c6b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:15.437160 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1225/2490] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:32:15 2022] DELETE /identity/v3/projects/62ace6d6acb34906937386d27065b868 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:15.442168 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503fabf-5472-4b61-a1f2-35d42aa81364 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:15.442528 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503fabf-5472-4b61-a1f2-35d42aa81364 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:15.442813 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503fabf-5472-4b61-a1f2-35d42aa81364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:15.463209 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d503fabf-5472-4b61-a1f2-35d42aa81364 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:15.464604 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d503fabf-5472-4b61-a1f2-35d42aa81364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:15.525785 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1266/2491] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:32:15.533711 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef401c-1bf4-4336-be35-3ec5de8af126 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:15.533999 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef401c-1bf4-4336-be35-3ec5de8af126 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:15.534277 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef401c-1bf4-4336-be35-3ec5de8af126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:15.554562 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-49ef401c-1bf4-4336-be35-3ec5de8af126 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:15.556071 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-49ef401c-1bf4-4336-be35-3ec5de8af126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:15.566405 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1226/2492] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:32:15.569871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503fabf-5472-4b61-a1f2-35d42aa81364 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:15.594397 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503fabf-5472-4b61-a1f2-35d42aa81364 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:15.599229 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d9e28-dad4-4832-b42b-b82854b7a101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:15.600109 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d9e28-dad4-4832-b42b-b82854b7a101 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:15.600678 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d9e28-dad4-4832-b42b-b82854b7a101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:15.601295 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d9e28-dad4-4832-b42b-b82854b7a101 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:15.602232 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d9e28-dad4-4832-b42b-b82854b7a101 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:32:15.602783 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d9e28-dad4-4832-b42b-b82854b7a101 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:15.604684 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d9e28-dad4-4832-b42b-b82854b7a101 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:15.617436 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1267/2493] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:32:15.622582 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef401c-1bf4-4336-be35-3ec5de8af126 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:15.632017 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef401c-1bf4-4336-be35-3ec5de8af126 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:15.637376 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f95bb-5372-4acd-8aff-0d54aa974e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:15.638009 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f95bb-5372-4acd-8aff-0d54aa974e82 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:15.638288 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f95bb-5372-4acd-8aff-0d54aa974e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:15.638595 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f95bb-5372-4acd-8aff-0d54aa974e82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:15.639200 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f95bb-5372-4acd-8aff-0d54aa974e82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:15.641113 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f95bb-5372-4acd-8aff-0d54aa974e82 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:15.670120 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1227/2494] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:32:15 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:32:15.675287 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d9e28-dad4-4832-b42b-b82854b7a101 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:15.686044 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d9e28-dad4-4832-b42b-b82854b7a101 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:15.735791 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:15.743831 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288aa77-b442-4d54-816b-94d7b52ee26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:15.744668 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288aa77-b442-4d54-816b-94d7b52ee26a admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:15.745133 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288aa77-b442-4d54-816b-94d7b52ee26a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:15.745582 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288aa77-b442-4d54-816b-94d7b52ee26a admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:15.746264 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288aa77-b442-4d54-816b-94d7b52ee26a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:15.748174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288aa77-b442-4d54-816b-94d7b52ee26a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:15.769783 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1268/2495] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:32:15 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:32:15.773873 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f95bb-5372-4acd-8aff-0d54aa974e82 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:15.784579 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f95bb-5372-4acd-8aff-0d54aa974e82 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:15.789226 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa15773-cc98-47e0-9dc3-55c949e096bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:15.789842 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa15773-cc98-47e0-9dc3-55c949e096bd admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:15.790116 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa15773-cc98-47e0-9dc3-55c949e096bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:15.790383 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa15773-cc98-47e0-9dc3-55c949e096bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:15.791217 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa15773-cc98-47e0-9dc3-55c949e096bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:15.792812 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa15773-cc98-47e0-9dc3-55c949e096bd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:15.803109 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1228/2496] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:32:15.807389 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288aa77-b442-4d54-816b-94d7b52ee26a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:15.818237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288aa77-b442-4d54-816b-94d7b52ee26a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:15.823900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782edce-dfeb-490b-aa69-f91e4d45a60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:15.824552 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782edce-dfeb-490b-aa69-f91e4d45a60b admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:15.824865 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782edce-dfeb-490b-aa69-f91e4d45a60b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:15.825170 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782edce-dfeb-490b-aa69-f91e4d45a60b admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:15.825887 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782edce-dfeb-490b-aa69-f91e4d45a60b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:15.827643 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782edce-dfeb-490b-aa69-f91e4d45a60b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:15.839677 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1269/2497] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:32:15.843674 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa15773-cc98-47e0-9dc3-55c949e096bd admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:15.854030 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa15773-cc98-47e0-9dc3-55c949e096bd admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:15.858739 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5aca4b-7828-4d25-b40d-a7160489d4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:15.859376 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5aca4b-7828-4d25-b40d-a7160489d4cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:15.859654 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5aca4b-7828-4d25-b40d-a7160489d4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:15.859927 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5aca4b-7828-4d25-b40d-a7160489d4cd admin admin] PATH_INFO: `/v3/projects/8c275a3570bf4b3ca85f81b03d23b529/users/c40997cd216b4aa191e9c2b292677dbe/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:15.868477 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:15.875573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5aca4b-7828-4d25-b40d-a7160489d4cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c275a3570bf4b3ca85f81b03d23b529, user_id=c40997cd216b4aa191e9c2b292677dbe, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:15.878710 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5aca4b-7828-4d25-b40d-a7160489d4cd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:15.892382 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1229/2498] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:32:15 2022] PUT /identity/v3/projects/8c275a3570bf4b3ca85f81b03d23b529/users/c40997cd216b4aa191e9c2b292677dbe/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:32:15.897954 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc4130-9b58-4739-8e96-25311f66c9d9 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:15.898305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc4130-9b58-4739-8e96-25311f66c9d9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:15.898585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc4130-9b58-4739-8e96-25311f66c9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:15.918985 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f9fc4130-9b58-4739-8e96-25311f66c9d9 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:15.920192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f9fc4130-9b58-4739-8e96-25311f66c9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:15.981688 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1270/2499] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:32:15.991662 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5aca4b-7828-4d25-b40d-a7160489d4cd admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:15.993360 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1e5aca4b-7828-4d25-b40d-a7160489d4cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:16.050912 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5aca4b-7828-4d25-b40d-a7160489d4cd admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:16.054571 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3696c-49ff-4c1d-b712-34a6565f9bb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:16.055426 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3696c-49ff-4c1d-b712-34a6565f9bb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:16.055703 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3696c-49ff-4c1d-b712-34a6565f9bb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:16.055980 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3696c-49ff-4c1d-b712-34a6565f9bb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:16.065478 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3696c-49ff-4c1d-b712-34a6565f9bb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:16.066900 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3696c-49ff-4c1d-b712-34a6565f9bb5 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:16.077670 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1230/2500] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:32:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:32:20.156890 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c924adf-f01a-43af-9e9b-2b96c6eee5ac None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:20.157483 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c924adf-f01a-43af-9e9b-2b96c6eee5ac None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:20.157684 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c924adf-f01a-43af-9e9b-2b96c6eee5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:20.191446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-9c924adf-f01a-43af-9e9b-2b96c6eee5ac None None] MFA Rules not processed for user `c40997cd216b4aa191e9c2b292677dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:20.192669 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9c924adf-f01a-43af-9e9b-2b96c6eee5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:20.262595 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1271/2501] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:32:20.267412 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3696c-49ff-4c1d-b712-34a6565f9bb5 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:20.278339 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3696c-49ff-4c1d-b712-34a6565f9bb5 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:20.283143 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb33cb-3c62-450b-ae23-6d482656a79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:20.283887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb33cb-3c62-450b-ae23-6d482656a79d admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:20.284321 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb33cb-3c62-450b-ae23-6d482656a79d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:20.284650 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb33cb-3c62-450b-ae23-6d482656a79d admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:20.285393 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb33cb-3c62-450b-ae23-6d482656a79d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:20.290058 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb33cb-3c62-450b-ae23-6d482656a79d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:20.335845 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1231/2502] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:32:20 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:32:20.340438 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c924adf-f01a-43af-9e9b-2b96c6eee5ac None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:20.359037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c924adf-f01a-43af-9e9b-2b96c6eee5ac None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:20.424315 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e21f00-bade-47e9-8dbc-80fce983cee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:20.425121 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e21f00-bade-47e9-8dbc-80fce983cee8 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:20.425499 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e21f00-bade-47e9-8dbc-80fce983cee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:20.425870 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e21f00-bade-47e9-8dbc-80fce983cee8 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:20.426572 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e21f00-bade-47e9-8dbc-80fce983cee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:20.428547 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e21f00-bade-47e9-8dbc-80fce983cee8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:20.439487 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:20.454145 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1272/2503] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:32:20 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:32:20.458160 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb33cb-3c62-450b-ae23-6d482656a79d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:20.469423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb33cb-3c62-450b-ae23-6d482656a79d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:20.474190 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a3707-cb1d-408f-b973-4cf4c7cd6699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:20.474794 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a3707-cb1d-408f-b973-4cf4c7cd6699 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:20.475071 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a3707-cb1d-408f-b973-4cf4c7cd6699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:20.475342 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a3707-cb1d-408f-b973-4cf4c7cd6699 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:20.475986 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a3707-cb1d-408f-b973-4cf4c7cd6699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:20.477632 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a3707-cb1d-408f-b973-4cf4c7cd6699 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:20.489437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1232/2504] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:32:20.492886 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e21f00-bade-47e9-8dbc-80fce983cee8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:20.503982 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e21f00-bade-47e9-8dbc-80fce983cee8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:20.508721 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26692ac-5134-4410-a265-df6afce20ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:20.509992 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26692ac-5134-4410-a265-df6afce20ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:20.510338 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26692ac-5134-4410-a265-df6afce20ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:20.510542 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26692ac-5134-4410-a265-df6afce20ca7 admin admin] PATH_INFO: `/v3/projects/2e59eec34af4431f81e19cb926c8b6d2/users/c9e93d2692fc4dae803f13c23dd13195/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:20.527744 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26692ac-5134-4410-a265-df6afce20ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e59eec34af4431f81e19cb926c8b6d2, user_id=c9e93d2692fc4dae803f13c23dd13195, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:20.530179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26692ac-5134-4410-a265-df6afce20ca7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:20.544349 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1273/2505] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:32:20 2022] PUT /identity/v3/projects/2e59eec34af4431f81e19cb926c8b6d2/users/c9e93d2692fc4dae803f13c23dd13195/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:20.548439 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a3707-cb1d-408f-b973-4cf4c7cd6699 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:20.559916 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a3707-cb1d-408f-b973-4cf4c7cd6699 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:20.622062 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd5792-d791-42bf-8894-082731260fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:20.622890 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd5792-d791-42bf-8894-082731260fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:20.623743 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd5792-d791-42bf-8894-082731260fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:20.624092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd5792-d791-42bf-8894-082731260fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:20.624757 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd5792-d791-42bf-8894-082731260fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:20.626617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd5792-d791-42bf-8894-082731260fd6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:20.638700 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1233/2506] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:32:20.643450 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26692ac-5134-4410-a265-df6afce20ca7 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:20.656278 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26692ac-5134-4410-a265-df6afce20ca7 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:20.661290 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a74853-ee79-4d30-9416-97f09dd41de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:20.662120 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a74853-ee79-4d30-9416-97f09dd41de5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:20.662412 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a74853-ee79-4d30-9416-97f09dd41de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:20.662685 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a74853-ee79-4d30-9416-97f09dd41de5 admin admin] PATH_INFO: `/v3/projects/2e59eec34af4431f81e19cb926c8b6d2/users/c9e93d2692fc4dae803f13c23dd13195/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:20.664604 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a74853-ee79-4d30-9416-97f09dd41de5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e59eec34af4431f81e19cb926c8b6d2, user_id=c9e93d2692fc4dae803f13c23dd13195, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:20.667355 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a74853-ee79-4d30-9416-97f09dd41de5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:20.680043 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1274/2507] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:32:20 2022] PUT /identity/v3/projects/2e59eec34af4431f81e19cb926c8b6d2/users/c9e93d2692fc4dae803f13c23dd13195/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:22.608470 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd5792-d791-42bf-8894-082731260fd6 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:22.610565 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4dcd5792-d791-42bf-8894-082731260fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:22.734335 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:22.762355 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd5792-d791-42bf-8894-082731260fd6 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:22.857321 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12125b3-0934-4f2d-b128-7c5f2eb8b45b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:22.862517 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12125b3-0934-4f2d-b128-7c5f2eb8b45b service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:22.863093 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12125b3-0934-4f2d-b128-7c5f2eb8b45b service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:22.863360 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12125b3-0934-4f2d-b128-7c5f2eb8b45b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:22.867889 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e12125b3-0934-4f2d-b128-7c5f2eb8b45b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:22.971752 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12125b3-0934-4f2d-b128-7c5f2eb8b45b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:22.975119 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12125b3-0934-4f2d-b128-7c5f2eb8b45b service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:22.987746 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1234/2508] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:32:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:32:25.732662 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf9cd2-4e8a-4fc6-9963-02fcd6ffcd41 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:25.733244 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf9cd2-4e8a-4fc6-9963-02fcd6ffcd41 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:25.733244 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf9cd2-4e8a-4fc6-9963-02fcd6ffcd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:25.765003 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-dfbf9cd2-4e8a-4fc6-9963-02fcd6ffcd41 None None] MFA Rules not processed for user `c9e93d2692fc4dae803f13c23dd13195`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:25.766267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-dfbf9cd2-4e8a-4fc6-9963-02fcd6ffcd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:25.842703 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1275/2509] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:32:25.853101 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12125b3-0934-4f2d-b128-7c5f2eb8b45b service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:25.854606 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e12125b3-0934-4f2d-b128-7c5f2eb8b45b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:25.871098 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12125b3-0934-4f2d-b128-7c5f2eb8b45b service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:25.876881 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95291024-9185-4f79-80fa-ee1934462179 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:25.877638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95291024-9185-4f79-80fa-ee1934462179 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:25.877986 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95291024-9185-4f79-80fa-ee1934462179 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:25.878261 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95291024-9185-4f79-80fa-ee1934462179 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:25.940892 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95291024-9185-4f79-80fa-ee1934462179 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:25.942571 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95291024-9185-4f79-80fa-ee1934462179 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:25.952306 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1235/2510] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:32:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:32:27.221713 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72ca62-92d6-4fd9-9b0c-99e1a6d9ebe5 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:27.222251 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72ca62-92d6-4fd9-9b0c-99e1a6d9ebe5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:27.222650 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72ca62-92d6-4fd9-9b0c-99e1a6d9ebe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:27.245523 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5c72ca62-92d6-4fd9-9b0c-99e1a6d9ebe5 None None] MFA Rules not processed for user `c40997cd216b4aa191e9c2b292677dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:27.247481 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5c72ca62-92d6-4fd9-9b0c-99e1a6d9ebe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:27.257363 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1276/2511] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:32:34.046359 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95291024-9185-4f79-80fa-ee1934462179 service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:34.092343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:34.119247 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95291024-9185-4f79-80fa-ee1934462179 service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:34.122956 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d89064-a52d-4cb6-864b-e6c8f81075b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:34.123600 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d89064-a52d-4cb6-864b-e6c8f81075b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:34.123876 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d89064-a52d-4cb6-864b-e6c8f81075b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:34.124163 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d89064-a52d-4cb6-864b-e6c8f81075b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:34.126053 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-75d89064-a52d-4cb6-864b-e6c8f81075b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:34.190433 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d89064-a52d-4cb6-864b-e6c8f81075b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:34.191792 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d89064-a52d-4cb6-864b-e6c8f81075b9 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:34.202178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1236/2512] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:32:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:32:37.240144 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:INSERT=3,keystone:SELECT=54 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:37.398114 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72ca62-92d6-4fd9-9b0c-99e1a6d9ebe5 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:37.400592 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5c72ca62-92d6-4fd9-9b0c-99e1a6d9ebe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:37.415016 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72ca62-92d6-4fd9-9b0c-99e1a6d9ebe5 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:37.420180 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b295d-c369-452e-b0a0-20092c4f9ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:37.420906 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b295d-c369-452e-b0a0-20092c4f9ef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:37.421203 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b295d-c369-452e-b0a0-20092c4f9ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:37.421781 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b295d-c369-452e-b0a0-20092c4f9ef4 admin admin] PATH_INFO: `/v3/users/9492a32538da4b0a8dc781e3485ac892` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:37.423045 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b295d-c369-452e-b0a0-20092c4f9ef4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9492a32538da4b0a8dc781e3485ac892)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:37.425606 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b295d-c369-452e-b0a0-20092c4f9ef4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:37.474638 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-267b295d-c369-452e-b0a0-20092c4f9ef4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9492a32538da4b0a8dc781e3485ac892'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:37.475213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-267b295d-c369-452e-b0a0-20092c4f9ef4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9492a32538da4b0a8dc781e3485ac892'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:37.488748 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-267b295d-c369-452e-b0a0-20092c4f9ef4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9492a32538da4b0a8dc781e3485ac892'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:37.497245 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-267b295d-c369-452e-b0a0-20092c4f9ef4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9492a32538da4b0a8dc781e3485ac892'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:37.505718 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-267b295d-c369-452e-b0a0-20092c4f9ef4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9492a32538da4b0a8dc781e3485ac892'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:37.512880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1277/2513] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:32:37 2022] DELETE /identity/v3/users/9492a32538da4b0a8dc781e3485ac892 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:37.976800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d89064-a52d-4cb6-864b-e6c8f81075b9 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:37.988659 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d89064-a52d-4cb6-864b-e6c8f81075b9 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:38.063363 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214c508-ffab-4ede-b41d-4bcf45329ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:38.064018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214c508-ffab-4ede-b41d-4bcf45329ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:38.064300 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214c508-ffab-4ede-b41d-4bcf45329ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:38.064576 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214c508-ffab-4ede-b41d-4bcf45329ff7 admin admin] PATH_INFO: `/v3/projects/a4efb55c7ae044ebacd068c9fe47c307` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:38.065800 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214c508-ffab-4ede-b41d-4bcf45329ff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4efb55c7ae044ebacd068c9fe47c307)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:38.068664 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214c508-ffab-4ede-b41d-4bcf45329ff7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:38.119400 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5214c508-ffab-4ede-b41d-4bcf45329ff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4efb55c7ae044ebacd068c9fe47c307', 'request_id': 'req-5214c508-ffab-4ede-b41d-4bcf45329ff7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:38.125229 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5214c508-ffab-4ede-b41d-4bcf45329ff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4efb55c7ae044ebacd068c9fe47c307', 'request_id': 'req-5214c508-ffab-4ede-b41d-4bcf45329ff7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:38.131934 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5214c508-ffab-4ede-b41d-4bcf45329ff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4efb55c7ae044ebacd068c9fe47c307', 'request_id': 'req-5214c508-ffab-4ede-b41d-4bcf45329ff7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:38.145045 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5214c508-ffab-4ede-b41d-4bcf45329ff7 admin admin] The token cache is being invalidate because project a4efb55c7ae044ebacd068c9fe47c307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:32:38.145601 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5214c508-ffab-4ede-b41d-4bcf45329ff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:38.146354 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5214c508-ffab-4ede-b41d-4bcf45329ff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:38.147886 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1237/2514] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:32:37 2022] DELETE /identity/v3/projects/a4efb55c7ae044ebacd068c9fe47c307 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:38.152949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad5348-1c00-4eb5-b90f-c677dc508600 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:38.153239 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad5348-1c00-4eb5-b90f-c677dc508600 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:38.153538 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad5348-1c00-4eb5-b90f-c677dc508600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:38.173642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c2ad5348-1c00-4eb5-b90f-c677dc508600 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:38.174855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c2ad5348-1c00-4eb5-b90f-c677dc508600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:38.239971 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1278/2515] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:32:38.248339 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65c54a-a56c-4258-8321-eb3d5c331495 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:38.248609 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65c54a-a56c-4258-8321-eb3d5c331495 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:38.248873 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65c54a-a56c-4258-8321-eb3d5c331495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:38.263319 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:38.278865 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ad65c54a-a56c-4258-8321-eb3d5c331495 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:38.280088 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ad65c54a-a56c-4258-8321-eb3d5c331495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:38.288592 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1238/2516] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:32:38.293983 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad5348-1c00-4eb5-b90f-c677dc508600 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:38.305503 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad5348-1c00-4eb5-b90f-c677dc508600 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:38.310368 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122704d7-78eb-459a-aecd-0fd43362bbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:38.310995 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122704d7-78eb-459a-aecd-0fd43362bbb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:38.311275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122704d7-78eb-459a-aecd-0fd43362bbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:38.311547 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122704d7-78eb-459a-aecd-0fd43362bbb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:38.312205 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122704d7-78eb-459a-aecd-0fd43362bbb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:32:38.312511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122704d7-78eb-459a-aecd-0fd43362bbb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:38.314221 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122704d7-78eb-459a-aecd-0fd43362bbb4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:38.326231 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1279/2517] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:32:38.330814 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65c54a-a56c-4258-8321-eb3d5c331495 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:38.340344 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65c54a-a56c-4258-8321-eb3d5c331495 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:38.345078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a760179-d031-4ebe-965d-5ee770e2a0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:38.345717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a760179-d031-4ebe-965d-5ee770e2a0a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:38.345995 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a760179-d031-4ebe-965d-5ee770e2a0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:38.346262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a760179-d031-4ebe-965d-5ee770e2a0a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:38.346889 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a760179-d031-4ebe-965d-5ee770e2a0a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:38.348814 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a760179-d031-4ebe-965d-5ee770e2a0a4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:38.379483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1239/2518] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:32:38 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:32:38.383926 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122704d7-78eb-459a-aecd-0fd43362bbb4 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:38.394073 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122704d7-78eb-459a-aecd-0fd43362bbb4 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:38.451703 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df03d7-cbfa-494c-9d8d-a5b1c15cf721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:38.452316 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df03d7-cbfa-494c-9d8d-a5b1c15cf721 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:38.452594 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df03d7-cbfa-494c-9d8d-a5b1c15cf721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:38.452863 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df03d7-cbfa-494c-9d8d-a5b1c15cf721 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:38.453532 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df03d7-cbfa-494c-9d8d-a5b1c15cf721 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:38.455459 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df03d7-cbfa-494c-9d8d-a5b1c15cf721 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:38.463821 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:38.479732 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1280/2519] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:32:38 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:32:38.484135 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a760179-d031-4ebe-965d-5ee770e2a0a4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:38.494460 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a760179-d031-4ebe-965d-5ee770e2a0a4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:38.499170 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1190f-a4aa-4fc5-a619-1a4515a6e939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:38.499773 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1190f-a4aa-4fc5-a619-1a4515a6e939 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:38.500050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1190f-a4aa-4fc5-a619-1a4515a6e939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:38.500308 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1190f-a4aa-4fc5-a619-1a4515a6e939 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:38.500957 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1190f-a4aa-4fc5-a619-1a4515a6e939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:38.502586 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1190f-a4aa-4fc5-a619-1a4515a6e939 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:38.514009 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1240/2520] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:32:38.518814 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df03d7-cbfa-494c-9d8d-a5b1c15cf721 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:38.529789 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df03d7-cbfa-494c-9d8d-a5b1c15cf721 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:38.534726 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125c51d-6084-4ff7-b64e-acac448a380c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:38.535337 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125c51d-6084-4ff7-b64e-acac448a380c admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:38.535616 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125c51d-6084-4ff7-b64e-acac448a380c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:38.535892 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125c51d-6084-4ff7-b64e-acac448a380c admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:38.536593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0125c51d-6084-4ff7-b64e-acac448a380c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:38.538279 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0125c51d-6084-4ff7-b64e-acac448a380c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:38.551254 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1281/2521] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:32:38.556455 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1190f-a4aa-4fc5-a619-1a4515a6e939 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:38.566672 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1190f-a4aa-4fc5-a619-1a4515a6e939 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:38.571876 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3cbbf-fd2b-4c2f-9292-51718ca22c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:38.572528 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3cbbf-fd2b-4c2f-9292-51718ca22c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:38.572907 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3cbbf-fd2b-4c2f-9292-51718ca22c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:38.573227 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3cbbf-fd2b-4c2f-9292-51718ca22c41 admin admin] PATH_INFO: `/v3/projects/3e827149c92c49bca7633ea031838aa1/users/16e61340b6e34d498b99b24a76eab7a7/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:38.588320 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3cbbf-fd2b-4c2f-9292-51718ca22c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e827149c92c49bca7633ea031838aa1, user_id=16e61340b6e34d498b99b24a76eab7a7, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:38.591033 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3cbbf-fd2b-4c2f-9292-51718ca22c41 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:38.604374 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1241/2522] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:32:38 2022] PUT /identity/v3/projects/3e827149c92c49bca7633ea031838aa1/users/16e61340b6e34d498b99b24a76eab7a7/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:38.614602 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ffa0c-58d6-447a-83d8-2bdcce8329c4 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:38.614909 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ffa0c-58d6-447a-83d8-2bdcce8329c4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:38.615178 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ffa0c-58d6-447a-83d8-2bdcce8329c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:38.643177 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-136ffa0c-58d6-447a-83d8-2bdcce8329c4 None None] MFA Rules not processed for user `16e61340b6e34d498b99b24a76eab7a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:38.644416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-136ffa0c-58d6-447a-83d8-2bdcce8329c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:38.708733 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1282/2523] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:32:38.720060 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3cbbf-fd2b-4c2f-9292-51718ca22c41 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:38.721875 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-79f3cbbf-fd2b-4c2f-9292-51718ca22c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:38.794590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3cbbf-fd2b-4c2f-9292-51718ca22c41 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:38.800317 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e54230-46cc-44c6-bc99-899e298fa584 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:38.800921 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e54230-46cc-44c6-bc99-899e298fa584 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:38.801200 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e54230-46cc-44c6-bc99-899e298fa584 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:38.801505 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e54230-46cc-44c6-bc99-899e298fa584 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:38.809935 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e54230-46cc-44c6-bc99-899e298fa584 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:38.811505 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e54230-46cc-44c6-bc99-899e298fa584 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:38.820234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1242/2524] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:32:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:32:38.961906 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ffa0c-58d6-447a-83d8-2bdcce8329c4 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:38.965659 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-136ffa0c-58d6-447a-83d8-2bdcce8329c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:39.026581 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ffa0c-58d6-447a-83d8-2bdcce8329c4 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:39.031562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cce185-7d61-46d6-a00c-f72fc8376518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:39.031562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cce185-7d61-46d6-a00c-f72fc8376518 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:39.031562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cce185-7d61-46d6-a00c-f72fc8376518 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:39.037284 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cce185-7d61-46d6-a00c-f72fc8376518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:39.038648 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-89cce185-7d61-46d6-a00c-f72fc8376518 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:39.040929 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e54230-46cc-44c6-bc99-899e298fa584 service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:39.105554 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cce185-7d61-46d6-a00c-f72fc8376518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:39.106924 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cce185-7d61-46d6-a00c-f72fc8376518 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:39.107247 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e54230-46cc-44c6-bc99-899e298fa584 service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:39.112538 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a816e5c-0d4c-4968-91a0-4f9f9c28c783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:39.113167 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a816e5c-0d4c-4968-91a0-4f9f9c28c783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:39.113521 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a816e5c-0d4c-4968-91a0-4f9f9c28c783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:39.113806 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a816e5c-0d4c-4968-91a0-4f9f9c28c783 admin admin] PATH_INFO: `/v3/users/16e61340b6e34d498b99b24a76eab7a7` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:39.115688 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a816e5c-0d4c-4968-91a0-4f9f9c28c783 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16e61340b6e34d498b99b24a76eab7a7)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:39.118976 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1283/2525] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:32:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:32:39.119120 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a816e5c-0d4c-4968-91a0-4f9f9c28c783 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:39.154317 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:39.170067 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8a816e5c-0d4c-4968-91a0-4f9f9c28c783 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16e61340b6e34d498b99b24a76eab7a7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:39.170751 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8a816e5c-0d4c-4968-91a0-4f9f9c28c783 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16e61340b6e34d498b99b24a76eab7a7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:39.178149 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8a816e5c-0d4c-4968-91a0-4f9f9c28c783 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16e61340b6e34d498b99b24a76eab7a7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:39.178803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8a816e5c-0d4c-4968-91a0-4f9f9c28c783 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16e61340b6e34d498b99b24a76eab7a7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:39.186927 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8a816e5c-0d4c-4968-91a0-4f9f9c28c783 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16e61340b6e34d498b99b24a76eab7a7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:39.209249 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1243/2526] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:32:39 2022] DELETE /identity/v3/users/16e61340b6e34d498b99b24a76eab7a7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:32:39.214476 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59cec7-33c4-44f7-80e7-de862c516289 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:39.214764 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59cec7-33c4-44f7-80e7-de862c516289 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:39.215038 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59cec7-33c4-44f7-80e7-de862c516289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:39.235116 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2b59cec7-33c4-44f7-80e7-de862c516289 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:39.236338 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2b59cec7-33c4-44f7-80e7-de862c516289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:39.251378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:39.303118 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1284/2527] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:32:39.314343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a816e5c-0d4c-4968-91a0-4f9f9c28c783 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:39.315754 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8a816e5c-0d4c-4968-91a0-4f9f9c28c783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:39.381237 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a816e5c-0d4c-4968-91a0-4f9f9c28c783 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:39.384927 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6686d1-1e7d-41c5-9cc6-99e98f800362 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:39.385571 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6686d1-1e7d-41c5-9cc6-99e98f800362 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:39.385846 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6686d1-1e7d-41c5-9cc6-99e98f800362 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:39.386112 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6686d1-1e7d-41c5-9cc6-99e98f800362 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:39.399888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6686d1-1e7d-41c5-9cc6-99e98f800362 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:39.401985 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6686d1-1e7d-41c5-9cc6-99e98f800362 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:39.413155 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1244/2528] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:32:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:32:39.707698 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59cec7-33c4-44f7-80e7-de862c516289 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:39.710128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2b59cec7-33c4-44f7-80e7-de862c516289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:39.728159 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59cec7-33c4-44f7-80e7-de862c516289 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:39.733521 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbef51e-b442-4317-87c8-73d3a747750f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:39.734177 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbef51e-b442-4317-87c8-73d3a747750f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:39.734489 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbef51e-b442-4317-87c8-73d3a747750f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:39.734819 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbef51e-b442-4317-87c8-73d3a747750f admin admin] PATH_INFO: `/v3/projects/3e827149c92c49bca7633ea031838aa1` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:39.736153 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbef51e-b442-4317-87c8-73d3a747750f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e827149c92c49bca7633ea031838aa1)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:39.738119 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbef51e-b442-4317-87c8-73d3a747750f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:39.787687 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4cbef51e-b442-4317-87c8-73d3a747750f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e827149c92c49bca7633ea031838aa1', 'request_id': 'req-4cbef51e-b442-4317-87c8-73d3a747750f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:39.794562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4cbef51e-b442-4317-87c8-73d3a747750f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e827149c92c49bca7633ea031838aa1', 'request_id': 'req-4cbef51e-b442-4317-87c8-73d3a747750f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:39.800941 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4cbef51e-b442-4317-87c8-73d3a747750f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e827149c92c49bca7633ea031838aa1', 'request_id': 'req-4cbef51e-b442-4317-87c8-73d3a747750f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:39.815114 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4cbef51e-b442-4317-87c8-73d3a747750f admin admin] The token cache is being invalidate because project 3e827149c92c49bca7633ea031838aa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:32:39.815407 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4cbef51e-b442-4317-87c8-73d3a747750f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:39.816092 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4cbef51e-b442-4317-87c8-73d3a747750f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:39.817835 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1285/2529] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:32:39 2022] DELETE /identity/v3/projects/3e827149c92c49bca7633ea031838aa1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:32:39.823102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc51b7f-f4d6-4f81-9edd-90ff540720b6 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:39.823467 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc51b7f-f4d6-4f81-9edd-90ff540720b6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:39.824655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc51b7f-f4d6-4f81-9edd-90ff540720b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:39.844564 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3cc51b7f-f4d6-4f81-9edd-90ff540720b6 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:39.845896 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3cc51b7f-f4d6-4f81-9edd-90ff540720b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:39.908136 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1245/2530] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:32:39.917032 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f75835-aa61-42d6-8881-b3b91abd1bcf None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:39.917321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f75835-aa61-42d6-8881-b3b91abd1bcf None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:39.917628 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f75835-aa61-42d6-8881-b3b91abd1bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:39.938134 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-44f75835-aa61-42d6-8881-b3b91abd1bcf None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:39.939349 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-44f75835-aa61-42d6-8881-b3b91abd1bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:39.947761 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1286/2531] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:32:39.951856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc51b7f-f4d6-4f81-9edd-90ff540720b6 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:39.962217 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc51b7f-f4d6-4f81-9edd-90ff540720b6 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:39.966798 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c5025-deb8-461f-ac25-e93e09b248c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:39.967394 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c5025-deb8-461f-ac25-e93e09b248c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:39.967673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c5025-deb8-461f-ac25-e93e09b248c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:39.967945 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c5025-deb8-461f-ac25-e93e09b248c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:39.968588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c5025-deb8-461f-ac25-e93e09b248c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:32:39.968891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c5025-deb8-461f-ac25-e93e09b248c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:39.970559 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c5025-deb8-461f-ac25-e93e09b248c3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:39.982981 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1246/2532] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:32:39.986910 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f75835-aa61-42d6-8881-b3b91abd1bcf None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:39.996402 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f75835-aa61-42d6-8881-b3b91abd1bcf None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:40.001386 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc55947-62ef-46fa-b1df-6a6b941ce853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:40.002008 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc55947-62ef-46fa-b1df-6a6b941ce853 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:40.002288 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc55947-62ef-46fa-b1df-6a6b941ce853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:40.002560 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc55947-62ef-46fa-b1df-6a6b941ce853 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:40.003230 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc55947-62ef-46fa-b1df-6a6b941ce853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:40.005130 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc55947-62ef-46fa-b1df-6a6b941ce853 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:40.039014 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1287/2533] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:32:39 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:32:40.040745 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c5025-deb8-461f-ac25-e93e09b248c3 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:40.051398 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c5025-deb8-461f-ac25-e93e09b248c3 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:40.085101 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:40.119077 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f920e6d-dec1-4769-bbe7-33f1205e99ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:40.119705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f920e6d-dec1-4769-bbe7-33f1205e99ca admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:40.119986 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f920e6d-dec1-4769-bbe7-33f1205e99ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:40.120262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f920e6d-dec1-4769-bbe7-33f1205e99ca admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:40.121150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f920e6d-dec1-4769-bbe7-33f1205e99ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:40.123134 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f920e6d-dec1-4769-bbe7-33f1205e99ca admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:40.149268 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1247/2534] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:32:40 2022] POST /identity/v3/users => generated 283 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:32:40.153659 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc55947-62ef-46fa-b1df-6a6b941ce853 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:40.165249 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc55947-62ef-46fa-b1df-6a6b941ce853 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:40.170880 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c876b-5cfb-4b83-8319-00e3d9f511f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:40.171764 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c876b-5cfb-4b83-8319-00e3d9f511f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:40.172304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c876b-5cfb-4b83-8319-00e3d9f511f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:40.172580 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c876b-5cfb-4b83-8319-00e3d9f511f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:40.173246 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c876b-5cfb-4b83-8319-00e3d9f511f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:40.174901 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c876b-5cfb-4b83-8319-00e3d9f511f8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:40.186820 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1288/2535] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:32:40.190879 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f920e6d-dec1-4769-bbe7-33f1205e99ca admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:40.202120 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f920e6d-dec1-4769-bbe7-33f1205e99ca admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:40.207948 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bea88-c510-4290-9415-677e42d06f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:40.208564 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bea88-c510-4290-9415-677e42d06f99 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:40.208837 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bea88-c510-4290-9415-677e42d06f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:40.209100 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bea88-c510-4290-9415-677e42d06f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:40.209784 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3bea88-c510-4290-9415-677e42d06f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:40.211915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3bea88-c510-4290-9415-677e42d06f99 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:40.224644 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1248/2536] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:32:40.228614 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c876b-5cfb-4b83-8319-00e3d9f511f8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:40.239452 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c876b-5cfb-4b83-8319-00e3d9f511f8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:40.244848 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a01a17-f073-43d6-afe1-014cf5003791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:40.245550 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a01a17-f073-43d6-afe1-014cf5003791 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:40.245829 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a01a17-f073-43d6-afe1-014cf5003791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:40.246098 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a01a17-f073-43d6-afe1-014cf5003791 admin admin] PATH_INFO: `/v3/projects/9952ac3d0d1b4e4d81518edd069432aa/users/a4ca08348b944243b35371f25f1978da/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:40.263717 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a01a17-f073-43d6-afe1-014cf5003791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9952ac3d0d1b4e4d81518edd069432aa, user_id=a4ca08348b944243b35371f25f1978da, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:40.266013 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a01a17-f073-43d6-afe1-014cf5003791 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:40.281979 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1289/2537] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:32:40 2022] PUT /identity/v3/projects/9952ac3d0d1b4e4d81518edd069432aa/users/a4ca08348b944243b35371f25f1978da/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:40.292979 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed902e0-4440-41da-949d-3c2678f16746 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:40.293288 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed902e0-4440-41da-949d-3c2678f16746 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:40.293588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed902e0-4440-41da-949d-3c2678f16746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:40.323094 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-0ed902e0-4440-41da-949d-3c2678f16746 None None] MFA Rules not processed for user `a4ca08348b944243b35371f25f1978da`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:40.324331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0ed902e0-4440-41da-949d-3c2678f16746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:40.394767 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1249/2538] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:32:40.399276 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a01a17-f073-43d6-afe1-014cf5003791 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:40.440792 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:40.463747 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a01a17-f073-43d6-afe1-014cf5003791 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:40.468751 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f52a7c-ff80-4d5d-8e68-8e15e1f7c610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:40.469352 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f52a7c-ff80-4d5d-8e68-8e15e1f7c610 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:40.469658 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f52a7c-ff80-4d5d-8e68-8e15e1f7c610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:40.469925 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f52a7c-ff80-4d5d-8e68-8e15e1f7c610 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:40.470560 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f52a7c-ff80-4d5d-8e68-8e15e1f7c610 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:40.472522 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f52a7c-ff80-4d5d-8e68-8e15e1f7c610 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:40.499286 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1290/2539] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:32:40 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:32:40.503089 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed902e0-4440-41da-949d-3c2678f16746 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:40.514502 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed902e0-4440-41da-949d-3c2678f16746 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:40.584686 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50914c8b-71fb-4ab7-87f4-d8036a68d1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:40.585308 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50914c8b-71fb-4ab7-87f4-d8036a68d1da admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:40.585614 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50914c8b-71fb-4ab7-87f4-d8036a68d1da admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:40.586465 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50914c8b-71fb-4ab7-87f4-d8036a68d1da admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:40.587133 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50914c8b-71fb-4ab7-87f4-d8036a68d1da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:40.589070 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50914c8b-71fb-4ab7-87f4-d8036a68d1da admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:40.623024 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1250/2540] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:32:40 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:32:40.627072 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f52a7c-ff80-4d5d-8e68-8e15e1f7c610 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:40.648178 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f52a7c-ff80-4d5d-8e68-8e15e1f7c610 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:40.654770 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f1fcc-bb04-45d7-be1c-9a3dc4bd38b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:40.655491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f1fcc-bb04-45d7-be1c-9a3dc4bd38b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:40.655844 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f1fcc-bb04-45d7-be1c-9a3dc4bd38b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:40.657310 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f1fcc-bb04-45d7-be1c-9a3dc4bd38b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:40.658247 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f1fcc-bb04-45d7-be1c-9a3dc4bd38b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:40.660514 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f1fcc-bb04-45d7-be1c-9a3dc4bd38b4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:40.679670 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1291/2541] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:32:40.680867 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50914c8b-71fb-4ab7-87f4-d8036a68d1da admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:40.692030 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50914c8b-71fb-4ab7-87f4-d8036a68d1da admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:40.697971 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2a298-f9dd-4f75-9f11-efe8b8ebd66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:40.698752 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2a298-f9dd-4f75-9f11-efe8b8ebd66b admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:40.699130 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2a298-f9dd-4f75-9f11-efe8b8ebd66b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:40.699537 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2a298-f9dd-4f75-9f11-efe8b8ebd66b admin admin] PATH_INFO: `/v3/projects/9b9e49ee122048efbf2942fb5c0251f2/users/0ef58d6d970349f19f3b73bbb1bbfb9d/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:40.722265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2a298-f9dd-4f75-9f11-efe8b8ebd66b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9e49ee122048efbf2942fb5c0251f2, user_id=0ef58d6d970349f19f3b73bbb1bbfb9d, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:40.725229 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2a298-f9dd-4f75-9f11-efe8b8ebd66b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:40.745441 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1251/2542] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:32:40 2022] PUT /identity/v3/projects/9b9e49ee122048efbf2942fb5c0251f2/users/0ef58d6d970349f19f3b73bbb1bbfb9d/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:40.752575 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f1fcc-bb04-45d7-be1c-9a3dc4bd38b4 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:40.766149 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f1fcc-bb04-45d7-be1c-9a3dc4bd38b4 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:40.833842 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3d5d9-104c-4d1e-a3fc-ba92a1badd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:40.835895 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3d5d9-104c-4d1e-a3fc-ba92a1badd58 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:40.835895 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3d5d9-104c-4d1e-a3fc-ba92a1badd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:40.835895 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3d5d9-104c-4d1e-a3fc-ba92a1badd58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:40.836362 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3d5d9-104c-4d1e-a3fc-ba92a1badd58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:40.838026 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3d5d9-104c-4d1e-a3fc-ba92a1badd58 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:40.849069 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1292/2543] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:32:40.853120 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2a298-f9dd-4f75-9f11-efe8b8ebd66b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:40.870150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2a298-f9dd-4f75-9f11-efe8b8ebd66b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:40.874846 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83f3c4-f827-437e-8855-5fa29bb9085f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:40.875159 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83f3c4-f827-437e-8855-5fa29bb9085f admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:40.875579 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83f3c4-f827-437e-8855-5fa29bb9085f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:40.876322 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83f3c4-f827-437e-8855-5fa29bb9085f admin admin] PATH_INFO: `/v3/projects/9b9e49ee122048efbf2942fb5c0251f2/users/0ef58d6d970349f19f3b73bbb1bbfb9d/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:40.880197 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83f3c4-f827-437e-8855-5fa29bb9085f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9e49ee122048efbf2942fb5c0251f2, user_id=0ef58d6d970349f19f3b73bbb1bbfb9d, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:40.883531 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83f3c4-f827-437e-8855-5fa29bb9085f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:40.890289 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:40.896567 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1252/2544] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:32:40 2022] PUT /identity/v3/projects/9b9e49ee122048efbf2942fb5c0251f2/users/0ef58d6d970349f19f3b73bbb1bbfb9d/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:32:40.908782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee96177-bdc6-46b1-8a7e-87b6722993e5 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:40.909041 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee96177-bdc6-46b1-8a7e-87b6722993e5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:40.909318 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee96177-bdc6-46b1-8a7e-87b6722993e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:40.948419 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5ee96177-bdc6-46b1-8a7e-87b6722993e5 None None] MFA Rules not processed for user `0ef58d6d970349f19f3b73bbb1bbfb9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:40.949617 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5ee96177-bdc6-46b1-8a7e-87b6722993e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:41.029362 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1293/2545] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:40 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:32:41.042260 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83f3c4-f827-437e-8855-5fa29bb9085f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:41.044955 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ba83f3c4-f827-437e-8855-5fa29bb9085f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:41.108865 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83f3c4-f827-437e-8855-5fa29bb9085f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:41.112987 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3f0e1-8cee-48b9-93fa-3311a63cdaf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:41.113732 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3f0e1-8cee-48b9-93fa-3311a63cdaf8 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:41.114179 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3f0e1-8cee-48b9-93fa-3311a63cdaf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:41.114522 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3f0e1-8cee-48b9-93fa-3311a63cdaf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:41.125762 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3f0e1-8cee-48b9-93fa-3311a63cdaf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:41.127402 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3f0e1-8cee-48b9-93fa-3311a63cdaf8 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:41.148365 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1253/2546] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:32:41 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:32:41.224497 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee96177-bdc6-46b1-8a7e-87b6722993e5 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:41.234420 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee96177-bdc6-46b1-8a7e-87b6722993e5 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:41.238170 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c85681-d636-4e7b-908f-b0d760ac5103 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:41.238848 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c85681-d636-4e7b-908f-b0d760ac5103 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:41.239194 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c85681-d636-4e7b-908f-b0d760ac5103 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:41.239540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c85681-d636-4e7b-908f-b0d760ac5103 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:41.272784 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:41.302031 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c85681-d636-4e7b-908f-b0d760ac5103 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:41.303615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c85681-d636-4e7b-908f-b0d760ac5103 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:41.313378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1294/2547] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:32:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:32:42.305071 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3f0e1-8cee-48b9-93fa-3311a63cdaf8 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:42.310078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-64d3f0e1-8cee-48b9-93fa-3311a63cdaf8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:42.379761 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3f0e1-8cee-48b9-93fa-3311a63cdaf8 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:42.385121 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c85681-d636-4e7b-908f-b0d760ac5103 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:42.386668 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a4c85681-d636-4e7b-908f-b0d760ac5103 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:42.392331 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3212a-c9fd-4a13-8455-864e6cc68318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:42.393231 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3212a-c9fd-4a13-8455-864e6cc68318 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:42.393719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3212a-c9fd-4a13-8455-864e6cc68318 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:42.394323 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3212a-c9fd-4a13-8455-864e6cc68318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:42.398042 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-50f3212a-c9fd-4a13-8455-864e6cc68318 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:42.411246 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3212a-c9fd-4a13-8455-864e6cc68318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:42.411941 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3212a-c9fd-4a13-8455-864e6cc68318 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:42.421489 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1254/2548] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:32:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:32:42.457206 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3212a-c9fd-4a13-8455-864e6cc68318 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:42.459063 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-50f3212a-c9fd-4a13-8455-864e6cc68318 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:42.482607 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c85681-d636-4e7b-908f-b0d760ac5103 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:42.488804 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5d575-ce19-4f14-8012-233b936be3f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3622621761f4f18ae3e9dfb5ba99bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:42.489553 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5d575-ce19-4f14-8012-233b936be3f2 service placement] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:42.489724 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5d575-ce19-4f14-8012-233b936be3f2 service placement] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:42.489981 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5d575-ce19-4f14-8012-233b936be3f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:42.491873 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9ed5d575-ce19-4f14-8012-233b936be3f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:42.515470 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5d575-ce19-4f14-8012-233b936be3f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:42.517235 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5d575-ce19-4f14-8012-233b936be3f2 service placement] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:42.543367 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1295/2549] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:32:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:32:42.565066 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3212a-c9fd-4a13-8455-864e6cc68318 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:42.572073 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a8aa7-3e76-4fd1-8cb0-6d843de6ba33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:42.572978 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a8aa7-3e76-4fd1-8cb0-6d843de6ba33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:42.573916 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a8aa7-3e76-4fd1-8cb0-6d843de6ba33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:42.574243 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a8aa7-3e76-4fd1-8cb0-6d843de6ba33 admin admin] PATH_INFO: `/v3/users/754c17cea670481bb43938aaf2e8d7d2` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:42.575698 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a8aa7-3e76-4fd1-8cb0-6d843de6ba33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=754c17cea670481bb43938aaf2e8d7d2)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:42.578259 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a8aa7-3e76-4fd1-8cb0-6d843de6ba33 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:42.643894 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:42.646466 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-580a8aa7-3e76-4fd1-8cb0-6d843de6ba33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '754c17cea670481bb43938aaf2e8d7d2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:42.647600 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-580a8aa7-3e76-4fd1-8cb0-6d843de6ba33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '754c17cea670481bb43938aaf2e8d7d2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:42.660499 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-580a8aa7-3e76-4fd1-8cb0-6d843de6ba33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '754c17cea670481bb43938aaf2e8d7d2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:42.661183 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-580a8aa7-3e76-4fd1-8cb0-6d843de6ba33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '754c17cea670481bb43938aaf2e8d7d2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:42.669641 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-580a8aa7-3e76-4fd1-8cb0-6d843de6ba33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '754c17cea670481bb43938aaf2e8d7d2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:42.690063 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1255/2550] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:32:42 2022] DELETE /identity/v3/users/754c17cea670481bb43938aaf2e8d7d2 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:42.893790 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5d575-ce19-4f14-8012-233b936be3f2 service placement] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:42.908530 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5d575-ce19-4f14-8012-233b936be3f2 service placement] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:42.982725 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07002a7-7c0f-4d45-bcef-2396c725230f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:42.983373 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07002a7-7c0f-4d45-bcef-2396c725230f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:42.983818 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07002a7-7c0f-4d45-bcef-2396c725230f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:42.984097 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07002a7-7c0f-4d45-bcef-2396c725230f admin admin] PATH_INFO: `/v3/projects/0fecac33adfb42c8b8bd850e9ba07f63` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:42.985611 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07002a7-7c0f-4d45-bcef-2396c725230f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fecac33adfb42c8b8bd850e9ba07f63)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:42.988182 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07002a7-7c0f-4d45-bcef-2396c725230f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:43.051805 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a07002a7-7c0f-4d45-bcef-2396c725230f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fecac33adfb42c8b8bd850e9ba07f63', 'request_id': 'req-a07002a7-7c0f-4d45-bcef-2396c725230f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:43.060174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a07002a7-7c0f-4d45-bcef-2396c725230f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fecac33adfb42c8b8bd850e9ba07f63', 'request_id': 'req-a07002a7-7c0f-4d45-bcef-2396c725230f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:43.071967 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a07002a7-7c0f-4d45-bcef-2396c725230f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fecac33adfb42c8b8bd850e9ba07f63', 'request_id': 'req-a07002a7-7c0f-4d45-bcef-2396c725230f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:43.074173 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:43.091658 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a07002a7-7c0f-4d45-bcef-2396c725230f admin admin] The token cache is being invalidate because project 0fecac33adfb42c8b8bd850e9ba07f63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:32:43.091976 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a07002a7-7c0f-4d45-bcef-2396c725230f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:43.092697 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a07002a7-7c0f-4d45-bcef-2396c725230f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:43.094242 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1296/2551] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:32:42 2022] DELETE /identity/v3/projects/0fecac33adfb42c8b8bd850e9ba07f63 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:43.099543 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc926581-2adf-45ff-9dd9-67fe0debe8cb None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:43.100351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc926581-2adf-45ff-9dd9-67fe0debe8cb None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:43.100727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc926581-2adf-45ff-9dd9-67fe0debe8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:43.123788 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-dc926581-2adf-45ff-9dd9-67fe0debe8cb None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:43.125091 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dc926581-2adf-45ff-9dd9-67fe0debe8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:43.207270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1256/2552] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:32:43.219278 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c690e-6449-4611-9e9c-102995fe2cc9 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:43.219553 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c690e-6449-4611-9e9c-102995fe2cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:43.220519 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c690e-6449-4611-9e9c-102995fe2cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:43.242704 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc926581-2adf-45ff-9dd9-67fe0debe8cb None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:43.245090 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dc926581-2adf-45ff-9dd9-67fe0debe8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:43.246128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-326c690e-6449-4611-9e9c-102995fe2cc9 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:43.248335 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-326c690e-6449-4611-9e9c-102995fe2cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:43.258634 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1297/2553] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:32:43.262830 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c690e-6449-4611-9e9c-102995fe2cc9 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:43.272307 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c690e-6449-4611-9e9c-102995fe2cc9 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:43.277002 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ac4d4-5ca7-489c-bf2e-4b42330da476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:43.277631 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ac4d4-5ca7-489c-bf2e-4b42330da476 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:43.277905 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ac4d4-5ca7-489c-bf2e-4b42330da476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:43.278171 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ac4d4-5ca7-489c-bf2e-4b42330da476 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:43.278811 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ac4d4-5ca7-489c-bf2e-4b42330da476 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:32:43.279108 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ac4d4-5ca7-489c-bf2e-4b42330da476 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:43.280726 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ac4d4-5ca7-489c-bf2e-4b42330da476 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:43.298120 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1298/2554] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:32:43.302355 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ac4d4-5ca7-489c-bf2e-4b42330da476 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:43.315095 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ac4d4-5ca7-489c-bf2e-4b42330da476 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:43.327889 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a013e1b-5699-4226-81f8-6c8a1806fbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:43.328569 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a013e1b-5699-4226-81f8-6c8a1806fbf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:43.328943 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a013e1b-5699-4226-81f8-6c8a1806fbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:43.329319 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a013e1b-5699-4226-81f8-6c8a1806fbf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:43.330191 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a013e1b-5699-4226-81f8-6c8a1806fbf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:43.332191 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a013e1b-5699-4226-81f8-6c8a1806fbf8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:43.336348 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc926581-2adf-45ff-9dd9-67fe0debe8cb None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:43.342055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4987db2-c8ef-45f5-96dd-7d5df2fd6589 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3622621761f4f18ae3e9dfb5ba99bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:43.342967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4987db2-c8ef-45f5-96dd-7d5df2fd6589 service placement] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:43.343427 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4987db2-c8ef-45f5-96dd-7d5df2fd6589 service placement] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:43.343852 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4987db2-c8ef-45f5-96dd-7d5df2fd6589 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:43.346300 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f4987db2-c8ef-45f5-96dd-7d5df2fd6589 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:43.362119 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4987db2-c8ef-45f5-96dd-7d5df2fd6589 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:43.363734 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4987db2-c8ef-45f5-96dd-7d5df2fd6589 service placement] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:43.368811 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1299/2555] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:32:43 2022] POST /identity/v3/projects => generated 365 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:32:43.371443 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a013e1b-5699-4226-81f8-6c8a1806fbf8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:43.375338 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1257/2556] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:32:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:32:43.433893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a013e1b-5699-4226-81f8-6c8a1806fbf8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:43.438968 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f51a5a-36fe-45ed-9fa3-714002f5c5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:43.439574 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f51a5a-36fe-45ed-9fa3-714002f5c5f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:43.439850 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f51a5a-36fe-45ed-9fa3-714002f5c5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:43.440117 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f51a5a-36fe-45ed-9fa3-714002f5c5f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:43.440748 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f51a5a-36fe-45ed-9fa3-714002f5c5f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:43.442691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f51a5a-36fe-45ed-9fa3-714002f5c5f3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:43.464359 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1300/2557] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:32:43 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:32:43.468425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4987db2-c8ef-45f5-96dd-7d5df2fd6589 service placement] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:43.480501 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4987db2-c8ef-45f5-96dd-7d5df2fd6589 service placement] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:43.485129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f365af5-6771-4475-a48d-983bd885c1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:43.485887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f365af5-6771-4475-a48d-983bd885c1eb admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:43.486226 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f365af5-6771-4475-a48d-983bd885c1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:43.486556 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f365af5-6771-4475-a48d-983bd885c1eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:43.487260 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f365af5-6771-4475-a48d-983bd885c1eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:43.488920 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f365af5-6771-4475-a48d-983bd885c1eb admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:43.500041 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1258/2558] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:32:43.503877 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f51a5a-36fe-45ed-9fa3-714002f5c5f3 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:43.514075 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f51a5a-36fe-45ed-9fa3-714002f5c5f3 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:43.518745 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65207e3-f53d-4e40-9ae7-6c65cbe5052b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:43.519342 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65207e3-f53d-4e40-9ae7-6c65cbe5052b admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:43.519619 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65207e3-f53d-4e40-9ae7-6c65cbe5052b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:43.519890 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65207e3-f53d-4e40-9ae7-6c65cbe5052b admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:43.520618 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65207e3-f53d-4e40-9ae7-6c65cbe5052b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:43.522316 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65207e3-f53d-4e40-9ae7-6c65cbe5052b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:43.537440 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1301/2559] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:32:43.540172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f365af5-6771-4475-a48d-983bd885c1eb admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:43.550847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f365af5-6771-4475-a48d-983bd885c1eb admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:43.558100 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641eab3-75dd-48d2-ace2-cd7c3832936d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:43.558942 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641eab3-75dd-48d2-ace2-cd7c3832936d admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:43.559385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641eab3-75dd-48d2-ace2-cd7c3832936d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:43.559963 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641eab3-75dd-48d2-ace2-cd7c3832936d admin admin] PATH_INFO: `/v3/projects/45a1b4771ad7406b9cc31c699bac9796/users/777c2c335ee146c6bcc29ceb3d103b31/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:43.577361 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d641eab3-75dd-48d2-ace2-cd7c3832936d admin admin] RBAC: Authorizing `identity:create_grant(project_id=45a1b4771ad7406b9cc31c699bac9796, user_id=777c2c335ee146c6bcc29ceb3d103b31, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:43.580276 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d641eab3-75dd-48d2-ace2-cd7c3832936d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:43.599645 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1259/2560] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:32:43 2022] PUT /identity/v3/projects/45a1b4771ad7406b9cc31c699bac9796/users/777c2c335ee146c6bcc29ceb3d103b31/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:43.612682 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852eaf4d-a5bc-43e0-8ffa-ad6480773b03 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:43.613093 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852eaf4d-a5bc-43e0-8ffa-ad6480773b03 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:43.613376 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852eaf4d-a5bc-43e0-8ffa-ad6480773b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:43.644917 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-852eaf4d-a5bc-43e0-8ffa-ad6480773b03 None None] MFA Rules not processed for user `777c2c335ee146c6bcc29ceb3d103b31`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:43.646172 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-852eaf4d-a5bc-43e0-8ffa-ad6480773b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:43.714542 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1302/2561] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:32:43.725542 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641eab3-75dd-48d2-ace2-cd7c3832936d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:43.731624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d641eab3-75dd-48d2-ace2-cd7c3832936d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:43.759968 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:43.799316 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641eab3-75dd-48d2-ace2-cd7c3832936d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:43.803401 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a53474-a3c8-4665-b78c-3379b4f815f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:43.803621 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a53474-a3c8-4665-b78c-3379b4f815f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:43.804269 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a53474-a3c8-4665-b78c-3379b4f815f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:43.804978 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a53474-a3c8-4665-b78c-3379b4f815f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:43.814096 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a53474-a3c8-4665-b78c-3379b4f815f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:43.815718 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a53474-a3c8-4665-b78c-3379b4f815f0 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:43.825786 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1260/2562] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:32:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:32:44.201048 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852eaf4d-a5bc-43e0-8ffa-ad6480773b03 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:44.202516 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-852eaf4d-a5bc-43e0-8ffa-ad6480773b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:44.222501 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:44.269220 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852eaf4d-a5bc-43e0-8ffa-ad6480773b03 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:44.273968 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65cb83-4984-4c93-8af6-0883e1a233d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:44.274586 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65cb83-4984-4c93-8af6-0883e1a233d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:44.274861 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65cb83-4984-4c93-8af6-0883e1a233d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:44.275129 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65cb83-4984-4c93-8af6-0883e1a233d6 admin admin] PATH_INFO: `/v3/users/a4ca08348b944243b35371f25f1978da` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:44.276230 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65cb83-4984-4c93-8af6-0883e1a233d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4ca08348b944243b35371f25f1978da)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:44.278195 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65cb83-4984-4c93-8af6-0883e1a233d6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:44.329177 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ea65cb83-4984-4c93-8af6-0883e1a233d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4ca08348b944243b35371f25f1978da'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:44.329825 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ea65cb83-4984-4c93-8af6-0883e1a233d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4ca08348b944243b35371f25f1978da'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:44.344892 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ea65cb83-4984-4c93-8af6-0883e1a233d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4ca08348b944243b35371f25f1978da'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:44.353794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ea65cb83-4984-4c93-8af6-0883e1a233d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4ca08348b944243b35371f25f1978da'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:44.362745 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ea65cb83-4984-4c93-8af6-0883e1a233d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4ca08348b944243b35371f25f1978da'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:44.373556 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1303/2563] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:32:44 2022] DELETE /identity/v3/users/a4ca08348b944243b35371f25f1978da => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:44.375760 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413379f6-c8b2-4a2b-b98c-b7caf6c9e86d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:44.381692 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413379f6-c8b2-4a2b-b98c-b7caf6c9e86d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:44.385781 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413379f6-c8b2-4a2b-b98c-b7caf6c9e86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:44.427174 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-413379f6-c8b2-4a2b-b98c-b7caf6c9e86d None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:44.431467 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-413379f6-c8b2-4a2b-b98c-b7caf6c9e86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:44.527104 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1261/2564] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:32:44.540697 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65cb83-4984-4c93-8af6-0883e1a233d6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:44.542262 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ea65cb83-4984-4c93-8af6-0883e1a233d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:44.618874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65cb83-4984-4c93-8af6-0883e1a233d6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:44.625090 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef5260-d7f7-4767-816a-23817e0b6d15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:44.625714 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef5260-d7f7-4767-816a-23817e0b6d15 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:44.625993 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef5260-d7f7-4767-816a-23817e0b6d15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:44.626264 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef5260-d7f7-4767-816a-23817e0b6d15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:44.648938 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef5260-d7f7-4767-816a-23817e0b6d15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:44.650551 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef5260-d7f7-4767-816a-23817e0b6d15 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:44.660862 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1304/2565] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:32:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:32:44.950437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413379f6-c8b2-4a2b-b98c-b7caf6c9e86d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:44.952044 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-413379f6-c8b2-4a2b-b98c-b7caf6c9e86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:44.965205 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413379f6-c8b2-4a2b-b98c-b7caf6c9e86d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:44.970004 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9084777-86f6-43f2-b32d-e4f100fff8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:44.970654 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9084777-86f6-43f2-b32d-e4f100fff8df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:44.970934 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9084777-86f6-43f2-b32d-e4f100fff8df admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:44.971207 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9084777-86f6-43f2-b32d-e4f100fff8df admin admin] PATH_INFO: `/v3/projects/9952ac3d0d1b4e4d81518edd069432aa` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:44.981245 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9084777-86f6-43f2-b32d-e4f100fff8df admin admin] RBAC: Authorizing `identity:delete_project(project_id=9952ac3d0d1b4e4d81518edd069432aa)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:44.983578 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9084777-86f6-43f2-b32d-e4f100fff8df admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:45.039470 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e9084777-86f6-43f2-b32d-e4f100fff8df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9952ac3d0d1b4e4d81518edd069432aa', 'request_id': 'req-e9084777-86f6-43f2-b32d-e4f100fff8df'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:45.045153 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e9084777-86f6-43f2-b32d-e4f100fff8df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9952ac3d0d1b4e4d81518edd069432aa', 'request_id': 'req-e9084777-86f6-43f2-b32d-e4f100fff8df'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:45.052071 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e9084777-86f6-43f2-b32d-e4f100fff8df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9952ac3d0d1b4e4d81518edd069432aa', 'request_id': 'req-e9084777-86f6-43f2-b32d-e4f100fff8df'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:45.066169 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e9084777-86f6-43f2-b32d-e4f100fff8df admin admin] The token cache is being invalidate because project 9952ac3d0d1b4e4d81518edd069432aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:32:45.066461 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e9084777-86f6-43f2-b32d-e4f100fff8df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:45.067093 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e9084777-86f6-43f2-b32d-e4f100fff8df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:45.068626 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1262/2566] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:32:44 2022] DELETE /identity/v3/projects/9952ac3d0d1b4e4d81518edd069432aa => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:45.072680 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef5260-d7f7-4767-816a-23817e0b6d15 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:45.082619 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef5260-d7f7-4767-816a-23817e0b6d15 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:45.121878 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:45.141049 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8756f2-07e3-47a8-b4eb-b457f877885f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:45.141711 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8756f2-07e3-47a8-b4eb-b457f877885f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:45.141995 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8756f2-07e3-47a8-b4eb-b457f877885f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:45.142267 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8756f2-07e3-47a8-b4eb-b457f877885f admin admin] PATH_INFO: `/v3/users/0ef58d6d970349f19f3b73bbb1bbfb9d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:45.143980 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8756f2-07e3-47a8-b4eb-b457f877885f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ef58d6d970349f19f3b73bbb1bbfb9d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:45.145471 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8756f2-07e3-47a8-b4eb-b457f877885f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:45.215699 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0b8756f2-07e3-47a8-b4eb-b457f877885f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ef58d6d970349f19f3b73bbb1bbfb9d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:45.216391 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0b8756f2-07e3-47a8-b4eb-b457f877885f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ef58d6d970349f19f3b73bbb1bbfb9d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:45.232302 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0b8756f2-07e3-47a8-b4eb-b457f877885f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ef58d6d970349f19f3b73bbb1bbfb9d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:45.241648 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0b8756f2-07e3-47a8-b4eb-b457f877885f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ef58d6d970349f19f3b73bbb1bbfb9d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:45.251246 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0b8756f2-07e3-47a8-b4eb-b457f877885f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ef58d6d970349f19f3b73bbb1bbfb9d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:45.259214 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1305/2567] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:32:45 2022] DELETE /identity/v3/users/0ef58d6d970349f19f3b73bbb1bbfb9d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:45.711842 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9084777-86f6-43f2-b32d-e4f100fff8df admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:45.714932 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e9084777-86f6-43f2-b32d-e4f100fff8df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:45.737311 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9084777-86f6-43f2-b32d-e4f100fff8df admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:45.805573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:45.830239 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48dc78-1abc-4be2-964c-e76d5eba3cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:45.831003 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48dc78-1abc-4be2-964c-e76d5eba3cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:45.831536 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48dc78-1abc-4be2-964c-e76d5eba3cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:45.831863 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48dc78-1abc-4be2-964c-e76d5eba3cc3 admin admin] PATH_INFO: `/v3/projects/9b9e49ee122048efbf2942fb5c0251f2` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:45.834090 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48dc78-1abc-4be2-964c-e76d5eba3cc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b9e49ee122048efbf2942fb5c0251f2)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:45.837071 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48dc78-1abc-4be2-964c-e76d5eba3cc3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:45.909472 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6c48dc78-1abc-4be2-964c-e76d5eba3cc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b9e49ee122048efbf2942fb5c0251f2', 'request_id': 'req-6c48dc78-1abc-4be2-964c-e76d5eba3cc3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:45.917002 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6c48dc78-1abc-4be2-964c-e76d5eba3cc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b9e49ee122048efbf2942fb5c0251f2', 'request_id': 'req-6c48dc78-1abc-4be2-964c-e76d5eba3cc3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:45.923427 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6c48dc78-1abc-4be2-964c-e76d5eba3cc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b9e49ee122048efbf2942fb5c0251f2', 'request_id': 'req-6c48dc78-1abc-4be2-964c-e76d5eba3cc3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:45.940308 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6c48dc78-1abc-4be2-964c-e76d5eba3cc3 admin admin] The token cache is being invalidate because project 9b9e49ee122048efbf2942fb5c0251f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:32:45.940849 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6c48dc78-1abc-4be2-964c-e76d5eba3cc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:45.941694 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6c48dc78-1abc-4be2-964c-e76d5eba3cc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:45.943503 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1263/2568] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:32:45 2022] DELETE /identity/v3/projects/9b9e49ee122048efbf2942fb5c0251f2 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:45.948470 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1eba3-864f-4379-9de0-e533f80c5282 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:45.948999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1eba3-864f-4379-9de0-e533f80c5282 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:45.949393 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1eba3-864f-4379-9de0-e533f80c5282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:45.971359 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-48e1eba3-864f-4379-9de0-e533f80c5282 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:45.974005 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-48e1eba3-864f-4379-9de0-e533f80c5282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:46.040163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1306/2569] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:32:46.048856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70d776-6b53-4634-a9b0-a8ca98a9dfda None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:46.049242 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70d776-6b53-4634-a9b0-a8ca98a9dfda None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:46.049714 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70d776-6b53-4634-a9b0-a8ca98a9dfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:46.073996 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2e70d776-6b53-4634-a9b0-a8ca98a9dfda None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:46.075203 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2e70d776-6b53-4634-a9b0-a8ca98a9dfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:46.083243 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1264/2570] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:32:46.088002 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1eba3-864f-4379-9de0-e533f80c5282 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:46.098941 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1eba3-864f-4379-9de0-e533f80c5282 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:46.107426 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f225f-d8a8-45a4-a16c-d1a027c61d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:46.115763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f225f-d8a8-45a4-a16c-d1a027c61d73 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:46.117899 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f225f-d8a8-45a4-a16c-d1a027c61d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:46.118732 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f225f-d8a8-45a4-a16c-d1a027c61d73 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:46.119608 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f225f-d8a8-45a4-a16c-d1a027c61d73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:32:46.120093 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f225f-d8a8-45a4-a16c-d1a027c61d73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:46.123438 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f225f-d8a8-45a4-a16c-d1a027c61d73 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:46.137823 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1307/2571] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:32:46.142254 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70d776-6b53-4634-a9b0-a8ca98a9dfda None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:46.152601 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70d776-6b53-4634-a9b0-a8ca98a9dfda None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:46.157605 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec395d-84e5-4089-bd39-174f84d057f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:46.158497 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec395d-84e5-4089-bd39-174f84d057f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:46.158857 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec395d-84e5-4089-bd39-174f84d057f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:46.159191 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec395d-84e5-4089-bd39-174f84d057f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:46.159890 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec395d-84e5-4089-bd39-174f84d057f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:46.161888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec395d-84e5-4089-bd39-174f84d057f0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:46.194676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1265/2572] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:32:46 2022] POST /identity/v3/projects => generated 401 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:32:46.199799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f225f-d8a8-45a4-a16c-d1a027c61d73 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:46.210092 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f225f-d8a8-45a4-a16c-d1a027c61d73 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:46.260854 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:46.278884 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91fa0c5-aeec-4036-8ded-2abf6109f987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:46.279502 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fa0c5-aeec-4036-8ded-2abf6109f987 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:46.279783 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fa0c5-aeec-4036-8ded-2abf6109f987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:46.280058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fa0c5-aeec-4036-8ded-2abf6109f987 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:46.280714 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91fa0c5-aeec-4036-8ded-2abf6109f987 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:46.283067 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91fa0c5-aeec-4036-8ded-2abf6109f987 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:46.306351 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1308/2573] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:32:46 2022] POST /identity/v3/users => generated 301 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:32:46.312220 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec395d-84e5-4089-bd39-174f84d057f0 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:46.323464 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec395d-84e5-4089-bd39-174f84d057f0 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:46.329032 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3f1b8-19df-4ee6-a9fd-5d61554f377b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:46.329919 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3f1b8-19df-4ee6-a9fd-5d61554f377b admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:46.330196 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3f1b8-19df-4ee6-a9fd-5d61554f377b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:46.330466 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3f1b8-19df-4ee6-a9fd-5d61554f377b admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:46.331113 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3f1b8-19df-4ee6-a9fd-5d61554f377b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:46.332708 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3f1b8-19df-4ee6-a9fd-5d61554f377b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:46.344055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1266/2574] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:32:46.348247 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91fa0c5-aeec-4036-8ded-2abf6109f987 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:46.358628 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91fa0c5-aeec-4036-8ded-2abf6109f987 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:46.363863 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd616be4-306e-4527-b411-6f3854830e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:46.364466 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd616be4-306e-4527-b411-6f3854830e6b admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:46.364747 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd616be4-306e-4527-b411-6f3854830e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:46.365020 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd616be4-306e-4527-b411-6f3854830e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:46.365710 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd616be4-306e-4527-b411-6f3854830e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:46.367305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd616be4-306e-4527-b411-6f3854830e6b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:46.378933 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1309/2575] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:32:46.383340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3f1b8-19df-4ee6-a9fd-5d61554f377b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:46.393551 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3f1b8-19df-4ee6-a9fd-5d61554f377b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:46.398789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda398e-4caa-4c8c-ac50-102e101bda5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:46.399484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda398e-4caa-4c8c-ac50-102e101bda5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:46.399767 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda398e-4caa-4c8c-ac50-102e101bda5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:46.400040 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda398e-4caa-4c8c-ac50-102e101bda5a admin admin] PATH_INFO: `/v3/projects/8a21c7ca50e14d7288134ad132cc23be/users/2d60a4e6b86147d08bfc89e4c825edb1/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:46.414808 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda398e-4caa-4c8c-ac50-102e101bda5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a21c7ca50e14d7288134ad132cc23be, user_id=2d60a4e6b86147d08bfc89e4c825edb1, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:46.417607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda398e-4caa-4c8c-ac50-102e101bda5a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:46.431380 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1267/2576] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:32:46 2022] PUT /identity/v3/projects/8a21c7ca50e14d7288134ad132cc23be/users/2d60a4e6b86147d08bfc89e4c825edb1/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:46.441810 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abd669-0b7c-4581-be73-c49bb0c63e2e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:46.442128 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abd669-0b7c-4581-be73-c49bb0c63e2e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:46.442401 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abd669-0b7c-4581-be73-c49bb0c63e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:46.470787 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c4abd669-0b7c-4581-be73-c49bb0c63e2e None None] MFA Rules not processed for user `2d60a4e6b86147d08bfc89e4c825edb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:46.472045 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c4abd669-0b7c-4581-be73-c49bb0c63e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:46.541325 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1310/2577] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:46 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:32:46.545930 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda398e-4caa-4c8c-ac50-102e101bda5a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:46.613209 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda398e-4caa-4c8c-ac50-102e101bda5a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:46.619471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a5f0a-07a1-43f9-ad80-07cada3fe831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:46.620077 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a5f0a-07a1-43f9-ad80-07cada3fe831 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:46.620356 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a5f0a-07a1-43f9-ad80-07cada3fe831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:46.620663 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a5f0a-07a1-43f9-ad80-07cada3fe831 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:46.621740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a5f0a-07a1-43f9-ad80-07cada3fe831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:46.624161 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a5f0a-07a1-43f9-ad80-07cada3fe831 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:46.640157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:46.657461 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1268/2578] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:32:46 2022] POST /identity/v3/projects => generated 401 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:32:46.659142 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abd669-0b7c-4581-be73-c49bb0c63e2e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:46.669999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abd669-0b7c-4581-be73-c49bb0c63e2e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:46.727175 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc455c7a-4297-436d-b52e-8845a1f4c994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:46.727783 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc455c7a-4297-436d-b52e-8845a1f4c994 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:46.728060 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc455c7a-4297-436d-b52e-8845a1f4c994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:46.728327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc455c7a-4297-436d-b52e-8845a1f4c994 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:46.728959 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc455c7a-4297-436d-b52e-8845a1f4c994 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:46.730917 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc455c7a-4297-436d-b52e-8845a1f4c994 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:46.756473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1311/2579] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:32:46 2022] POST /identity/v3/users => generated 307 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:32:46.760894 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a5f0a-07a1-43f9-ad80-07cada3fe831 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:46.772793 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a5f0a-07a1-43f9-ad80-07cada3fe831 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:46.778751 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04cc5b-f8d8-492e-8369-3f0b97ce02fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:46.779820 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04cc5b-f8d8-492e-8369-3f0b97ce02fc admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:46.780070 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04cc5b-f8d8-492e-8369-3f0b97ce02fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:46.780448 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04cc5b-f8d8-492e-8369-3f0b97ce02fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:46.781194 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04cc5b-f8d8-492e-8369-3f0b97ce02fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:46.783178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04cc5b-f8d8-492e-8369-3f0b97ce02fc admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:46.797893 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1269/2580] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:32:46.802044 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc455c7a-4297-436d-b52e-8845a1f4c994 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:46.814847 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc455c7a-4297-436d-b52e-8845a1f4c994 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:46.827234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20940304-7d6b-42e6-a141-23bfc6028bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:46.827909 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20940304-7d6b-42e6-a141-23bfc6028bef admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:46.828184 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20940304-7d6b-42e6-a141-23bfc6028bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:46.828454 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20940304-7d6b-42e6-a141-23bfc6028bef admin admin] PATH_INFO: `/v3/projects/05bd1ef51bff43c796bde7c65bd6d23d/users/ac6dd534ed3a4fbd8cebfe8609f0d6fe/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:46.850121 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20940304-7d6b-42e6-a141-23bfc6028bef admin admin] RBAC: Authorizing `identity:create_grant(project_id=05bd1ef51bff43c796bde7c65bd6d23d, user_id=ac6dd534ed3a4fbd8cebfe8609f0d6fe, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:46.852846 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20940304-7d6b-42e6-a141-23bfc6028bef admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:46.870842 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1312/2581] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:32:46 2022] PUT /identity/v3/projects/05bd1ef51bff43c796bde7c65bd6d23d/users/ac6dd534ed3a4fbd8cebfe8609f0d6fe/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:46.880395 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04cc5b-f8d8-492e-8369-3f0b97ce02fc admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:46.894522 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04cc5b-f8d8-492e-8369-3f0b97ce02fc admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:46.973571 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bbdde2-b701-426e-bc79-eced9ed25960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:46.974183 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbdde2-b701-426e-bc79-eced9ed25960 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:46.974454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbdde2-b701-426e-bc79-eced9ed25960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:46.974720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbdde2-b701-426e-bc79-eced9ed25960 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:46.975353 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bbdde2-b701-426e-bc79-eced9ed25960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:46.977103 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bbdde2-b701-426e-bc79-eced9ed25960 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:46.990187 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1270/2582] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:32:46.994694 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20940304-7d6b-42e6-a141-23bfc6028bef admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:47.006710 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20940304-7d6b-42e6-a141-23bfc6028bef admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:47.012393 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8310e-1ead-4bf2-b822-7dc8c2112bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:47.013338 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8310e-1ead-4bf2-b822-7dc8c2112bef admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:47.013917 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8310e-1ead-4bf2-b822-7dc8c2112bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:47.014458 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8310e-1ead-4bf2-b822-7dc8c2112bef admin admin] PATH_INFO: `/v3/projects/05bd1ef51bff43c796bde7c65bd6d23d/users/ac6dd534ed3a4fbd8cebfe8609f0d6fe/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:47.016877 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a8310e-1ead-4bf2-b822-7dc8c2112bef admin admin] RBAC: Authorizing `identity:create_grant(project_id=05bd1ef51bff43c796bde7c65bd6d23d, user_id=ac6dd534ed3a4fbd8cebfe8609f0d6fe, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:47.019934 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a8310e-1ead-4bf2-b822-7dc8c2112bef admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:47.031565 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1313/2583] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:32:46 2022] PUT /identity/v3/projects/05bd1ef51bff43c796bde7c65bd6d23d/users/ac6dd534ed3a4fbd8cebfe8609f0d6fe/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:47.043367 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540f45b-e56d-4ac5-bf97-0eecd37ebf6c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:47.043758 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540f45b-e56d-4ac5-bf97-0eecd37ebf6c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:47.044132 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540f45b-e56d-4ac5-bf97-0eecd37ebf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:47.078466 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6540f45b-e56d-4ac5-bf97-0eecd37ebf6c None None] MFA Rules not processed for user `ac6dd534ed3a4fbd8cebfe8609f0d6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:47.079812 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6540f45b-e56d-4ac5-bf97-0eecd37ebf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:47.154377 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1271/2584] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:47 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:32:47.170527 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8310e-1ead-4bf2-b822-7dc8c2112bef admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:47.173141 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b1a8310e-1ead-4bf2-b822-7dc8c2112bef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:47.185598 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:47.246471 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8310e-1ead-4bf2-b822-7dc8c2112bef admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:47.250283 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eec956-9a57-4ce7-a25c-055b6fee5bf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:47.251054 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eec956-9a57-4ce7-a25c-055b6fee5bf8 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:47.251570 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eec956-9a57-4ce7-a25c-055b6fee5bf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:47.251742 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eec956-9a57-4ce7-a25c-055b6fee5bf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:47.261641 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eec956-9a57-4ce7-a25c-055b6fee5bf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:47.263133 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eec956-9a57-4ce7-a25c-055b6fee5bf8 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:47.272775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1314/2585] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:32:47 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:32:47.346197 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540f45b-e56d-4ac5-bf97-0eecd37ebf6c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:47.356637 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540f45b-e56d-4ac5-bf97-0eecd37ebf6c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:47.360277 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69e8f9-7f12-4021-a8b1-6081fc1a6444 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:47.360891 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69e8f9-7f12-4021-a8b1-6081fc1a6444 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:47.361171 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69e8f9-7f12-4021-a8b1-6081fc1a6444 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:47.361497 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69e8f9-7f12-4021-a8b1-6081fc1a6444 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:47.417668 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69e8f9-7f12-4021-a8b1-6081fc1a6444 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:47.419028 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69e8f9-7f12-4021-a8b1-6081fc1a6444 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:47.428909 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1272/2586] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:32:47 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:32:49.009379 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a9dfd-8254-4b2c-9ede-1756617b9b4e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:49.010356 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a9dfd-8254-4b2c-9ede-1756617b9b4e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:49.010845 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a9dfd-8254-4b2c-9ede-1756617b9b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:49.047213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-630a9dfd-8254-4b2c-9ede-1756617b9b4e None None] MFA Rules not processed for user `9e7444bc40314e73b282217bbb94798d`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:49.049138 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-630a9dfd-8254-4b2c-9ede-1756617b9b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:49.151411 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1315/2587] 10.222.0.94 () {58 vars in 1009 bytes} [Thu Sep 1 17:32:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:32:49.165666 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69e8f9-7f12-4021-a8b1-6081fc1a6444 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:49.167905 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-df69e8f9-7f12-4021-a8b1-6081fc1a6444 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:49.176691 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:49.298997 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69e8f9-7f12-4021-a8b1-6081fc1a6444 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:49.311089 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2e84d-aef8-4228-be7c-58b9205a2e94 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7ebf43f36c4862a3c527941e033666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:49.311716 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2e84d-aef8-4228-be7c-58b9205a2e94 service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:49.311994 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2e84d-aef8-4228-be7c-58b9205a2e94 service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:49.312265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2e84d-aef8-4228-be7c-58b9205a2e94 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:49.326965 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2e84d-aef8-4228-be7c-58b9205a2e94 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:49.329446 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2e84d-aef8-4228-be7c-58b9205a2e94 service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:49.352088 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1273/2588] 10.222.0.94 () {60 vars in 1384 bytes} [Thu Sep 1 17:32:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 17:32:50.263542 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a9dfd-8254-4b2c-9ede-1756617b9b4e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:50.266372 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-630a9dfd-8254-4b2c-9ede-1756617b9b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:50.404427 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a9dfd-8254-4b2c-9ede-1756617b9b4e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:50.439539 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b74b4-17af-4e28-b892-a272f868a6b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:50.440639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b74b4-17af-4e28-b892-a272f868a6b9 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:50.447472 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b74b4-17af-4e28-b892-a272f868a6b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:50.447846 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b74b4-17af-4e28-b892-a272f868a6b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:50.450159 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3d6b74b4-17af-4e28-b892-a272f868a6b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:50.481030 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b74b4-17af-4e28-b892-a272f868a6b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:50.482781 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b74b4-17af-4e28-b892-a272f868a6b9 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:50.502985 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1316/2589] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:32:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:32:51.951176 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2e84d-aef8-4228-be7c-58b9205a2e94 service swift] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:52.061486 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2e84d-aef8-4228-be7c-58b9205a2e94 service swift] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:52.067437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dcfd1-2669-4cd6-bbed-d7883edd34e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:52.068580 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dcfd1-2669-4cd6-bbed-d7883edd34e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:52.068845 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dcfd1-2669-4cd6-bbed-d7883edd34e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:52.069055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dcfd1-2669-4cd6-bbed-d7883edd34e1 admin admin] PATH_INFO: `/v3/users/2d60a4e6b86147d08bfc89e4c825edb1` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:52.070547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5dcfd1-2669-4cd6-bbed-d7883edd34e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d60a4e6b86147d08bfc89e4c825edb1)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:52.073028 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5dcfd1-2669-4cd6-bbed-d7883edd34e1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:52.166323 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9a5dcfd1-2669-4cd6-bbed-d7883edd34e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d60a4e6b86147d08bfc89e4c825edb1'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:52.167075 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9a5dcfd1-2669-4cd6-bbed-d7883edd34e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d60a4e6b86147d08bfc89e4c825edb1'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:52.176437 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9a5dcfd1-2669-4cd6-bbed-d7883edd34e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d60a4e6b86147d08bfc89e4c825edb1'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:52.177356 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9a5dcfd1-2669-4cd6-bbed-d7883edd34e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d60a4e6b86147d08bfc89e4c825edb1'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:52.186921 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9a5dcfd1-2669-4cd6-bbed-d7883edd34e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d60a4e6b86147d08bfc89e4c825edb1'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:52.209191 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1274/2590] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:32:51 2022] DELETE /identity/v3/users/2d60a4e6b86147d08bfc89e4c825edb1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:52.215390 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b37f3-01c8-49a2-b157-383c63e5ff03 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:52.216421 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b37f3-01c8-49a2-b157-383c63e5ff03 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:52.216736 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b37f3-01c8-49a2-b157-383c63e5ff03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:52.239647 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-409b37f3-01c8-49a2-b157-383c63e5ff03 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:52.240966 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-409b37f3-01c8-49a2-b157-383c63e5ff03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:52.285895 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:52.318361 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1317/2591] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:32:52.329229 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dcfd1-2669-4cd6-bbed-d7883edd34e1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:52.331268 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9a5dcfd1-2669-4cd6-bbed-d7883edd34e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:52.350393 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:52.411419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dcfd1-2669-4cd6-bbed-d7883edd34e1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:52.415764 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb19bc-08fe-4806-b163-47cb2688217a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:52.416408 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb19bc-08fe-4806-b163-47cb2688217a service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:52.416687 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb19bc-08fe-4806-b163-47cb2688217a service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:52.416928 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb19bc-08fe-4806-b163-47cb2688217a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:52.427175 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb19bc-08fe-4806-b163-47cb2688217a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:52.428929 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb19bc-08fe-4806-b163-47cb2688217a service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:52.440537 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1275/2592] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:32:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:32:52.800701 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b37f3-01c8-49a2-b157-383c63e5ff03 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:52.802240 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-409b37f3-01c8-49a2-b157-383c63e5ff03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:52.824447 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b37f3-01c8-49a2-b157-383c63e5ff03 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:52.830193 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f6016-beea-41c5-aabe-f40196fb3283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:52.830935 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f6016-beea-41c5-aabe-f40196fb3283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:52.831217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f6016-beea-41c5-aabe-f40196fb3283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:52.831490 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f6016-beea-41c5-aabe-f40196fb3283 admin admin] PATH_INFO: `/v3/projects/8a21c7ca50e14d7288134ad132cc23be` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:52.832639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f6016-beea-41c5-aabe-f40196fb3283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a21c7ca50e14d7288134ad132cc23be)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:52.834774 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f6016-beea-41c5-aabe-f40196fb3283 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:52.897111 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a30f6016-beea-41c5-aabe-f40196fb3283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a21c7ca50e14d7288134ad132cc23be', 'request_id': 'req-a30f6016-beea-41c5-aabe-f40196fb3283'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:52.904738 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a30f6016-beea-41c5-aabe-f40196fb3283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a21c7ca50e14d7288134ad132cc23be', 'request_id': 'req-a30f6016-beea-41c5-aabe-f40196fb3283'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:52.912052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a30f6016-beea-41c5-aabe-f40196fb3283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a21c7ca50e14d7288134ad132cc23be', 'request_id': 'req-a30f6016-beea-41c5-aabe-f40196fb3283'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:52.926066 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a30f6016-beea-41c5-aabe-f40196fb3283 admin admin] The token cache is being invalidate because project 8a21c7ca50e14d7288134ad132cc23be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:32:52.926361 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a30f6016-beea-41c5-aabe-f40196fb3283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:52.926995 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a30f6016-beea-41c5-aabe-f40196fb3283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:52.929448 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1318/2593] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:32:52 2022] DELETE /identity/v3/projects/8a21c7ca50e14d7288134ad132cc23be => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:52.934405 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb19bc-08fe-4806-b163-47cb2688217a service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:52.945817 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb19bc-08fe-4806-b163-47cb2688217a service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:53.017324 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df646918-b481-4f10-8d91-1a2b8870210d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:53.018216 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df646918-b481-4f10-8d91-1a2b8870210d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:53.018614 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df646918-b481-4f10-8d91-1a2b8870210d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:53.019330 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df646918-b481-4f10-8d91-1a2b8870210d admin admin] PATH_INFO: `/v3/users/ac6dd534ed3a4fbd8cebfe8609f0d6fe` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:53.020762 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df646918-b481-4f10-8d91-1a2b8870210d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac6dd534ed3a4fbd8cebfe8609f0d6fe)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:53.023006 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df646918-b481-4f10-8d91-1a2b8870210d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:53.087039 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-df646918-b481-4f10-8d91-1a2b8870210d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac6dd534ed3a4fbd8cebfe8609f0d6fe'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:53.087820 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-df646918-b481-4f10-8d91-1a2b8870210d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac6dd534ed3a4fbd8cebfe8609f0d6fe'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:53.098419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-df646918-b481-4f10-8d91-1a2b8870210d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac6dd534ed3a4fbd8cebfe8609f0d6fe'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:53.099226 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-df646918-b481-4f10-8d91-1a2b8870210d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac6dd534ed3a4fbd8cebfe8609f0d6fe'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:53.117883 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-df646918-b481-4f10-8d91-1a2b8870210d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac6dd534ed3a4fbd8cebfe8609f0d6fe'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:53.151789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1276/2594] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:32:52 2022] DELETE /identity/v3/users/ac6dd534ed3a4fbd8cebfe8609f0d6fe => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:53.225578 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f6016-beea-41c5-aabe-f40196fb3283 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:53.227855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a30f6016-beea-41c5-aabe-f40196fb3283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:53.255019 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f6016-beea-41c5-aabe-f40196fb3283 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:53.415321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f096a-bd73-4849-83be-d6bd80498399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:53.415986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f096a-bd73-4849-83be-d6bd80498399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:53.416270 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f096a-bd73-4849-83be-d6bd80498399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:53.416541 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f096a-bd73-4849-83be-d6bd80498399 admin admin] PATH_INFO: `/v3/users/777c2c335ee146c6bcc29ceb3d103b31` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:53.419113 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f096a-bd73-4849-83be-d6bd80498399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=777c2c335ee146c6bcc29ceb3d103b31)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:53.421212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f096a-bd73-4849-83be-d6bd80498399 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:53.549632 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-966f096a-bd73-4849-83be-d6bd80498399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '777c2c335ee146c6bcc29ceb3d103b31'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:53.550983 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-966f096a-bd73-4849-83be-d6bd80498399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '777c2c335ee146c6bcc29ceb3d103b31'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:53.579204 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-966f096a-bd73-4849-83be-d6bd80498399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '777c2c335ee146c6bcc29ceb3d103b31'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:53.580652 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:53.593058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-966f096a-bd73-4849-83be-d6bd80498399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '777c2c335ee146c6bcc29ceb3d103b31'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:53.620027 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-966f096a-bd73-4849-83be-d6bd80498399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '777c2c335ee146c6bcc29ceb3d103b31'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:53.623791 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df646918-b481-4f10-8d91-1a2b8870210d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:53.625728 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-df646918-b481-4f10-8d91-1a2b8870210d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:53.627686 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1319/2595] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:32:53 2022] DELETE /identity/v3/users/777c2c335ee146c6bcc29ceb3d103b31 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:53.632717 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ce63d-14ba-4c08-91aa-e33b03a1af0d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:53.634357 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ce63d-14ba-4c08-91aa-e33b03a1af0d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:53.635409 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ce63d-14ba-4c08-91aa-e33b03a1af0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:53.665947 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e83ce63d-14ba-4c08-91aa-e33b03a1af0d None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:53.669758 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e83ce63d-14ba-4c08-91aa-e33b03a1af0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:53.694361 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:53.764674 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df646918-b481-4f10-8d91-1a2b8870210d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:53.778122 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1320/2596] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:32:53.779114 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ce63d-14ba-4c08-91aa-e33b03a1af0d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:53.780593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e83ce63d-14ba-4c08-91aa-e33b03a1af0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:53.806205 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ce63d-14ba-4c08-91aa-e33b03a1af0d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:53.812687 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524f6c1-0369-49ac-a631-f63f8a11202b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:53.814067 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524f6c1-0369-49ac-a631-f63f8a11202b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:53.814473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524f6c1-0369-49ac-a631-f63f8a11202b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:53.814852 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524f6c1-0369-49ac-a631-f63f8a11202b admin admin] PATH_INFO: `/v3/projects/05bd1ef51bff43c796bde7c65bd6d23d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:53.816837 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524f6c1-0369-49ac-a631-f63f8a11202b admin admin] RBAC: Authorizing `identity:delete_project(project_id=05bd1ef51bff43c796bde7c65bd6d23d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:53.818919 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524f6c1-0369-49ac-a631-f63f8a11202b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:53.830232 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f073de-83dd-49ae-92f7-fa63eaf66e76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:53.830859 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f073de-83dd-49ae-92f7-fa63eaf66e76 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:53.831288 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f073de-83dd-49ae-92f7-fa63eaf66e76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:53.831568 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f073de-83dd-49ae-92f7-fa63eaf66e76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:53.834034 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-43f073de-83dd-49ae-92f7-fa63eaf66e76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:53.880191 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c524f6c1-0369-49ac-a631-f63f8a11202b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05bd1ef51bff43c796bde7c65bd6d23d', 'request_id': 'req-c524f6c1-0369-49ac-a631-f63f8a11202b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:53.888209 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c524f6c1-0369-49ac-a631-f63f8a11202b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05bd1ef51bff43c796bde7c65bd6d23d', 'request_id': 'req-c524f6c1-0369-49ac-a631-f63f8a11202b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:53.896327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c524f6c1-0369-49ac-a631-f63f8a11202b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05bd1ef51bff43c796bde7c65bd6d23d', 'request_id': 'req-c524f6c1-0369-49ac-a631-f63f8a11202b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:53.919914 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c524f6c1-0369-49ac-a631-f63f8a11202b admin admin] The token cache is being invalidate because project 05bd1ef51bff43c796bde7c65bd6d23d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:32:53.920311 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c524f6c1-0369-49ac-a631-f63f8a11202b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:53.920887 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c524f6c1-0369-49ac-a631-f63f8a11202b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:53.922577 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1321/2597] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:32:53 2022] DELETE /identity/v3/projects/05bd1ef51bff43c796bde7c65bd6d23d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:53.925578 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524f6c1-0369-49ac-a631-f63f8a11202b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:53.925578 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c524f6c1-0369-49ac-a631-f63f8a11202b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:53.928066 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f073de-83dd-49ae-92f7-fa63eaf66e76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:53.930444 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f073de-83dd-49ae-92f7-fa63eaf66e76 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:53.947472 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1277/2598] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:32:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:32:53.948827 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28f6d7-15d4-4f0c-b34a-c21ea7facd82 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:53.949171 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28f6d7-15d4-4f0c-b34a-c21ea7facd82 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:53.949585 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28f6d7-15d4-4f0c-b34a-c21ea7facd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:53.973603 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2f28f6d7-15d4-4f0c-b34a-c21ea7facd82 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:53.974980 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2f28f6d7-15d4-4f0c-b34a-c21ea7facd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:54.033725 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524f6c1-0369-49ac-a631-f63f8a11202b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:54.038854 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc877d-aa6d-4332-b2c4-bee11a893e2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:54.039548 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc877d-aa6d-4332-b2c4-bee11a893e2f service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:54.039939 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc877d-aa6d-4332-b2c4-bee11a893e2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:54.040307 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc877d-aa6d-4332-b2c4-bee11a893e2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:54.042364 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-36fc877d-aa6d-4332-b2c4-bee11a893e2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:54.068707 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:54.095646 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1278/2599] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:32:54.097270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a71d21-0a4a-4db5-8d7c-ad8093379a17 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:54.097786 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a71d21-0a4a-4db5-8d7c-ad8093379a17 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:54.098000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a71d21-0a4a-4db5-8d7c-ad8093379a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:54.149588 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a6a71d21-0a4a-4db5-8d7c-ad8093379a17 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:54.152279 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a6a71d21-0a4a-4db5-8d7c-ad8093379a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:54.154218 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc877d-aa6d-4332-b2c4-bee11a893e2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:54.155787 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc877d-aa6d-4332-b2c4-bee11a893e2f service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:54.168779 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1322/2600] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:32:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:32:54.180765 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1279/2601] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:32:54.185687 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc877d-aa6d-4332-b2c4-bee11a893e2f service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:54.199178 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc877d-aa6d-4332-b2c4-bee11a893e2f service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:54.211876 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec7ef7-979e-44d3-af14-fa3ef1bece32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:54.213575 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec7ef7-979e-44d3-af14-fa3ef1bece32 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:54.214476 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec7ef7-979e-44d3-af14-fa3ef1bece32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:54.214899 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec7ef7-979e-44d3-af14-fa3ef1bece32 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:54.215702 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec7ef7-979e-44d3-af14-fa3ef1bece32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:32:54.217545 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec7ef7-979e-44d3-af14-fa3ef1bece32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:54.220903 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec7ef7-979e-44d3-af14-fa3ef1bece32 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:54.241059 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1323/2602] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:32:54.246337 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a71d21-0a4a-4db5-8d7c-ad8093379a17 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:54.257642 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a71d21-0a4a-4db5-8d7c-ad8093379a17 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:54.271343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e43a4-3f93-4953-a20b-33d3cec21b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:54.272059 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e43a4-3f93-4953-a20b-33d3cec21b45 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:54.273514 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e43a4-3f93-4953-a20b-33d3cec21b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:54.273514 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e43a4-3f93-4953-a20b-33d3cec21b45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:54.276690 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e43a4-3f93-4953-a20b-33d3cec21b45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:54.278758 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e43a4-3f93-4953-a20b-33d3cec21b45 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:54.363370 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec7ef7-979e-44d3-af14-fa3ef1bece32 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:54.364194 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1280/2603] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:32:54 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:32:54.382089 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec7ef7-979e-44d3-af14-fa3ef1bece32 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:54.458738 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ddaa1-4dcf-41ca-8ff0-6f1046ae0b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:54.459350 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ddaa1-4dcf-41ca-8ff0-6f1046ae0b08 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:54.459860 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ddaa1-4dcf-41ca-8ff0-6f1046ae0b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:54.460164 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ddaa1-4dcf-41ca-8ff0-6f1046ae0b08 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:54.460879 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ddaa1-4dcf-41ca-8ff0-6f1046ae0b08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:54.465650 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ddaa1-4dcf-41ca-8ff0-6f1046ae0b08 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:54.492702 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1324/2604] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:32:54 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:32:54.497935 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e43a4-3f93-4953-a20b-33d3cec21b45 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:54.512695 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e43a4-3f93-4953-a20b-33d3cec21b45 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:54.518065 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff730c5-2b1c-4a40-932d-eeee6f52d6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:54.518687 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff730c5-2b1c-4a40-932d-eeee6f52d6dc admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:54.518957 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff730c5-2b1c-4a40-932d-eeee6f52d6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:54.519221 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff730c5-2b1c-4a40-932d-eeee6f52d6dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:54.520065 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff730c5-2b1c-4a40-932d-eeee6f52d6dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:54.521886 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff730c5-2b1c-4a40-932d-eeee6f52d6dc admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:54.547887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1281/2605] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:32:54.552004 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ddaa1-4dcf-41ca-8ff0-6f1046ae0b08 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:54.564235 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ddaa1-4dcf-41ca-8ff0-6f1046ae0b08 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:54.570527 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1be94-5da0-4d25-988c-4fb538ab765f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:54.571149 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1be94-5da0-4d25-988c-4fb538ab765f admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:54.571430 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1be94-5da0-4d25-988c-4fb538ab765f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:54.571704 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1be94-5da0-4d25-988c-4fb538ab765f admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:54.572356 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1be94-5da0-4d25-988c-4fb538ab765f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:54.574356 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1be94-5da0-4d25-988c-4fb538ab765f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:54.592344 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1325/2606] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:32:54.593240 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff730c5-2b1c-4a40-932d-eeee6f52d6dc admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:54.599073 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:54.607135 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff730c5-2b1c-4a40-932d-eeee6f52d6dc admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:54.632966 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac084069-8eba-4c1d-a6e0-221968d165e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:54.633677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac084069-8eba-4c1d-a6e0-221968d165e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:54.633986 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac084069-8eba-4c1d-a6e0-221968d165e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:54.634241 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac084069-8eba-4c1d-a6e0-221968d165e5 admin admin] PATH_INFO: `/v3/projects/bba455c260cd48e488d68245332a75d4/users/a6105c4d7d4342c9963e37c64009b74f/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:54.678720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac084069-8eba-4c1d-a6e0-221968d165e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba455c260cd48e488d68245332a75d4, user_id=a6105c4d7d4342c9963e37c64009b74f, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:54.682046 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac084069-8eba-4c1d-a6e0-221968d165e5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:54.707779 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1282/2607] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:32:54 2022] PUT /identity/v3/projects/bba455c260cd48e488d68245332a75d4/users/a6105c4d7d4342c9963e37c64009b74f/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:54.718977 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7586c-f4e4-47fb-b262-1dae5592b6fb None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:54.719289 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7586c-f4e4-47fb-b262-1dae5592b6fb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:54.719760 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7586c-f4e4-47fb-b262-1dae5592b6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:54.764721 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-feb7586c-f4e4-47fb-b262-1dae5592b6fb None None] MFA Rules not processed for user `a6105c4d7d4342c9963e37c64009b74f`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:54.766256 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-feb7586c-f4e4-47fb-b262-1dae5592b6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:54.921647 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac084069-8eba-4c1d-a6e0-221968d165e5 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:54.927022 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1326/2608] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:32:54.976556 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7586c-f4e4-47fb-b262-1dae5592b6fb None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:54.978032 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-feb7586c-f4e4-47fb-b262-1dae5592b6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:55.011452 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:55.066413 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac084069-8eba-4c1d-a6e0-221968d165e5 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:55.080386 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a57b7a-3c64-4584-989a-2faf4fa36b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:55.081013 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a57b7a-3c64-4584-989a-2faf4fa36b76 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:55.081293 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a57b7a-3c64-4584-989a-2faf4fa36b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:55.081958 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a57b7a-3c64-4584-989a-2faf4fa36b76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:55.082305 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a57b7a-3c64-4584-989a-2faf4fa36b76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:55.086349 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a57b7a-3c64-4584-989a-2faf4fa36b76 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:55.126889 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7586c-f4e4-47fb-b262-1dae5592b6fb None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:55.131595 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f2108-aaf0-4bbb-a8ee-20478b50e2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:55.132340 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f2108-aaf0-4bbb-a8ee-20478b50e2ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:55.132614 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f2108-aaf0-4bbb-a8ee-20478b50e2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:55.132883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f2108-aaf0-4bbb-a8ee-20478b50e2ab admin admin] PATH_INFO: `/v3/projects/45a1b4771ad7406b9cc31c699bac9796` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:55.134064 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f2108-aaf0-4bbb-a8ee-20478b50e2ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=45a1b4771ad7406b9cc31c699bac9796)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:55.136554 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1283/2609] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:32:54 2022] POST /identity/v3/projects => generated 385 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:32:55.139298 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f2108-aaf0-4bbb-a8ee-20478b50e2ab admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:55.140516 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a57b7a-3c64-4584-989a-2faf4fa36b76 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:55.225460 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a57b7a-3c64-4584-989a-2faf4fa36b76 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:55.237598 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-999f2108-aaf0-4bbb-a8ee-20478b50e2ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45a1b4771ad7406b9cc31c699bac9796', 'request_id': 'req-999f2108-aaf0-4bbb-a8ee-20478b50e2ab'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:55.247997 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-999f2108-aaf0-4bbb-a8ee-20478b50e2ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45a1b4771ad7406b9cc31c699bac9796', 'request_id': 'req-999f2108-aaf0-4bbb-a8ee-20478b50e2ab'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:55.259113 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-999f2108-aaf0-4bbb-a8ee-20478b50e2ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45a1b4771ad7406b9cc31c699bac9796', 'request_id': 'req-999f2108-aaf0-4bbb-a8ee-20478b50e2ab'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:55.276934 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-999f2108-aaf0-4bbb-a8ee-20478b50e2ab admin admin] The token cache is being invalidate because project 45a1b4771ad7406b9cc31c699bac9796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:32:55.277280 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-999f2108-aaf0-4bbb-a8ee-20478b50e2ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:55.278023 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-999f2108-aaf0-4bbb-a8ee-20478b50e2ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:55.280139 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1327/2610] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:32:54 2022] DELETE /identity/v3/projects/45a1b4771ad7406b9cc31c699bac9796 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:32:55.284882 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d7c59-b731-4da2-bfcd-fc4d89464217 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:55.285314 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d7c59-b731-4da2-bfcd-fc4d89464217 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:55.285819 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d7c59-b731-4da2-bfcd-fc4d89464217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:55.308346 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-406d7c59-b731-4da2-bfcd-fc4d89464217 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:55.309988 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-406d7c59-b731-4da2-bfcd-fc4d89464217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:55.341343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fac47d-a91e-447b-933e-c39521b3e5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:55.342145 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fac47d-a91e-447b-933e-c39521b3e5ef admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:55.342660 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fac47d-a91e-447b-933e-c39521b3e5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:55.343107 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fac47d-a91e-447b-933e-c39521b3e5ef admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:55.343920 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fac47d-a91e-447b-933e-c39521b3e5ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:55.346663 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fac47d-a91e-447b-933e-c39521b3e5ef admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:55.376101 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:55.389490 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1284/2611] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:32:55 2022] POST /identity/v3/users => generated 299 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:32:55.390376 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fac47d-a91e-447b-933e-c39521b3e5ef admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:55.392710 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b2fac47d-a91e-447b-933e-c39521b3e5ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:55.411692 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fac47d-a91e-447b-933e-c39521b3e5ef admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:55.420108 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5721f88-cd6f-4382-a0c8-7c94bcc2b419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:55.420724 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5721f88-cd6f-4382-a0c8-7c94bcc2b419 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:55.421001 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5721f88-cd6f-4382-a0c8-7c94bcc2b419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:55.421375 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5721f88-cd6f-4382-a0c8-7c94bcc2b419 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:55.421860 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1328/2612] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:32:55.422092 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5721f88-cd6f-4382-a0c8-7c94bcc2b419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:55.423750 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5721f88-cd6f-4382-a0c8-7c94bcc2b419 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:55.429890 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f9ccf-891f-4ca1-9ad0-cda70a51fed6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:55.430845 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f9ccf-891f-4ca1-9ad0-cda70a51fed6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:55.433950 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f9ccf-891f-4ca1-9ad0-cda70a51fed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:55.442163 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1285/2613] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:32:55.443101 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5721f88-cd6f-4382-a0c8-7c94bcc2b419 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:55.457632 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5721f88-cd6f-4382-a0c8-7c94bcc2b419 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:55.465129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064bd95-ef30-4595-a968-a234cb96835c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:55.465129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064bd95-ef30-4595-a968-a234cb96835c admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:55.465129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064bd95-ef30-4595-a968-a234cb96835c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:55.465548 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064bd95-ef30-4595-a968-a234cb96835c admin admin] PATH_INFO: `/v3/projects/eea6e943a8924efe9104f4a33c963fe3/users/bb881bd4a10948db9670ae26bf659e76/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:55.482430 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-9e3f9ccf-891f-4ca1-9ad0-cda70a51fed6 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:55.483618 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9e3f9ccf-891f-4ca1-9ad0-cda70a51fed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:55.486230 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f064bd95-ef30-4595-a968-a234cb96835c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea6e943a8924efe9104f4a33c963fe3, user_id=bb881bd4a10948db9670ae26bf659e76, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:55.489383 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f064bd95-ef30-4595-a968-a234cb96835c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:55.504747 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1329/2614] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:32:55.506024 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f9ccf-891f-4ca1-9ad0-cda70a51fed6 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:55.511234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1286/2615] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:32:55 2022] PUT /identity/v3/projects/eea6e943a8924efe9104f4a33c963fe3/users/bb881bd4a10948db9670ae26bf659e76/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:55.518567 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f9ccf-891f-4ca1-9ad0-cda70a51fed6 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:55.521557 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064bd95-ef30-4595-a968-a234cb96835c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:55.592195 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:55.643779 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f17da-e367-4b9b-a7bc-30fe1bdc6250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:55.645795 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064bd95-ef30-4595-a968-a234cb96835c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:55.646046 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f17da-e367-4b9b-a7bc-30fe1bdc6250 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:55.646459 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f17da-e367-4b9b-a7bc-30fe1bdc6250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:55.646865 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f17da-e367-4b9b-a7bc-30fe1bdc6250 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:55.648349 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f17da-e367-4b9b-a7bc-30fe1bdc6250 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:32:55.648900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f17da-e367-4b9b-a7bc-30fe1bdc6250 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:55.650766 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f17da-e367-4b9b-a7bc-30fe1bdc6250 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:55.659707 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49570997-1fa1-48a8-b577-1cf78cdf7096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:55.660987 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49570997-1fa1-48a8-b577-1cf78cdf7096 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:55.661567 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49570997-1fa1-48a8-b577-1cf78cdf7096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:55.662039 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49570997-1fa1-48a8-b577-1cf78cdf7096 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:55.662858 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49570997-1fa1-48a8-b577-1cf78cdf7096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:55.664887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49570997-1fa1-48a8-b577-1cf78cdf7096 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:55.670127 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1330/2616] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:32:55.674900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f17da-e367-4b9b-a7bc-30fe1bdc6250 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:55.682947 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1287/2617] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:32:55.685807 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49570997-1fa1-48a8-b577-1cf78cdf7096 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:55.689446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f17da-e367-4b9b-a7bc-30fe1bdc6250 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:55.695871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82f7dc-0d1a-451b-ac04-1c2212062fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:55.697425 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82f7dc-0d1a-451b-ac04-1c2212062fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:55.697819 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82f7dc-0d1a-451b-ac04-1c2212062fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:55.698607 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82f7dc-0d1a-451b-ac04-1c2212062fa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:55.699535 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82f7dc-0d1a-451b-ac04-1c2212062fa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:55.700911 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49570997-1fa1-48a8-b577-1cf78cdf7096 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:55.702155 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82f7dc-0d1a-451b-ac04-1c2212062fa8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:55.705885 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7465002-6f3c-4844-91a0-2bcb6f2a303e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:55.706626 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7465002-6f3c-4844-91a0-2bcb6f2a303e admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:55.707062 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7465002-6f3c-4844-91a0-2bcb6f2a303e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:55.707343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7465002-6f3c-4844-91a0-2bcb6f2a303e admin admin] PATH_INFO: `/v3/projects/eea6e943a8924efe9104f4a33c963fe3/users/bb881bd4a10948db9670ae26bf659e76/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:55.709573 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7465002-6f3c-4844-91a0-2bcb6f2a303e admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea6e943a8924efe9104f4a33c963fe3, user_id=bb881bd4a10948db9670ae26bf659e76, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:55.712840 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7465002-6f3c-4844-91a0-2bcb6f2a303e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:55.732387 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1288/2618] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:32:55 2022] PUT /identity/v3/projects/eea6e943a8924efe9104f4a33c963fe3/users/bb881bd4a10948db9670ae26bf659e76/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:55.746759 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48c59e-b436-454b-a6f6-52dde5e4562f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:55.747036 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48c59e-b436-454b-a6f6-52dde5e4562f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:55.747697 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48c59e-b436-454b-a6f6-52dde5e4562f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:55.754454 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1331/2619] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:32:55 2022] POST /identity/v3/projects => generated 377 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:32:55.758909 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82f7dc-0d1a-451b-ac04-1c2212062fa8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:55.784491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7e48c59e-b436-454b-a6f6-52dde5e4562f None None] MFA Rules not processed for user `bb881bd4a10948db9670ae26bf659e76`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:55.786492 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7e48c59e-b436-454b-a6f6-52dde5e4562f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:55.835048 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82f7dc-0d1a-451b-ac04-1c2212062fa8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:55.842494 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d171492-9592-4f9a-81a4-faa448929c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:55.842866 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d171492-9592-4f9a-81a4-faa448929c03 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:55.843277 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d171492-9592-4f9a-81a4-faa448929c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:55.843551 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d171492-9592-4f9a-81a4-faa448929c03 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:55.844380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d171492-9592-4f9a-81a4-faa448929c03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:55.846540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d171492-9592-4f9a-81a4-faa448929c03 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:55.878514 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1332/2620] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:32:55 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:32:55.879361 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1289/2621] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:55 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:32:55.883450 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48c59e-b436-454b-a6f6-52dde5e4562f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:55.890082 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d171492-9592-4f9a-81a4-faa448929c03 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:55.892234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8d171492-9592-4f9a-81a4-faa448929c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:55.909626 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48c59e-b436-454b-a6f6-52dde5e4562f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:55.916947 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fab5b-4aa0-409f-9fec-7cd42220dc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:55.917872 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fab5b-4aa0-409f-9fec-7cd42220dc95 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:55.918154 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fab5b-4aa0-409f-9fec-7cd42220dc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:55.918423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fab5b-4aa0-409f-9fec-7cd42220dc95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:55.919131 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1fab5b-4aa0-409f-9fec-7cd42220dc95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:55.922669 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1fab5b-4aa0-409f-9fec-7cd42220dc95 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:55.936109 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1290/2622] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:32:55.940062 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fab5b-4aa0-409f-9fec-7cd42220dc95 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:55.958549 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fab5b-4aa0-409f-9fec-7cd42220dc95 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:55.966927 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f6b1f-9076-4f80-b012-b9d009c1c4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:55.967589 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f6b1f-9076-4f80-b012-b9d009c1c4aa admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:55.967866 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f6b1f-9076-4f80-b012-b9d009c1c4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:55.968136 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f6b1f-9076-4f80-b012-b9d009c1c4aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:55.968783 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f6b1f-9076-4f80-b012-b9d009c1c4aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:55.970775 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f6b1f-9076-4f80-b012-b9d009c1c4aa admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:55.985455 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1291/2623] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:32:55.994261 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f6b1f-9076-4f80-b012-b9d009c1c4aa admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:56.009509 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d171492-9592-4f9a-81a4-faa448929c03 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:56.016571 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f6b1f-9076-4f80-b012-b9d009c1c4aa admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:56.020014 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc4174-3739-4efb-9a1d-6e888a2b6ae6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:56.020273 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc4174-3739-4efb-9a1d-6e888a2b6ae6 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:56.020557 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc4174-3739-4efb-9a1d-6e888a2b6ae6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:56.020882 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc4174-3739-4efb-9a1d-6e888a2b6ae6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:56.024499 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-debc4174-3739-4efb-9a1d-6e888a2b6ae6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:56.028680 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0bd4b-73b4-498e-9f7a-d9cfe2cd291c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:56.029633 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0bd4b-73b4-498e-9f7a-d9cfe2cd291c admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:56.030674 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0bd4b-73b4-498e-9f7a-d9cfe2cd291c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:56.031593 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0bd4b-73b4-498e-9f7a-d9cfe2cd291c admin admin] PATH_INFO: `/v3/projects/ff43493d328a4ec697be0c7386e3ac97/users/090f3f03860247b2bd701cdb9ef10580/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:56.044784 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:56.063347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0bd4b-73b4-498e-9f7a-d9cfe2cd291c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff43493d328a4ec697be0c7386e3ac97, user_id=090f3f03860247b2bd701cdb9ef10580, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:56.067214 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0bd4b-73b4-498e-9f7a-d9cfe2cd291c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:56.108897 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1292/2624] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:32:55 2022] PUT /identity/v3/projects/ff43493d328a4ec697be0c7386e3ac97/users/090f3f03860247b2bd701cdb9ef10580/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:56.115549 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc189e-4e35-40c8-8975-990283a45330 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:56.116825 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc189e-4e35-40c8-8975-990283a45330 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:56.123657 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:56.127728 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc189e-4e35-40c8-8975-990283a45330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:56.151090 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc4174-3739-4efb-9a1d-6e888a2b6ae6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:56.152993 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc4174-3739-4efb-9a1d-6e888a2b6ae6 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:56.175708 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1333/2625] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:32:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:32:56.196143 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-61cc189e-4e35-40c8-8975-990283a45330 None None] MFA Rules not processed for user `090f3f03860247b2bd701cdb9ef10580`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:56.197497 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-61cc189e-4e35-40c8-8975-990283a45330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:56.341922 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1293/2626] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:32:56.346885 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc4174-3739-4efb-9a1d-6e888a2b6ae6 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:56.368707 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc4174-3739-4efb-9a1d-6e888a2b6ae6 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:56.490015 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070dae48-c03a-4275-ae28-b87b75a82aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:56.491244 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070dae48-c03a-4275-ae28-b87b75a82aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:56.491526 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070dae48-c03a-4275-ae28-b87b75a82aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:56.491852 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070dae48-c03a-4275-ae28-b87b75a82aa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:56.492511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070dae48-c03a-4275-ae28-b87b75a82aa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:56.495486 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070dae48-c03a-4275-ae28-b87b75a82aa1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:56.544249 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1334/2627] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:32:56 2022] POST /identity/v3/projects => generated 381 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:32:56.545372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc189e-4e35-40c8-8975-990283a45330 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:56.561905 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc189e-4e35-40c8-8975-990283a45330 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:56.675482 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad25ab-1083-4457-81ef-a98ee88f59cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:56.676386 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad25ab-1083-4457-81ef-a98ee88f59cc admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:56.676870 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad25ab-1083-4457-81ef-a98ee88f59cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:56.677327 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad25ab-1083-4457-81ef-a98ee88f59cc admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:56.678720 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad25ab-1083-4457-81ef-a98ee88f59cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:56.681053 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad25ab-1083-4457-81ef-a98ee88f59cc admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:56.735738 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1294/2628] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:32:56 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:32:56.741209 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070dae48-c03a-4275-ae28-b87b75a82aa1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:56.757876 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070dae48-c03a-4275-ae28-b87b75a82aa1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:56.770119 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e161b4-05fd-4a8c-a818-1e7a27d1873c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:56.771218 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e161b4-05fd-4a8c-a818-1e7a27d1873c admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:56.771602 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e161b4-05fd-4a8c-a818-1e7a27d1873c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:56.771975 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e161b4-05fd-4a8c-a818-1e7a27d1873c admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:56.773314 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e161b4-05fd-4a8c-a818-1e7a27d1873c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:56.775174 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e161b4-05fd-4a8c-a818-1e7a27d1873c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:56.805263 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1335/2629] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:32:56.806154 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad25ab-1083-4457-81ef-a98ee88f59cc admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:56.821439 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad25ab-1083-4457-81ef-a98ee88f59cc admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:56.835157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136bd69-ab7c-4e64-aa2c-9ade5641d2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:56.836185 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136bd69-ab7c-4e64-aa2c-9ade5641d2f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:56.837149 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136bd69-ab7c-4e64-aa2c-9ade5641d2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:56.837736 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136bd69-ab7c-4e64-aa2c-9ade5641d2f3 admin admin] PATH_INFO: `/v3/projects/4604777db62f4ec19487ac19debb561c/users/53b0534074ee406ebce7dd16bbae1989/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:56.857356 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136bd69-ab7c-4e64-aa2c-9ade5641d2f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4604777db62f4ec19487ac19debb561c, user_id=53b0534074ee406ebce7dd16bbae1989, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:56.862903 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136bd69-ab7c-4e64-aa2c-9ade5641d2f3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:56.882548 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1295/2630] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:32:56 2022] PUT /identity/v3/projects/4604777db62f4ec19487ac19debb561c/users/53b0534074ee406ebce7dd16bbae1989/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:56.886526 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e161b4-05fd-4a8c-a818-1e7a27d1873c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:56.902664 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e161b4-05fd-4a8c-a818-1e7a27d1873c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:57.008312 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35974ad8-75f9-4f4c-990f-3bd2e5a8a7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:57.009888 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35974ad8-75f9-4f4c-990f-3bd2e5a8a7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:57.010326 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35974ad8-75f9-4f4c-990f-3bd2e5a8a7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:57.011439 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35974ad8-75f9-4f4c-990f-3bd2e5a8a7f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:57.012657 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35974ad8-75f9-4f4c-990f-3bd2e5a8a7f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:57.015954 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35974ad8-75f9-4f4c-990f-3bd2e5a8a7f0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:57.036259 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1336/2631] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:32:57.041042 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136bd69-ab7c-4e64-aa2c-9ade5641d2f3 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:57.058471 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136bd69-ab7c-4e64-aa2c-9ade5641d2f3 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:57.065424 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a5888-55ef-4c12-b679-660744ab452f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:57.066228 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a5888-55ef-4c12-b679-660744ab452f admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:57.067249 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a5888-55ef-4c12-b679-660744ab452f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:57.067586 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a5888-55ef-4c12-b679-660744ab452f admin admin] PATH_INFO: `/v3/projects/4604777db62f4ec19487ac19debb561c/users/53b0534074ee406ebce7dd16bbae1989/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:57.069749 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a5888-55ef-4c12-b679-660744ab452f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4604777db62f4ec19487ac19debb561c, user_id=53b0534074ee406ebce7dd16bbae1989, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:57.072767 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a5888-55ef-4c12-b679-660744ab452f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:57.093286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1296/2632] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:32:57 2022] PUT /identity/v3/projects/4604777db62f4ec19487ac19debb561c/users/53b0534074ee406ebce7dd16bbae1989/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:57.104286 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa221c5-b776-4103-a6bb-be272d859a37 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:57.104618 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa221c5-b776-4103-a6bb-be272d859a37 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:57.104845 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa221c5-b776-4103-a6bb-be272d859a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:57.147016 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-dfa221c5-b776-4103-a6bb-be272d859a37 None None] MFA Rules not processed for user `53b0534074ee406ebce7dd16bbae1989`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:57.148708 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-dfa221c5-b776-4103-a6bb-be272d859a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:57.233745 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:57.293065 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1337/2633] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:32:57.315899 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a5888-55ef-4c12-b679-660744ab452f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:57.317638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f17a5888-55ef-4c12-b679-660744ab452f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:57.383001 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:57.446023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a5888-55ef-4c12-b679-660744ab452f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:57.462458 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9005357-1119-44a2-a3a2-db53d8ae368d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:57.463098 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9005357-1119-44a2-a3a2-db53d8ae368d service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:57.463376 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9005357-1119-44a2-a3a2-db53d8ae368d service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:57.463646 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9005357-1119-44a2-a3a2-db53d8ae368d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:57.486534 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9005357-1119-44a2-a3a2-db53d8ae368d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:57.488016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9005357-1119-44a2-a3a2-db53d8ae368d service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:57.511268 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1297/2634] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:32:57 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:32:58.181675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa221c5-b776-4103-a6bb-be272d859a37 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:58.192450 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa221c5-b776-4103-a6bb-be272d859a37 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:58.199526 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e877f7-7f42-404b-9bc1-af752941d4c5 tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53b0534074ee406ebce7dd16bbae1989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4604777db62f4ec19487ac19debb561c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:58.200419 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e877f7-7f42-404b-9bc1-af752941d4c5 tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:58.200795 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e877f7-7f42-404b-9bc1-af752941d4c5 tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:58.201075 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e877f7-7f42-404b-9bc1-af752941d4c5 tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:58.201829 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e877f7-7f42-404b-9bc1-af752941d4c5 tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:32:58.202190 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e877f7-7f42-404b-9bc1-af752941d4c5 tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:58.205683 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e877f7-7f42-404b-9bc1-af752941d4c5 tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:58.223237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1338/2635] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:32:58.227721 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9005357-1119-44a2-a3a2-db53d8ae368d service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:58.238290 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9005357-1119-44a2-a3a2-db53d8ae368d service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:58.246918 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c67d39-854b-4db4-b329-32de735c07cc tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53b0534074ee406ebce7dd16bbae1989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4604777db62f4ec19487ac19debb561c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:58.247690 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c67d39-854b-4db4-b329-32de735c07cc tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:58.248067 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c67d39-854b-4db4-b329-32de735c07cc tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:58.248412 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c67d39-854b-4db4-b329-32de735c07cc tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:58.249144 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c67d39-854b-4db4-b329-32de735c07cc tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:58.251470 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c67d39-854b-4db4-b329-32de735c07cc tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:58.305950 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1298/2636] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:32:58 2022] POST /identity/v3/projects => generated 353 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:32:58.307423 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e877f7-7f42-404b-9bc1-af752941d4c5 tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:58.328647 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e877f7-7f42-404b-9bc1-af752941d4c5 tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:58.484784 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c2c64-722f-4460-9763-197d3d30bb5f tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53b0534074ee406ebce7dd16bbae1989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4604777db62f4ec19487ac19debb561c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:58.485570 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c2c64-722f-4460-9763-197d3d30bb5f tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:58.485926 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c2c64-722f-4460-9763-197d3d30bb5f tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:58.486272 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c2c64-722f-4460-9763-197d3d30bb5f tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:58.486996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c2c64-722f-4460-9763-197d3d30bb5f tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:32:58.487348 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c2c64-722f-4460-9763-197d3d30bb5f tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:58.488967 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c2c64-722f-4460-9763-197d3d30bb5f tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:58.507711 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1339/2637] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:32:58.554635 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c67d39-854b-4db4-b329-32de735c07cc tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:58.570448 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c67d39-854b-4db4-b329-32de735c07cc tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:58.575640 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51290e3f-995f-4685-a77a-ce7a1c9015e8 tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53b0534074ee406ebce7dd16bbae1989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4604777db62f4ec19487ac19debb561c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:58.586352 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51290e3f-995f-4685-a77a-ce7a1c9015e8 tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:58.586748 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51290e3f-995f-4685-a77a-ce7a1c9015e8 tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:58.590699 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51290e3f-995f-4685-a77a-ce7a1c9015e8 tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] PATH_INFO: `/v3/projects/94774881a08243a0a84cb3db24a32820` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:58.593798 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51290e3f-995f-4685-a77a-ce7a1c9015e8 tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] RBAC: Authorizing `identity:delete_project(project_id=94774881a08243a0a84cb3db24a32820)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:58.602010 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51290e3f-995f-4685-a77a-ce7a1c9015e8 tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:58.727685 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-51290e3f-995f-4685-a77a-ce7a1c9015e8 tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94774881a08243a0a84cb3db24a32820', 'request_id': 'req-51290e3f-995f-4685-a77a-ce7a1c9015e8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:58.752594 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-51290e3f-995f-4685-a77a-ce7a1c9015e8 tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94774881a08243a0a84cb3db24a32820', 'request_id': 'req-51290e3f-995f-4685-a77a-ce7a1c9015e8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:58.769090 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-51290e3f-995f-4685-a77a-ce7a1c9015e8 tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94774881a08243a0a84cb3db24a32820', 'request_id': 'req-51290e3f-995f-4685-a77a-ce7a1c9015e8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:58.787387 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-51290e3f-995f-4685-a77a-ce7a1c9015e8 tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] The token cache is being invalidate because project 94774881a08243a0a84cb3db24a32820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:32:58.787713 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-51290e3f-995f-4685-a77a-ce7a1c9015e8 tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:58.788936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-51290e3f-995f-4685-a77a-ce7a1c9015e8 tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:58.793786 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1299/2638] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:32:58 2022] DELETE /identity/v3/projects/94774881a08243a0a84cb3db24a32820 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:59.044633 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c2c64-722f-4460-9763-197d3d30bb5f tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:59.046345 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c99c2c64-722f-4460-9763-197d3d30bb5f tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:59.129314 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c2c64-722f-4460-9763-197d3d30bb5f tempest-VolumeQuotaClassesTest-1893947562 tempest-VolumeQuotaClassesTest-1893947562-project-admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:59.199366 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6718c3-075c-4c18-8176-2bb214d79ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:59.200289 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6718c3-075c-4c18-8176-2bb214d79ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:59.200678 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6718c3-075c-4c18-8176-2bb214d79ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:59.201053 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6718c3-075c-4c18-8176-2bb214d79ad0 admin admin] PATH_INFO: `/v3/users/090f3f03860247b2bd701cdb9ef10580` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:59.202371 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6718c3-075c-4c18-8176-2bb214d79ad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=090f3f03860247b2bd701cdb9ef10580)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:59.205280 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6718c3-075c-4c18-8176-2bb214d79ad0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:59.225146 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:59.274905 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7e6718c3-075c-4c18-8176-2bb214d79ad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '090f3f03860247b2bd701cdb9ef10580'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:59.275939 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7e6718c3-075c-4c18-8176-2bb214d79ad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '090f3f03860247b2bd701cdb9ef10580'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:59.293528 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7e6718c3-075c-4c18-8176-2bb214d79ad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '090f3f03860247b2bd701cdb9ef10580'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:59.303099 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7e6718c3-075c-4c18-8176-2bb214d79ad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '090f3f03860247b2bd701cdb9ef10580'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:59.313419 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7e6718c3-075c-4c18-8176-2bb214d79ad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '090f3f03860247b2bd701cdb9ef10580'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:32:59.321289 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1340/2639] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:32:59 2022] DELETE /identity/v3/users/090f3f03860247b2bd701cdb9ef10580 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:32:59.325998 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c797e-e86c-488a-ad7d-4824922a08c1 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:59.326279 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c797e-e86c-488a-ad7d-4824922a08c1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:59.326548 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c797e-e86c-488a-ad7d-4824922a08c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:59.349785 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9f5c797e-e86c-488a-ad7d-4824922a08c1 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:32:59.351195 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9f5c797e-e86c-488a-ad7d-4824922a08c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:59.421652 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1300/2640] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:32:59.429335 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6718c3-075c-4c18-8176-2bb214d79ad0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:59.430859 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7e6718c3-075c-4c18-8176-2bb214d79ad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:59.520936 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6718c3-075c-4c18-8176-2bb214d79ad0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:32:59.524771 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80c1be-36bc-4e60-b6f1-4c0f42b12b44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:32:59.525466 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80c1be-36bc-4e60-b6f1-4c0f42b12b44 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:32:59.525746 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80c1be-36bc-4e60-b6f1-4c0f42b12b44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:32:59.526021 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80c1be-36bc-4e60-b6f1-4c0f42b12b44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:32:59.547949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80c1be-36bc-4e60-b6f1-4c0f42b12b44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:32:59.549387 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80c1be-36bc-4e60-b6f1-4c0f42b12b44 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:32:59.565360 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1341/2641] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:32:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:32:59.964633 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c797e-e86c-488a-ad7d-4824922a08c1 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:32:59.967038 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9f5c797e-e86c-488a-ad7d-4824922a08c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:32:59.992031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c797e-e86c-488a-ad7d-4824922a08c1 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:00.001529 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e32fa-b145-4ef0-98da-49bba74fe348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:00.002290 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e32fa-b145-4ef0-98da-49bba74fe348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:00.002645 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e32fa-b145-4ef0-98da-49bba74fe348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:00.002991 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e32fa-b145-4ef0-98da-49bba74fe348 admin admin] PATH_INFO: `/v3/projects/ff43493d328a4ec697be0c7386e3ac97` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:00.004225 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e32fa-b145-4ef0-98da-49bba74fe348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff43493d328a4ec697be0c7386e3ac97)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:00.006708 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e32fa-b145-4ef0-98da-49bba74fe348 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:00.059773 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:00.083350 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cf7e32fa-b145-4ef0-98da-49bba74fe348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff43493d328a4ec697be0c7386e3ac97', 'request_id': 'req-cf7e32fa-b145-4ef0-98da-49bba74fe348'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:00.090134 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cf7e32fa-b145-4ef0-98da-49bba74fe348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff43493d328a4ec697be0c7386e3ac97', 'request_id': 'req-cf7e32fa-b145-4ef0-98da-49bba74fe348'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:00.097649 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cf7e32fa-b145-4ef0-98da-49bba74fe348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff43493d328a4ec697be0c7386e3ac97', 'request_id': 'req-cf7e32fa-b145-4ef0-98da-49bba74fe348'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:00.123167 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cf7e32fa-b145-4ef0-98da-49bba74fe348 admin admin] The token cache is being invalidate because project ff43493d328a4ec697be0c7386e3ac97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:33:00.125737 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cf7e32fa-b145-4ef0-98da-49bba74fe348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:00.126773 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cf7e32fa-b145-4ef0-98da-49bba74fe348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:00.129281 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1301/2642] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:32:59 2022] DELETE /identity/v3/projects/ff43493d328a4ec697be0c7386e3ac97 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:33:00.133457 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80c1be-36bc-4e60-b6f1-4c0f42b12b44 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:00.144893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80c1be-36bc-4e60-b6f1-4c0f42b12b44 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:00.223854 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81bdc3-576b-467b-9887-4ed39a66198b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:00.225959 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81bdc3-576b-467b-9887-4ed39a66198b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:00.226400 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81bdc3-576b-467b-9887-4ed39a66198b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:00.226857 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81bdc3-576b-467b-9887-4ed39a66198b admin admin] PATH_INFO: `/v3/users/53b0534074ee406ebce7dd16bbae1989` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:00.228014 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81bdc3-576b-467b-9887-4ed39a66198b admin admin] RBAC: Authorizing `identity:delete_user(user_id=53b0534074ee406ebce7dd16bbae1989)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:00.230306 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81bdc3-576b-467b-9887-4ed39a66198b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:00.281351 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:00.290500 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3c81bdc3-576b-467b-9887-4ed39a66198b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53b0534074ee406ebce7dd16bbae1989'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:00.291499 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3c81bdc3-576b-467b-9887-4ed39a66198b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53b0534074ee406ebce7dd16bbae1989'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:00.306130 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3c81bdc3-576b-467b-9887-4ed39a66198b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53b0534074ee406ebce7dd16bbae1989'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:00.314332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3c81bdc3-576b-467b-9887-4ed39a66198b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53b0534074ee406ebce7dd16bbae1989'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:00.322973 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3c81bdc3-576b-467b-9887-4ed39a66198b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53b0534074ee406ebce7dd16bbae1989'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:00.329891 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1342/2643] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:33:00 2022] DELETE /identity/v3/users/53b0534074ee406ebce7dd16bbae1989 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:33:00.660974 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e32fa-b145-4ef0-98da-49bba74fe348 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:00.662843 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cf7e32fa-b145-4ef0-98da-49bba74fe348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:00.681769 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e32fa-b145-4ef0-98da-49bba74fe348 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:00.746335 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56c17d-92f6-4761-91fd-dc658d45db76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:00.747304 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56c17d-92f6-4761-91fd-dc658d45db76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:00.747757 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56c17d-92f6-4761-91fd-dc658d45db76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:00.748222 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56c17d-92f6-4761-91fd-dc658d45db76 admin admin] PATH_INFO: `/v3/projects/4604777db62f4ec19487ac19debb561c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:00.749462 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56c17d-92f6-4761-91fd-dc658d45db76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4604777db62f4ec19487ac19debb561c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:00.751474 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56c17d-92f6-4761-91fd-dc658d45db76 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:00.810817 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-eb56c17d-92f6-4761-91fd-dc658d45db76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4604777db62f4ec19487ac19debb561c', 'request_id': 'req-eb56c17d-92f6-4761-91fd-dc658d45db76'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:00.817285 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-eb56c17d-92f6-4761-91fd-dc658d45db76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4604777db62f4ec19487ac19debb561c', 'request_id': 'req-eb56c17d-92f6-4761-91fd-dc658d45db76'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:00.824716 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-eb56c17d-92f6-4761-91fd-dc658d45db76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4604777db62f4ec19487ac19debb561c', 'request_id': 'req-eb56c17d-92f6-4761-91fd-dc658d45db76'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:00.838792 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-eb56c17d-92f6-4761-91fd-dc658d45db76 admin admin] The token cache is being invalidate because project 4604777db62f4ec19487ac19debb561c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:33:00.839083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-eb56c17d-92f6-4761-91fd-dc658d45db76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:00.839783 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-eb56c17d-92f6-4761-91fd-dc658d45db76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:00.841494 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1302/2644] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:33:00 2022] DELETE /identity/v3/projects/4604777db62f4ec19487ac19debb561c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:33:00.846380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997ce10-cfc5-40eb-baa8-e971fd3821b9 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:00.846738 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997ce10-cfc5-40eb-baa8-e971fd3821b9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:00.847078 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997ce10-cfc5-40eb-baa8-e971fd3821b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:00.867438 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d997ce10-cfc5-40eb-baa8-e971fd3821b9 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:00.868772 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d997ce10-cfc5-40eb-baa8-e971fd3821b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:00.954422 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1343/2645] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:33:00.963654 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3664b-47f5-435f-b0fa-df78db7dc25c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:00.964097 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3664b-47f5-435f-b0fa-df78db7dc25c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:00.964446 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3664b-47f5-435f-b0fa-df78db7dc25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:00.985664 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-bdf3664b-47f5-435f-b0fa-df78db7dc25c None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:00.987064 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bdf3664b-47f5-435f-b0fa-df78db7dc25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:01.005989 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1303/2646] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:33:01.010589 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997ce10-cfc5-40eb-baa8-e971fd3821b9 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:01.028624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997ce10-cfc5-40eb-baa8-e971fd3821b9 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:01.035663 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3664b-47f5-435f-b0fa-df78db7dc25c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:01.037640 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce69c2-ac84-45a6-a8c1-1274b4a36491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:01.037951 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bdf3664b-47f5-435f-b0fa-df78db7dc25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:01.038484 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce69c2-ac84-45a6-a8c1-1274b4a36491 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:01.038865 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce69c2-ac84-45a6-a8c1-1274b4a36491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:01.039236 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce69c2-ac84-45a6-a8c1-1274b4a36491 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:01.040003 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce69c2-ac84-45a6-a8c1-1274b4a36491 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:33:01.040399 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce69c2-ac84-45a6-a8c1-1274b4a36491 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:01.042258 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce69c2-ac84-45a6-a8c1-1274b4a36491 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:01.056152 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1344/2647] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:33:01.062032 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce69c2-ac84-45a6-a8c1-1274b4a36491 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:01.076399 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce69c2-ac84-45a6-a8c1-1274b4a36491 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:01.081361 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207011cf-e4a8-429f-9d15-e539d2ae283e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:01.081998 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207011cf-e4a8-429f-9d15-e539d2ae283e admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:01.082286 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207011cf-e4a8-429f-9d15-e539d2ae283e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:01.082620 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207011cf-e4a8-429f-9d15-e539d2ae283e admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:01.083257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207011cf-e4a8-429f-9d15-e539d2ae283e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:01.085379 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207011cf-e4a8-429f-9d15-e539d2ae283e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:01.096539 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:01.127854 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3664b-47f5-435f-b0fa-df78db7dc25c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:01.129184 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1345/2648] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:33:01 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:33:01.133818 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207011cf-e4a8-429f-9d15-e539d2ae283e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:01.204751 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96120b0c-6066-4138-bf9b-8cb6b270f59f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:01.205735 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96120b0c-6066-4138-bf9b-8cb6b270f59f service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:01.206453 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96120b0c-6066-4138-bf9b-8cb6b270f59f service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:01.206915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96120b0c-6066-4138-bf9b-8cb6b270f59f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:01.208870 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-96120b0c-6066-4138-bf9b-8cb6b270f59f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:01.231529 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207011cf-e4a8-429f-9d15-e539d2ae283e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:01.237365 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d21053-81c6-4e48-a750-ccc2bb4e164f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:01.238455 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d21053-81c6-4e48-a750-ccc2bb4e164f admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:01.238734 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d21053-81c6-4e48-a750-ccc2bb4e164f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:01.239003 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d21053-81c6-4e48-a750-ccc2bb4e164f admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:01.239639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d21053-81c6-4e48-a750-ccc2bb4e164f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:01.242589 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d21053-81c6-4e48-a750-ccc2bb4e164f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:01.278630 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1346/2649] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:33:01 2022] POST /identity/v3/users => generated 290 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:33:01.279632 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d21053-81c6-4e48-a750-ccc2bb4e164f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:01.303980 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d21053-81c6-4e48-a750-ccc2bb4e164f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:01.311713 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96120b0c-6066-4138-bf9b-8cb6b270f59f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:01.312942 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96120b0c-6066-4138-bf9b-8cb6b270f59f service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:01.320708 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68865567-a1f4-43fe-8c79-2e21c5daf4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:01.323533 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68865567-a1f4-43fe-8c79-2e21c5daf4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:01.323533 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68865567-a1f4-43fe-8c79-2e21c5daf4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:01.323825 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68865567-a1f4-43fe-8c79-2e21c5daf4b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:01.324495 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68865567-a1f4-43fe-8c79-2e21c5daf4b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:01.326158 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68865567-a1f4-43fe-8c79-2e21c5daf4b9 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:01.331954 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1304/2650] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:33:01 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:33:01.332809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:01.342057 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1347/2651] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:33:01.344498 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96120b0c-6066-4138-bf9b-8cb6b270f59f service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:01.357630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96120b0c-6066-4138-bf9b-8cb6b270f59f service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:01.363601 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a83007-facd-4807-8226-05fe7e50ea93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:01.364496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a83007-facd-4807-8226-05fe7e50ea93 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:01.364980 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a83007-facd-4807-8226-05fe7e50ea93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:01.365850 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a83007-facd-4807-8226-05fe7e50ea93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:01.367504 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a83007-facd-4807-8226-05fe7e50ea93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:01.369467 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a83007-facd-4807-8226-05fe7e50ea93 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:01.383434 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1305/2652] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:33:01.384810 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68865567-a1f4-43fe-8c79-2e21c5daf4b9 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:01.397601 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68865567-a1f4-43fe-8c79-2e21c5daf4b9 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:01.406019 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258f8fd-7a01-4a96-822d-2ee087085e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:01.406806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258f8fd-7a01-4a96-822d-2ee087085e33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:01.407140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258f8fd-7a01-4a96-822d-2ee087085e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:01.407368 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258f8fd-7a01-4a96-822d-2ee087085e33 admin admin] PATH_INFO: `/v3/projects/436543b013804c0981971749f97453bb/users/02363a5ed2414ba6a5c2c4aeb7108eaa/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:01.426929 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258f8fd-7a01-4a96-822d-2ee087085e33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=436543b013804c0981971749f97453bb, user_id=02363a5ed2414ba6a5c2c4aeb7108eaa, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:01.431061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258f8fd-7a01-4a96-822d-2ee087085e33 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:01.456965 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1348/2653] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:33:01 2022] PUT /identity/v3/projects/436543b013804c0981971749f97453bb/users/02363a5ed2414ba6a5c2c4aeb7108eaa/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:33:01.458716 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee11991-f078-452e-af67-e965757ecb87 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:01.459041 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee11991-f078-452e-af67-e965757ecb87 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:01.459319 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee11991-f078-452e-af67-e965757ecb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:01.491327 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8ee11991-f078-452e-af67-e965757ecb87 None None] MFA Rules not processed for user `02363a5ed2414ba6a5c2c4aeb7108eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:01.492583 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8ee11991-f078-452e-af67-e965757ecb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:01.570797 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1306/2654] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:33:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:33:01.575558 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258f8fd-7a01-4a96-822d-2ee087085e33 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:01.659941 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258f8fd-7a01-4a96-822d-2ee087085e33 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:01.666627 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03faa5e8-fcd7-4f5a-b2fa-abdaea90f0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:01.667260 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03faa5e8-fcd7-4f5a-b2fa-abdaea90f0d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:01.667542 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03faa5e8-fcd7-4f5a-b2fa-abdaea90f0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:01.667802 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03faa5e8-fcd7-4f5a-b2fa-abdaea90f0d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:01.668817 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03faa5e8-fcd7-4f5a-b2fa-abdaea90f0d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:01.670423 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03faa5e8-fcd7-4f5a-b2fa-abdaea90f0d6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:01.708609 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1349/2655] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:33:01 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:33:01.710642 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee11991-f078-452e-af67-e965757ecb87 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:01.721826 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee11991-f078-452e-af67-e965757ecb87 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:01.742009 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:01.779114 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae62a4-ac3d-4d59-b396-cfa95cf15d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:01.779769 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae62a4-ac3d-4d59-b396-cfa95cf15d52 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:01.780041 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae62a4-ac3d-4d59-b396-cfa95cf15d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:01.780340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae62a4-ac3d-4d59-b396-cfa95cf15d52 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:01.780967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae62a4-ac3d-4d59-b396-cfa95cf15d52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:01.782902 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae62a4-ac3d-4d59-b396-cfa95cf15d52 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:01.803097 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1307/2656] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:33:01 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:33:01.807783 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03faa5e8-fcd7-4f5a-b2fa-abdaea90f0d6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:01.818839 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03faa5e8-fcd7-4f5a-b2fa-abdaea90f0d6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:01.824482 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded3663-6de9-4bcb-8e00-3ec4e4dd1e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:01.825081 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded3663-6de9-4bcb-8e00-3ec4e4dd1e2a admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:01.825362 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded3663-6de9-4bcb-8e00-3ec4e4dd1e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:01.825663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded3663-6de9-4bcb-8e00-3ec4e4dd1e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:01.826300 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded3663-6de9-4bcb-8e00-3ec4e4dd1e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:01.827887 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded3663-6de9-4bcb-8e00-3ec4e4dd1e2a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:01.838520 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1350/2657] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:33:01.842508 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae62a4-ac3d-4d59-b396-cfa95cf15d52 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:01.852750 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae62a4-ac3d-4d59-b396-cfa95cf15d52 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:01.857470 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311f73f-cdb7-4299-9cc8-f4e1a0a1380d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:01.858061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311f73f-cdb7-4299-9cc8-f4e1a0a1380d admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:01.858334 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311f73f-cdb7-4299-9cc8-f4e1a0a1380d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:01.858605 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311f73f-cdb7-4299-9cc8-f4e1a0a1380d admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:01.859422 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311f73f-cdb7-4299-9cc8-f4e1a0a1380d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:01.860997 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311f73f-cdb7-4299-9cc8-f4e1a0a1380d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:01.871480 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1308/2658] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:33:01.875728 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded3663-6de9-4bcb-8e00-3ec4e4dd1e2a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:01.886491 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded3663-6de9-4bcb-8e00-3ec4e4dd1e2a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:01.891179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c7c85-b5d6-406f-a14f-fad539a4b4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:01.891836 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c7c85-b5d6-406f-a14f-fad539a4b4b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:01.892116 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c7c85-b5d6-406f-a14f-fad539a4b4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:01.892390 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c7c85-b5d6-406f-a14f-fad539a4b4b4 admin admin] PATH_INFO: `/v3/projects/a3a1ee45152d471da864d8aa6b404b6f/users/fffa4dda445a49b99719913b347f7914/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:01.909534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c7c85-b5d6-406f-a14f-fad539a4b4b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3a1ee45152d471da864d8aa6b404b6f, user_id=fffa4dda445a49b99719913b347f7914, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:01.912188 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c7c85-b5d6-406f-a14f-fad539a4b4b4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:01.924801 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1351/2659] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:33:01 2022] PUT /identity/v3/projects/a3a1ee45152d471da864d8aa6b404b6f/users/fffa4dda445a49b99719913b347f7914/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:33:01.935552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18e88b-122d-4f1f-bf80-7953b8108f53 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:01.935838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18e88b-122d-4f1f-bf80-7953b8108f53 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:01.936109 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18e88b-122d-4f1f-bf80-7953b8108f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:01.968916 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-af18e88b-122d-4f1f-bf80-7953b8108f53 None None] MFA Rules not processed for user `fffa4dda445a49b99719913b347f7914`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:01.970146 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-af18e88b-122d-4f1f-bf80-7953b8108f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:02.042743 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1309/2660] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:33:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:33:02.047433 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c7c85-b5d6-406f-a14f-fad539a4b4b4 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:02.109483 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c7c85-b5d6-406f-a14f-fad539a4b4b4 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:02.114085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad165ca6-8c83-47a6-af03-4c74f311093b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:02.114692 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad165ca6-8c83-47a6-af03-4c74f311093b admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:02.114966 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad165ca6-8c83-47a6-af03-4c74f311093b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:02.115234 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad165ca6-8c83-47a6-af03-4c74f311093b admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:02.116852 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad165ca6-8c83-47a6-af03-4c74f311093b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:02.118352 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad165ca6-8c83-47a6-af03-4c74f311093b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:02.145432 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1352/2661] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:33:02 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:33:02.156406 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18e88b-122d-4f1f-bf80-7953b8108f53 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:02.167680 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18e88b-122d-4f1f-bf80-7953b8108f53 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:02.223536 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b2c5d-b24d-4fef-a557-de3bc97fc4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:02.224139 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b2c5d-b24d-4fef-a557-de3bc97fc4a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:02.224417 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b2c5d-b24d-4fef-a557-de3bc97fc4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:02.224697 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b2c5d-b24d-4fef-a557-de3bc97fc4a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:02.225842 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b2c5d-b24d-4fef-a557-de3bc97fc4a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:02.227754 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b2c5d-b24d-4fef-a557-de3bc97fc4a9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:02.249252 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1310/2662] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:33:02 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:33:02.253247 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad165ca6-8c83-47a6-af03-4c74f311093b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:02.264007 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad165ca6-8c83-47a6-af03-4c74f311093b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:02.268951 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecddcc6-6a51-4f4f-a805-875d3f0fab6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:02.269626 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecddcc6-6a51-4f4f-a805-875d3f0fab6f admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:02.270106 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecddcc6-6a51-4f4f-a805-875d3f0fab6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:02.270420 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecddcc6-6a51-4f4f-a805-875d3f0fab6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:02.270958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecddcc6-6a51-4f4f-a805-875d3f0fab6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:02.273289 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecddcc6-6a51-4f4f-a805-875d3f0fab6f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:02.279453 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:02.286052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1353/2663] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:33:02.290847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b2c5d-b24d-4fef-a557-de3bc97fc4a9 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:02.305630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b2c5d-b24d-4fef-a557-de3bc97fc4a9 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:02.310473 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773718f-8045-4bf5-8109-02a2e191930a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:02.311139 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773718f-8045-4bf5-8109-02a2e191930a admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:02.311417 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773718f-8045-4bf5-8109-02a2e191930a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:02.311703 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773718f-8045-4bf5-8109-02a2e191930a admin admin] PATH_INFO: `/v3/projects/2ebff752cd8a49fbab7d6f0910626fcc/users/018d138a3e5c4c4385063784597b555a/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:02.327193 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773718f-8045-4bf5-8109-02a2e191930a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ebff752cd8a49fbab7d6f0910626fcc, user_id=018d138a3e5c4c4385063784597b555a, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:02.329913 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773718f-8045-4bf5-8109-02a2e191930a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:02.339509 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:02.347441 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1311/2664] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:33:02 2022] PUT /identity/v3/projects/2ebff752cd8a49fbab7d6f0910626fcc/users/018d138a3e5c4c4385063784597b555a/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:33:02.351807 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecddcc6-6a51-4f4f-a805-875d3f0fab6f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:02.361879 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecddcc6-6a51-4f4f-a805-875d3f0fab6f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:02.421203 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447389a-8d13-4727-9ab5-678547f6aea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:02.421944 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447389a-8d13-4727-9ab5-678547f6aea2 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:02.422454 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447389a-8d13-4727-9ab5-678547f6aea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:02.422837 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447389a-8d13-4727-9ab5-678547f6aea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:02.423560 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447389a-8d13-4727-9ab5-678547f6aea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:02.425256 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447389a-8d13-4727-9ab5-678547f6aea2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:02.436169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1354/2665] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:33:02.440303 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773718f-8045-4bf5-8109-02a2e191930a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:02.451493 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773718f-8045-4bf5-8109-02a2e191930a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:02.456369 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e5d5e-64bd-4458-a2c8-036ebc13f5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:02.457029 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e5d5e-64bd-4458-a2c8-036ebc13f5bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:02.457310 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e5d5e-64bd-4458-a2c8-036ebc13f5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:02.457617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e5d5e-64bd-4458-a2c8-036ebc13f5bd admin admin] PATH_INFO: `/v3/projects/2ebff752cd8a49fbab7d6f0910626fcc/users/018d138a3e5c4c4385063784597b555a/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:02.460267 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e5d5e-64bd-4458-a2c8-036ebc13f5bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ebff752cd8a49fbab7d6f0910626fcc, user_id=018d138a3e5c4c4385063784597b555a, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:02.462991 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e5d5e-64bd-4458-a2c8-036ebc13f5bd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:02.474430 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1312/2666] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:33:02 2022] PUT /identity/v3/projects/2ebff752cd8a49fbab7d6f0910626fcc/users/018d138a3e5c4c4385063784597b555a/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:33:02.486535 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e4ddf-382f-4d88-bdb9-ded62953f3c9 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:02.486535 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e4ddf-382f-4d88-bdb9-ded62953f3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:02.486535 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e4ddf-382f-4d88-bdb9-ded62953f3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:02.516176 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-7f8e4ddf-382f-4d88-bdb9-ded62953f3c9 None None] MFA Rules not processed for user `018d138a3e5c4c4385063784597b555a`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:02.517452 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7f8e4ddf-382f-4d88-bdb9-ded62953f3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:02.595141 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1355/2667] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:33:02 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:33:02.606953 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e5d5e-64bd-4458-a2c8-036ebc13f5bd admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:02.667959 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e5d5e-64bd-4458-a2c8-036ebc13f5bd admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:02.671639 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d06535-c4a1-4b26-9e89-3ce3518826a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:02.672274 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d06535-c4a1-4b26-9e89-3ce3518826a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:02.672552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d06535-c4a1-4b26-9e89-3ce3518826a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:02.672824 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d06535-c4a1-4b26-9e89-3ce3518826a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:02.682368 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d06535-c4a1-4b26-9e89-3ce3518826a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:02.683789 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d06535-c4a1-4b26-9e89-3ce3518826a0 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:02.693131 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1313/2668] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:33:02 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:33:02.736386 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e4ddf-382f-4d88-bdb9-ded62953f3c9 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:02.747111 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e4ddf-382f-4d88-bdb9-ded62953f3c9 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:02.750701 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea82166-9c2b-4cb5-8b98-1ae1d2c0bbd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:02.751351 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea82166-9c2b-4cb5-8b98-1ae1d2c0bbd0 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:02.751598 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea82166-9c2b-4cb5-8b98-1ae1d2c0bbd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:02.751867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea82166-9c2b-4cb5-8b98-1ae1d2c0bbd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:02.809295 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea82166-9c2b-4cb5-8b98-1ae1d2c0bbd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:02.810810 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea82166-9c2b-4cb5-8b98-1ae1d2c0bbd0 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:02.820655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1356/2669] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:33:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:33:05.468732 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d06535-c4a1-4b26-9e89-3ce3518826a0 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:05.470276 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d2d06535-c4a1-4b26-9e89-3ce3518826a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:05.531776 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d06535-c4a1-4b26-9e89-3ce3518826a0 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:05.535445 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3aa44e-6536-4e6a-8476-2ffcf038bd08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:05.536047 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3aa44e-6536-4e6a-8476-2ffcf038bd08 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:05.536321 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3aa44e-6536-4e6a-8476-2ffcf038bd08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:05.536596 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3aa44e-6536-4e6a-8476-2ffcf038bd08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:05.538954 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ea3aa44e-6536-4e6a-8476-2ffcf038bd08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:05.549262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3aa44e-6536-4e6a-8476-2ffcf038bd08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:05.550651 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3aa44e-6536-4e6a-8476-2ffcf038bd08 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:05.558884 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1314/2670] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:33:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:33:05.683391 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c11898-5292-4cbe-8823-910525b43092 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:05.683968 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c11898-5292-4cbe-8823-910525b43092 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:05.684407 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c11898-5292-4cbe-8823-910525b43092 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:05.685813 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1357/2671] 10.222.0.94 () {54 vars in 921 bytes} [Thu Sep 1 17:33:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:33:05.691997 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810ab3f-c400-4388-885d-71c2148e6b62 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:05.692355 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810ab3f-c400-4388-885d-71c2148e6b62 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:05.692699 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810ab3f-c400-4388-885d-71c2148e6b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:05.713710 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8810ab3f-c400-4388-885d-71c2148e6b62 None None] MFA Rules not processed for user `8b7fa3c4c5d94b3c9b7f17dde35d39a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:05.715044 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8810ab3f-c400-4388-885d-71c2148e6b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:05.783385 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1315/2672] 10.222.0.94 () {58 vars in 1018 bytes} [Thu Sep 1 17:33:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:33:05.796157 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c11898-5292-4cbe-8823-910525b43092 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:05.797958 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-20c11898-5292-4cbe-8823-910525b43092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:05.821706 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:05.861953 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c11898-5292-4cbe-8823-910525b43092 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:05.865656 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb8a10-3ebe-450b-a655-6ea35db9a5dc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6647f3aa54dc68e888b3adb8c28b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:05.866356 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb8a10-3ebe-450b-a655-6ea35db9a5dc service glance] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:05.866705 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb8a10-3ebe-450b-a655-6ea35db9a5dc service glance] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:05.867037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb8a10-3ebe-450b-a655-6ea35db9a5dc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:05.878563 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb8a10-3ebe-450b-a655-6ea35db9a5dc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:05.880071 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb8a10-3ebe-450b-a655-6ea35db9a5dc service glance] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:05.891962 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1358/2673] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:33:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:33:05.906693 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810ab3f-c400-4388-885d-71c2148e6b62 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:05.933843 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:05.963883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987585b6-6064-4f67-b8eb-96b8404a37a6 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:05.964169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987585b6-6064-4f67-b8eb-96b8404a37a6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:05.964441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987585b6-6064-4f67-b8eb-96b8404a37a6 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:05.965824 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1359/2674] 10.222.0.94 () {54 vars in 921 bytes} [Thu Sep 1 17:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:33:05.970134 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657db695-f4e5-4882-a5df-f910c1df9fb5 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:05.970441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657db695-f4e5-4882-a5df-f910c1df9fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:05.970721 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657db695-f4e5-4882-a5df-f910c1df9fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:05.974876 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810ab3f-c400-4388-885d-71c2148e6b62 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:05.980078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d9dc3-24bc-42ae-b981-f699c614061d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:05.980716 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d9dc3-24bc-42ae-b981-f699c614061d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:05.980994 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d9dc3-24bc-42ae-b981-f699c614061d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:05.981262 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d9dc3-24bc-42ae-b981-f699c614061d admin admin] PATH_INFO: `/v3/users/02363a5ed2414ba6a5c2c4aeb7108eaa` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:05.982461 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d9dc3-24bc-42ae-b981-f699c614061d admin admin] RBAC: Authorizing `identity:delete_user(user_id=02363a5ed2414ba6a5c2c4aeb7108eaa)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:05.984419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d9dc3-24bc-42ae-b981-f699c614061d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:05.990845 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-657db695-f4e5-4882-a5df-f910c1df9fb5 None None] MFA Rules not processed for user `92edc2953b8e4e42aa64569335acfc9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:05.992063 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-657db695-f4e5-4882-a5df-f910c1df9fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:05.998667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1360/2675] 10.222.0.94 () {58 vars in 1018 bytes} [Thu Sep 1 17:33:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:33:06.011201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657db695-f4e5-4882-a5df-f910c1df9fb5 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:06.022719 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657db695-f4e5-4882-a5df-f910c1df9fb5 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:06.026590 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39af160-1cb8-4b6f-a4ea-e0e885836026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:06.027182 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39af160-1cb8-4b6f-a4ea-e0e885836026 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:06.027455 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39af160-1cb8-4b6f-a4ea-e0e885836026 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:06.027718 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39af160-1cb8-4b6f-a4ea-e0e885836026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:06.034903 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39af160-1cb8-4b6f-a4ea-e0e885836026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:06.035540 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-aa1d9dc3-24bc-42ae-b981-f699c614061d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02363a5ed2414ba6a5c2c4aeb7108eaa'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:06.036213 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-aa1d9dc3-24bc-42ae-b981-f699c614061d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02363a5ed2414ba6a5c2c4aeb7108eaa'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:06.036410 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39af160-1cb8-4b6f-a4ea-e0e885836026 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:06.044296 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-aa1d9dc3-24bc-42ae-b981-f699c614061d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02363a5ed2414ba6a5c2c4aeb7108eaa'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:06.044943 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1361/2676] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:33:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:33:06.045205 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-aa1d9dc3-24bc-42ae-b981-f699c614061d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02363a5ed2414ba6a5c2c4aeb7108eaa'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:06.052197 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-aa1d9dc3-24bc-42ae-b981-f699c614061d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02363a5ed2414ba6a5c2c4aeb7108eaa'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:06.073978 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1316/2677] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:33:05 2022] DELETE /identity/v3/users/02363a5ed2414ba6a5c2c4aeb7108eaa => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:33:06.079187 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c22249-3edd-4989-9ee5-50e8c83efd91 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:06.079527 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c22249-3edd-4989-9ee5-50e8c83efd91 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:06.079712 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c22249-3edd-4989-9ee5-50e8c83efd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:06.109182 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-20c22249-3edd-4989-9ee5-50e8c83efd91 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:06.110504 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-20c22249-3edd-4989-9ee5-50e8c83efd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:06.140230 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05106e-25a9-4c80-9d6a-00214211c25c None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:06.140544 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05106e-25a9-4c80-9d6a-00214211c25c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:06.140822 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05106e-25a9-4c80-9d6a-00214211c25c None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:06.142258 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1317/2678] 10.222.0.94 () {54 vars in 921 bytes} [Thu Sep 1 17:33:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 17:33:06.148254 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de68bd-2537-4d65-837d-044d9202ca57 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:06.148540 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de68bd-2537-4d65-837d-044d9202ca57 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:06.148821 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de68bd-2537-4d65-837d-044d9202ca57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:06.169653 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-45de68bd-2537-4d65-837d-044d9202ca57 None None] MFA Rules not processed for user `8b7fa3c4c5d94b3c9b7f17dde35d39a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:06.170892 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-45de68bd-2537-4d65-837d-044d9202ca57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:06.175015 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1362/2679] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:33:06.185016 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c22249-3edd-4989-9ee5-50e8c83efd91 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:06.186378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-20c22249-3edd-4989-9ee5-50e8c83efd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:06.239716 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1318/2680] 10.222.0.94 () {58 vars in 1018 bytes} [Thu Sep 1 17:33:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:33:06.242646 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c22249-3edd-4989-9ee5-50e8c83efd91 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:06.246495 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91c26e-a16e-44c4-bb78-c04a0abd0988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:06.247108 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91c26e-a16e-44c4-bb78-c04a0abd0988 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:06.247386 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91c26e-a16e-44c4-bb78-c04a0abd0988 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:06.247654 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91c26e-a16e-44c4-bb78-c04a0abd0988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:06.250713 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de68bd-2537-4d65-837d-044d9202ca57 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:06.257859 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91c26e-a16e-44c4-bb78-c04a0abd0988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:06.259291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91c26e-a16e-44c4-bb78-c04a0abd0988 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:06.260392 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de68bd-2537-4d65-837d-044d9202ca57 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:06.264126 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50637847-e592-483f-803f-fc2484a93bb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:06.264754 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50637847-e592-483f-803f-fc2484a93bb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:06.265162 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50637847-e592-483f-803f-fc2484a93bb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:06.265460 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50637847-e592-483f-803f-fc2484a93bb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:06.268793 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1363/2681] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:33:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:33:06.277207 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50637847-e592-483f-803f-fc2484a93bb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:06.278394 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50637847-e592-483f-803f-fc2484a93bb1 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:06.290744 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1319/2682] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:33:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:33:06.300229 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91c26e-a16e-44c4-bb78-c04a0abd0988 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:06.301724 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1f91c26e-a16e-44c4-bb78-c04a0abd0988 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:06.315284 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91c26e-a16e-44c4-bb78-c04a0abd0988 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:06.320675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc437f66-c65a-4b38-a63f-c7348241eb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:06.321298 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc437f66-c65a-4b38-a63f-c7348241eb9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:06.321602 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc437f66-c65a-4b38-a63f-c7348241eb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:06.321877 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc437f66-c65a-4b38-a63f-c7348241eb9a admin admin] PATH_INFO: `/v3/users/a6105c4d7d4342c9963e37c64009b74f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:06.323006 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc437f66-c65a-4b38-a63f-c7348241eb9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6105c4d7d4342c9963e37c64009b74f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:06.325131 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc437f66-c65a-4b38-a63f-c7348241eb9a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:06.372114 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:06.383640 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fc437f66-c65a-4b38-a63f-c7348241eb9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6105c4d7d4342c9963e37c64009b74f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:06.384313 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fc437f66-c65a-4b38-a63f-c7348241eb9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6105c4d7d4342c9963e37c64009b74f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:06.399881 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fc437f66-c65a-4b38-a63f-c7348241eb9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6105c4d7d4342c9963e37c64009b74f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:06.407981 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fc437f66-c65a-4b38-a63f-c7348241eb9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6105c4d7d4342c9963e37c64009b74f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:06.416830 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fc437f66-c65a-4b38-a63f-c7348241eb9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6105c4d7d4342c9963e37c64009b74f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:06.424067 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1364/2683] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:33:06 2022] DELETE /identity/v3/users/a6105c4d7d4342c9963e37c64009b74f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:33:06.429129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f4b54-fcaf-49b1-a1c2-a86a54fd074c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:06.429434 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f4b54-fcaf-49b1-a1c2-a86a54fd074c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:06.429705 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f4b54-fcaf-49b1-a1c2-a86a54fd074c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:06.450910 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a39f4b54-fcaf-49b1-a1c2-a86a54fd074c None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:06.452260 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a39f4b54-fcaf-49b1-a1c2-a86a54fd074c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:06.471070 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:06.525014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1320/2684] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:33:06.538728 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc437f66-c65a-4b38-a63f-c7348241eb9a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:06.541748 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fc437f66-c65a-4b38-a63f-c7348241eb9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:06.605076 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f4b54-fcaf-49b1-a1c2-a86a54fd074c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:06.606633 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a39f4b54-fcaf-49b1-a1c2-a86a54fd074c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:06.615255 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc437f66-c65a-4b38-a63f-c7348241eb9a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:06.621261 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61f596-9e92-4d03-b008-6ecd1320923c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:06.622082 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61f596-9e92-4d03-b008-6ecd1320923c service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:06.622321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61f596-9e92-4d03-b008-6ecd1320923c service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:06.622615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61f596-9e92-4d03-b008-6ecd1320923c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:06.623528 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f4b54-fcaf-49b1-a1c2-a86a54fd074c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:06.628732 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b63ae-11fe-418e-8c26-4b1255b812d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:06.638318 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b63ae-11fe-418e-8c26-4b1255b812d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:06.638688 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b63ae-11fe-418e-8c26-4b1255b812d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:06.639045 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b63ae-11fe-418e-8c26-4b1255b812d7 admin admin] PATH_INFO: `/v3/projects/436543b013804c0981971749f97453bb` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:06.640475 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b63ae-11fe-418e-8c26-4b1255b812d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=436543b013804c0981971749f97453bb)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:06.642631 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61f596-9e92-4d03-b008-6ecd1320923c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:06.642941 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b63ae-11fe-418e-8c26-4b1255b812d7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:06.648090 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61f596-9e92-4d03-b008-6ecd1320923c service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:06.659783 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1365/2685] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:33:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:33:06.703151 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8b4b63ae-11fe-418e-8c26-4b1255b812d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '436543b013804c0981971749f97453bb', 'request_id': 'req-8b4b63ae-11fe-418e-8c26-4b1255b812d7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:06.710553 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8b4b63ae-11fe-418e-8c26-4b1255b812d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '436543b013804c0981971749f97453bb', 'request_id': 'req-8b4b63ae-11fe-418e-8c26-4b1255b812d7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:06.717739 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8b4b63ae-11fe-418e-8c26-4b1255b812d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '436543b013804c0981971749f97453bb', 'request_id': 'req-8b4b63ae-11fe-418e-8c26-4b1255b812d7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:06.733097 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8b4b63ae-11fe-418e-8c26-4b1255b812d7 admin admin] The token cache is being invalidate because project 436543b013804c0981971749f97453bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:33:06.733423 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8b4b63ae-11fe-418e-8c26-4b1255b812d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:06.734273 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8b4b63ae-11fe-418e-8c26-4b1255b812d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:06.736379 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1321/2686] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:33:06 2022] DELETE /identity/v3/projects/436543b013804c0981971749f97453bb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:33:06.741115 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61f596-9e92-4d03-b008-6ecd1320923c service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:06.754272 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61f596-9e92-4d03-b008-6ecd1320923c service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:06.821851 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4126d-6d1b-4c52-b5e4-787fa755ed05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:06.823053 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4126d-6d1b-4c52-b5e4-787fa755ed05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:06.823410 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4126d-6d1b-4c52-b5e4-787fa755ed05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:06.824224 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4126d-6d1b-4c52-b5e4-787fa755ed05 admin admin] PATH_INFO: `/v3/users/fffa4dda445a49b99719913b347f7914` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:06.826718 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4126d-6d1b-4c52-b5e4-787fa755ed05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fffa4dda445a49b99719913b347f7914)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:06.828663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4126d-6d1b-4c52-b5e4-787fa755ed05 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:06.902973 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-bbf4126d-6d1b-4c52-b5e4-787fa755ed05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fffa4dda445a49b99719913b347f7914'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:06.904675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-bbf4126d-6d1b-4c52-b5e4-787fa755ed05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fffa4dda445a49b99719913b347f7914'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:06.920421 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:06.922048 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-bbf4126d-6d1b-4c52-b5e4-787fa755ed05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fffa4dda445a49b99719913b347f7914'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:06.931728 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-bbf4126d-6d1b-4c52-b5e4-787fa755ed05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fffa4dda445a49b99719913b347f7914'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:06.940852 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-bbf4126d-6d1b-4c52-b5e4-787fa755ed05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fffa4dda445a49b99719913b347f7914'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:06.947998 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1366/2687] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:33:06 2022] DELETE /identity/v3/users/fffa4dda445a49b99719913b347f7914 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:33:07.038009 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b63ae-11fe-418e-8c26-4b1255b812d7 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:07.040526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8b4b63ae-11fe-418e-8c26-4b1255b812d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:07.054929 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b63ae-11fe-418e-8c26-4b1255b812d7 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:07.136319 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41fd31-9b4c-4fc3-b1a2-4e98163c990d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:07.137047 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41fd31-9b4c-4fc3-b1a2-4e98163c990d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:07.137325 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41fd31-9b4c-4fc3-b1a2-4e98163c990d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:07.137662 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41fd31-9b4c-4fc3-b1a2-4e98163c990d admin admin] PATH_INFO: `/v3/projects/bba455c260cd48e488d68245332a75d4` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:07.138972 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e41fd31-9b4c-4fc3-b1a2-4e98163c990d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bba455c260cd48e488d68245332a75d4)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:07.140898 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e41fd31-9b4c-4fc3-b1a2-4e98163c990d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:07.198008 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:07.201562 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1e41fd31-9b4c-4fc3-b1a2-4e98163c990d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bba455c260cd48e488d68245332a75d4', 'request_id': 'req-1e41fd31-9b4c-4fc3-b1a2-4e98163c990d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:07.210911 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1e41fd31-9b4c-4fc3-b1a2-4e98163c990d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bba455c260cd48e488d68245332a75d4', 'request_id': 'req-1e41fd31-9b4c-4fc3-b1a2-4e98163c990d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:07.218151 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1e41fd31-9b4c-4fc3-b1a2-4e98163c990d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bba455c260cd48e488d68245332a75d4', 'request_id': 'req-1e41fd31-9b4c-4fc3-b1a2-4e98163c990d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:07.232032 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1e41fd31-9b4c-4fc3-b1a2-4e98163c990d admin admin] The token cache is being invalidate because project bba455c260cd48e488d68245332a75d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:33:07.232329 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1e41fd31-9b4c-4fc3-b1a2-4e98163c990d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:07.233108 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1e41fd31-9b4c-4fc3-b1a2-4e98163c990d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:07.235211 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1322/2688] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:33:07 2022] DELETE /identity/v3/projects/bba455c260cd48e488d68245332a75d4 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:33:07.239233 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4126d-6d1b-4c52-b5e4-787fa755ed05 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:07.240783 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bbf4126d-6d1b-4c52-b5e4-787fa755ed05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:07.255011 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4126d-6d1b-4c52-b5e4-787fa755ed05 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:07.316875 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41fd31-9b4c-4fc3-b1a2-4e98163c990d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:07.319148 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1e41fd31-9b4c-4fc3-b1a2-4e98163c990d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:07.334214 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514b706-f5d9-4234-8380-fd99471200d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:07.335395 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514b706-f5d9-4234-8380-fd99471200d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:07.335677 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514b706-f5d9-4234-8380-fd99471200d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:07.335955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514b706-f5d9-4234-8380-fd99471200d2 admin admin] PATH_INFO: `/v3/users/bb881bd4a10948db9670ae26bf659e76` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:07.338252 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514b706-f5d9-4234-8380-fd99471200d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb881bd4a10948db9670ae26bf659e76)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:07.340578 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514b706-f5d9-4234-8380-fd99471200d2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:07.400877 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9514b706-f5d9-4234-8380-fd99471200d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb881bd4a10948db9670ae26bf659e76'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:07.402289 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9514b706-f5d9-4234-8380-fd99471200d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb881bd4a10948db9670ae26bf659e76'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:07.410407 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41fd31-9b4c-4fc3-b1a2-4e98163c990d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:07.416388 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9514b706-f5d9-4234-8380-fd99471200d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb881bd4a10948db9670ae26bf659e76'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:07.416530 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880d55e-3f68-4bd2-a3bf-9ec330fa1150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:07.417086 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880d55e-3f68-4bd2-a3bf-9ec330fa1150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:07.417466 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880d55e-3f68-4bd2-a3bf-9ec330fa1150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:07.417670 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880d55e-3f68-4bd2-a3bf-9ec330fa1150 admin admin] PATH_INFO: `/v3/projects/a3a1ee45152d471da864d8aa6b404b6f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:07.418979 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3880d55e-3f68-4bd2-a3bf-9ec330fa1150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3a1ee45152d471da864d8aa6b404b6f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:07.420889 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3880d55e-3f68-4bd2-a3bf-9ec330fa1150 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:07.423565 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9514b706-f5d9-4234-8380-fd99471200d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb881bd4a10948db9670ae26bf659e76'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:07.432621 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9514b706-f5d9-4234-8380-fd99471200d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb881bd4a10948db9670ae26bf659e76'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:07.438711 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1367/2689] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:33:07 2022] DELETE /identity/v3/users/bb881bd4a10948db9670ae26bf659e76 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:33:07.489545 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3880d55e-3f68-4bd2-a3bf-9ec330fa1150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3a1ee45152d471da864d8aa6b404b6f', 'request_id': 'req-3880d55e-3f68-4bd2-a3bf-9ec330fa1150'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:07.496524 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3880d55e-3f68-4bd2-a3bf-9ec330fa1150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3a1ee45152d471da864d8aa6b404b6f', 'request_id': 'req-3880d55e-3f68-4bd2-a3bf-9ec330fa1150'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:07.503187 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3880d55e-3f68-4bd2-a3bf-9ec330fa1150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3a1ee45152d471da864d8aa6b404b6f', 'request_id': 'req-3880d55e-3f68-4bd2-a3bf-9ec330fa1150'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:07.519208 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3880d55e-3f68-4bd2-a3bf-9ec330fa1150 admin admin] The token cache is being invalidate because project a3a1ee45152d471da864d8aa6b404b6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:33:07.519511 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3880d55e-3f68-4bd2-a3bf-9ec330fa1150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:07.520399 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3880d55e-3f68-4bd2-a3bf-9ec330fa1150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:07.523792 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1323/2690] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:33:07 2022] DELETE /identity/v3/projects/a3a1ee45152d471da864d8aa6b404b6f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:33:07.528043 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514b706-f5d9-4234-8380-fd99471200d2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:07.529382 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9514b706-f5d9-4234-8380-fd99471200d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:07.604377 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514b706-f5d9-4234-8380-fd99471200d2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:07.609497 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:07.667024 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c1218-9e0e-4b48-8040-c8c37630f349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:07.667713 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c1218-9e0e-4b48-8040-c8c37630f349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:07.667995 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c1218-9e0e-4b48-8040-c8c37630f349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:07.668275 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c1218-9e0e-4b48-8040-c8c37630f349 admin admin] PATH_INFO: `/v3/users/018d138a3e5c4c4385063784597b555a` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:07.669520 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c1218-9e0e-4b48-8040-c8c37630f349 admin admin] RBAC: Authorizing `identity:delete_user(user_id=018d138a3e5c4c4385063784597b555a)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:07.671840 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c1218-9e0e-4b48-8040-c8c37630f349 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:07.723439 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-441c1218-9e0e-4b48-8040-c8c37630f349 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '018d138a3e5c4c4385063784597b555a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:07.724336 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-441c1218-9e0e-4b48-8040-c8c37630f349 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '018d138a3e5c4c4385063784597b555a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:07.739693 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-441c1218-9e0e-4b48-8040-c8c37630f349 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '018d138a3e5c4c4385063784597b555a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:07.743000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880d55e-3f68-4bd2-a3bf-9ec330fa1150 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:07.744445 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3880d55e-3f68-4bd2-a3bf-9ec330fa1150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:07.747867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-441c1218-9e0e-4b48-8040-c8c37630f349 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '018d138a3e5c4c4385063784597b555a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:07.758406 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-441c1218-9e0e-4b48-8040-c8c37630f349 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '018d138a3e5c4c4385063784597b555a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:07.762908 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880d55e-3f68-4bd2-a3bf-9ec330fa1150 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:07.766439 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1368/2691] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:33:07 2022] DELETE /identity/v3/users/018d138a3e5c4c4385063784597b555a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:33:07.770887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953c73c-b321-400f-a4b3-968399b182bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:07.771568 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953c73c-b321-400f-a4b3-968399b182bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:07.771850 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953c73c-b321-400f-a4b3-968399b182bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:07.772125 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953c73c-b321-400f-a4b3-968399b182bf admin admin] PATH_INFO: `/v3/projects/eea6e943a8924efe9104f4a33c963fe3` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:07.773264 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953c73c-b321-400f-a4b3-968399b182bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=eea6e943a8924efe9104f4a33c963fe3)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:07.775530 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953c73c-b321-400f-a4b3-968399b182bf admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:07.834201 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1953c73c-b321-400f-a4b3-968399b182bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eea6e943a8924efe9104f4a33c963fe3', 'request_id': 'req-1953c73c-b321-400f-a4b3-968399b182bf'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:07.841208 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1953c73c-b321-400f-a4b3-968399b182bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eea6e943a8924efe9104f4a33c963fe3', 'request_id': 'req-1953c73c-b321-400f-a4b3-968399b182bf'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:07.844014 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:07.850894 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1953c73c-b321-400f-a4b3-968399b182bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eea6e943a8924efe9104f4a33c963fe3', 'request_id': 'req-1953c73c-b321-400f-a4b3-968399b182bf'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:07.868325 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1953c73c-b321-400f-a4b3-968399b182bf admin admin] The token cache is being invalidate because project eea6e943a8924efe9104f4a33c963fe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:33:07.868721 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1953c73c-b321-400f-a4b3-968399b182bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:07.869668 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1953c73c-b321-400f-a4b3-968399b182bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:07.871615 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1324/2692] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:33:07 2022] DELETE /identity/v3/projects/eea6e943a8924efe9104f4a33c963fe3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:33:07.877915 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2cee7-939a-4aaf-8690-1ac5959128b5 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:07.878205 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2cee7-939a-4aaf-8690-1ac5959128b5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:07.878559 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2cee7-939a-4aaf-8690-1ac5959128b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:07.901588 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-23b2cee7-939a-4aaf-8690-1ac5959128b5 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:07.902986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-23b2cee7-939a-4aaf-8690-1ac5959128b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:07.978054 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1369/2693] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:33:07.986243 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd40340-a543-4eeb-9ad3-09f1837d5fce None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:07.986520 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd40340-a543-4eeb-9ad3-09f1837d5fce None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:07.986797 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd40340-a543-4eeb-9ad3-09f1837d5fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:08.010492 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-edd40340-a543-4eeb-9ad3-09f1837d5fce None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:08.011801 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-edd40340-a543-4eeb-9ad3-09f1837d5fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:08.024496 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1325/2694] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:33:08.029115 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2cee7-939a-4aaf-8690-1ac5959128b5 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:08.041772 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2cee7-939a-4aaf-8690-1ac5959128b5 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:08.047834 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a6008-e1d7-4e2d-ad02-a870b1645a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:08.048663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a6008-e1d7-4e2d-ad02-a870b1645a88 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:08.049540 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a6008-e1d7-4e2d-ad02-a870b1645a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:08.052010 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a6008-e1d7-4e2d-ad02-a870b1645a88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:08.056316 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a6008-e1d7-4e2d-ad02-a870b1645a88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:33:08.056900 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a6008-e1d7-4e2d-ad02-a870b1645a88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:08.058832 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a6008-e1d7-4e2d-ad02-a870b1645a88 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:08.078104 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1370/2695] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:33:08.078901 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd40340-a543-4eeb-9ad3-09f1837d5fce None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:08.081056 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a6008-e1d7-4e2d-ad02-a870b1645a88 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:08.083052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7f9a6008-e1d7-4e2d-ad02-a870b1645a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:08.091706 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd40340-a543-4eeb-9ad3-09f1837d5fce None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:08.097891 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a6008-e1d7-4e2d-ad02-a870b1645a88 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:08.099464 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfdfa4-c114-4d72-915c-20aa9f113af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:08.102643 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfdfa4-c114-4d72-915c-20aa9f113af6 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:08.102931 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfdfa4-c114-4d72-915c-20aa9f113af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:08.103203 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfdfa4-c114-4d72-915c-20aa9f113af6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:08.103861 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecfdfa4-c114-4d72-915c-20aa9f113af6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:08.105806 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecfdfa4-c114-4d72-915c-20aa9f113af6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:08.116062 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b2a56-498e-4406-889d-8cc743cfef81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:08.116833 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b2a56-498e-4406-889d-8cc743cfef81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:08.117218 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b2a56-498e-4406-889d-8cc743cfef81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:08.117428 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b2a56-498e-4406-889d-8cc743cfef81 admin admin] PATH_INFO: `/v3/projects/2ebff752cd8a49fbab7d6f0910626fcc` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:08.118608 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b2a56-498e-4406-889d-8cc743cfef81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ebff752cd8a49fbab7d6f0910626fcc)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:08.120688 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b2a56-498e-4406-889d-8cc743cfef81 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:08.129890 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:08.153849 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1326/2696] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:33:08 2022] POST /identity/v3/projects => generated 377 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:33:08.158172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfdfa4-c114-4d72-915c-20aa9f113af6 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:08.209857 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e77b2a56-498e-4406-889d-8cc743cfef81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ebff752cd8a49fbab7d6f0910626fcc', 'request_id': 'req-e77b2a56-498e-4406-889d-8cc743cfef81'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:08.216472 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e77b2a56-498e-4406-889d-8cc743cfef81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ebff752cd8a49fbab7d6f0910626fcc', 'request_id': 'req-e77b2a56-498e-4406-889d-8cc743cfef81'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:08.223729 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e77b2a56-498e-4406-889d-8cc743cfef81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ebff752cd8a49fbab7d6f0910626fcc', 'request_id': 'req-e77b2a56-498e-4406-889d-8cc743cfef81'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:08.241533 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e77b2a56-498e-4406-889d-8cc743cfef81 admin admin] The token cache is being invalidate because project 2ebff752cd8a49fbab7d6f0910626fcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:33:08.242089 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e77b2a56-498e-4406-889d-8cc743cfef81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:08.243459 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e77b2a56-498e-4406-889d-8cc743cfef81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:08.245743 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1371/2697] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:33:08 2022] DELETE /identity/v3/projects/2ebff752cd8a49fbab7d6f0910626fcc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:33:08.251182 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37669ea-414a-4518-9872-2e9962e97a22 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:08.251465 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37669ea-414a-4518-9872-2e9962e97a22 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:08.251740 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37669ea-414a-4518-9872-2e9962e97a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:08.258859 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfdfa4-c114-4d72-915c-20aa9f113af6 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:08.277274 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b37669ea-414a-4518-9872-2e9962e97a22 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:08.278547 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b37669ea-414a-4518-9872-2e9962e97a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:08.337152 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a07cf-c104-478f-9eb7-a62a7626d6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:08.337938 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a07cf-c104-478f-9eb7-a62a7626d6ee admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:08.338233 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a07cf-c104-478f-9eb7-a62a7626d6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:08.338485 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a07cf-c104-478f-9eb7-a62a7626d6ee admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:08.339139 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a07cf-c104-478f-9eb7-a62a7626d6ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:08.341216 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a07cf-c104-478f-9eb7-a62a7626d6ee admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:08.368105 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1327/2698] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:33:08 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:33:08.369286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a07cf-c104-478f-9eb7-a62a7626d6ee admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:08.370700 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1372/2699] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:33:08.371025 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b36a07cf-c104-478f-9eb7-a62a7626d6ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:08.378943 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7be4a8-f4b2-48e1-b251-5120582aa66d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:08.379517 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7be4a8-f4b2-48e1-b251-5120582aa66d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:08.381307 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7be4a8-f4b2-48e1-b251-5120582aa66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:08.384366 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a07cf-c104-478f-9eb7-a62a7626d6ee admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:08.389292 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789c49d-68ec-4a1b-9daf-d36e608ed6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:08.389919 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789c49d-68ec-4a1b-9daf-d36e608ed6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:08.390193 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789c49d-68ec-4a1b-9daf-d36e608ed6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:08.390458 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789c49d-68ec-4a1b-9daf-d36e608ed6f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:08.391295 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789c49d-68ec-4a1b-9daf-d36e608ed6f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:08.393923 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789c49d-68ec-4a1b-9daf-d36e608ed6f0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:08.403473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1f7be4a8-f4b2-48e1-b251-5120582aa66d None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:08.404704 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1f7be4a8-f4b2-48e1-b251-5120582aa66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:08.405289 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1328/2700] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:33:08.409149 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789c49d-68ec-4a1b-9daf-d36e608ed6f0 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:08.414210 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1373/2701] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:33:08.418397 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7be4a8-f4b2-48e1-b251-5120582aa66d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:08.420080 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789c49d-68ec-4a1b-9daf-d36e608ed6f0 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:08.426484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957543c6-d8e8-46e1-a1b6-36d5e1be6ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:08.427078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957543c6-d8e8-46e1-a1b6-36d5e1be6ecb admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:08.427358 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957543c6-d8e8-46e1-a1b6-36d5e1be6ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:08.427630 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957543c6-d8e8-46e1-a1b6-36d5e1be6ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:08.428487 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7be4a8-f4b2-48e1-b251-5120582aa66d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:08.428847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957543c6-d8e8-46e1-a1b6-36d5e1be6ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:08.430465 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957543c6-d8e8-46e1-a1b6-36d5e1be6ecb admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:08.434511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642af560-ff0d-420c-a7d5-a0b93ffe2f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:08.435196 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642af560-ff0d-420c-a7d5-a0b93ffe2f2a admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:08.435538 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642af560-ff0d-420c-a7d5-a0b93ffe2f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:08.436281 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642af560-ff0d-420c-a7d5-a0b93ffe2f2a admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:08.437001 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642af560-ff0d-420c-a7d5-a0b93ffe2f2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:33:08.437631 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642af560-ff0d-420c-a7d5-a0b93ffe2f2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:08.439388 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642af560-ff0d-420c-a7d5-a0b93ffe2f2a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:08.442200 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1329/2702] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:33:08.447136 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957543c6-d8e8-46e1-a1b6-36d5e1be6ecb admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:08.453307 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1374/2703] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:33:08.457286 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957543c6-d8e8-46e1-a1b6-36d5e1be6ecb admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:08.457460 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642af560-ff0d-420c-a7d5-a0b93ffe2f2a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:08.463229 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24226ee-8488-458f-9a78-f0c9193fab83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:08.464080 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24226ee-8488-458f-9a78-f0c9193fab83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:08.464358 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24226ee-8488-458f-9a78-f0c9193fab83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:08.465219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24226ee-8488-458f-9a78-f0c9193fab83 admin admin] PATH_INFO: `/v3/projects/10b21d1729a44b08a4e532bed7b26976/users/a5fde76de29b443faebaa573f2bfcc62/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:08.468341 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642af560-ff0d-420c-a7d5-a0b93ffe2f2a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:08.473077 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c547f5-7b5b-49a7-bd63-9fbbd30c1122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:08.473700 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c547f5-7b5b-49a7-bd63-9fbbd30c1122 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:08.473977 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c547f5-7b5b-49a7-bd63-9fbbd30c1122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:08.474245 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c547f5-7b5b-49a7-bd63-9fbbd30c1122 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:08.474914 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c547f5-7b5b-49a7-bd63-9fbbd30c1122 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:08.476809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c547f5-7b5b-49a7-bd63-9fbbd30c1122 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:08.481120 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24226ee-8488-458f-9a78-f0c9193fab83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10b21d1729a44b08a4e532bed7b26976, user_id=a5fde76de29b443faebaa573f2bfcc62, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:08.484037 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24226ee-8488-458f-9a78-f0c9193fab83 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:08.498452 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1330/2704] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:33:08 2022] PUT /identity/v3/projects/10b21d1729a44b08a4e532bed7b26976/users/a5fde76de29b443faebaa573f2bfcc62/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:33:08.510492 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1375/2705] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:33:08 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:33:08.512165 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da4565-6e21-408d-991e-22852f3ca20c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:08.512165 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da4565-6e21-408d-991e-22852f3ca20c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:08.512372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da4565-6e21-408d-991e-22852f3ca20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:08.512665 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c547f5-7b5b-49a7-bd63-9fbbd30c1122 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:08.544530 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:08.556001 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d9da4565-6e21-408d-991e-22852f3ca20c None None] MFA Rules not processed for user `a5fde76de29b443faebaa573f2bfcc62`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:08.558291 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d9da4565-6e21-408d-991e-22852f3ca20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:08.587126 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:08.593655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c547f5-7b5b-49a7-bd63-9fbbd30c1122 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:08.600653 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da651f-ec0c-43a1-97d1-0baf2433844c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:08.602357 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da651f-ec0c-43a1-97d1-0baf2433844c admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:08.603867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da651f-ec0c-43a1-97d1-0baf2433844c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:08.604481 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da651f-ec0c-43a1-97d1-0baf2433844c admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:08.605514 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da651f-ec0c-43a1-97d1-0baf2433844c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:08.608029 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da651f-ec0c-43a1-97d1-0baf2433844c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:08.641558 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1376/2706] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:33:08 2022] POST /identity/v3/users => generated 291 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:33:08.646000 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da651f-ec0c-43a1-97d1-0baf2433844c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:08.652165 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1331/2707] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:33:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:33:08.656416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da651f-ec0c-43a1-97d1-0baf2433844c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:08.661212 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4d801-399e-4e42-b2e0-4060cdf50ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:08.661860 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4d801-399e-4e42-b2e0-4060cdf50ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:08.662168 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4d801-399e-4e42-b2e0-4060cdf50ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:08.662715 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4d801-399e-4e42-b2e0-4060cdf50ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:08.663536 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4d801-399e-4e42-b2e0-4060cdf50ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:08.663656 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da4565-6e21-408d-991e-22852f3ca20c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:08.664766 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4d801-399e-4e42-b2e0-4060cdf50ca0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:08.665056 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d9da4565-6e21-408d-991e-22852f3ca20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:08.678470 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1377/2708] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:33:08.679954 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4d801-399e-4e42-b2e0-4060cdf50ca0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:08.691360 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4d801-399e-4e42-b2e0-4060cdf50ca0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:08.696707 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c32e1-a9e8-428b-b287-6ea0240b46cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:08.697306 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c32e1-a9e8-428b-b287-6ea0240b46cc admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:08.697621 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c32e1-a9e8-428b-b287-6ea0240b46cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:08.697893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c32e1-a9e8-428b-b287-6ea0240b46cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:08.698530 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c32e1-a9e8-428b-b287-6ea0240b46cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:08.700162 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c32e1-a9e8-428b-b287-6ea0240b46cc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:08.711052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1378/2709] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:33:08.715445 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c32e1-a9e8-428b-b287-6ea0240b46cc admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:08.726206 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c32e1-a9e8-428b-b287-6ea0240b46cc admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:08.731106 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f8c69-8cc8-4023-8c6b-4d3b88bb197b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:08.731754 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f8c69-8cc8-4023-8c6b-4d3b88bb197b admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:08.732030 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f8c69-8cc8-4023-8c6b-4d3b88bb197b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:08.732298 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f8c69-8cc8-4023-8c6b-4d3b88bb197b admin admin] PATH_INFO: `/v3/projects/9d78567724404af18ad7ec631a910cb9/users/e6034a122b714868bf4027560513cc3e/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:08.735076 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da4565-6e21-408d-991e-22852f3ca20c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:08.739839 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7fa7c3-329a-43d7-ba95-d5e978165468 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6647f3aa54dc68e888b3adb8c28b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:08.741042 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fa7c3-329a-43d7-ba95-d5e978165468 service glance] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:08.741312 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fa7c3-329a-43d7-ba95-d5e978165468 service glance] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:08.741611 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fa7c3-329a-43d7-ba95-d5e978165468 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:08.749494 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f8c69-8cc8-4023-8c6b-4d3b88bb197b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d78567724404af18ad7ec631a910cb9, user_id=e6034a122b714868bf4027560513cc3e, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:08.752499 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fa7c3-329a-43d7-ba95-d5e978165468 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:08.753393 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f8c69-8cc8-4023-8c6b-4d3b88bb197b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:08.754076 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fa7c3-329a-43d7-ba95-d5e978165468 service glance] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:08.772145 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1332/2710] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:33:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:33:08.772691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1379/2711] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:33:08 2022] PUT /identity/v3/projects/9d78567724404af18ad7ec631a910cb9/users/e6034a122b714868bf4027560513cc3e/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:33:08.784491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c95118-6bed-4074-9819-c774fbc9b151 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:08.785016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c95118-6bed-4074-9819-c774fbc9b151 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:08.785287 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c95118-6bed-4074-9819-c774fbc9b151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:08.799324 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1ed37-fb5c-4aeb-9cd8-5b85f6c9643f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:08.799593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1ed37-fb5c-4aeb-9cd8-5b85f6c9643f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:08.799874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1ed37-fb5c-4aeb-9cd8-5b85f6c9643f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:08.817646 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b2c95118-6bed-4074-9819-c774fbc9b151 None None] MFA Rules not processed for user `e6034a122b714868bf4027560513cc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:08.819470 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b2c95118-6bed-4074-9819-c774fbc9b151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:08.822612 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0bf1ed37-fb5c-4aeb-9cd8-5b85f6c9643f None None] MFA Rules not processed for user `9e7444bc40314e73b282217bbb94798d`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:08.824065 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0bf1ed37-fb5c-4aeb-9cd8-5b85f6c9643f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:08.895281 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1380/2712] 10.222.0.94 () {58 vars in 1009 bytes} [Thu Sep 1 17:33:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:33:08.906362 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1333/2713] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:33:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:33:08.914798 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1ed37-fb5c-4aeb-9cd8-5b85f6c9643f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:08.923362 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c95118-6bed-4074-9819-c774fbc9b151 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:08.925638 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b2c95118-6bed-4074-9819-c774fbc9b151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:08.966015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:08.988473 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1ed37-fb5c-4aeb-9cd8-5b85f6c9643f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:08.994628 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fd0d5-94fd-4909-ba95-40cc1635cf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:08.995241 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fd0d5-94fd-4909-ba95-40cc1635cf4e admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:08.995521 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fd0d5-94fd-4909-ba95-40cc1635cf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:08.995809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fd0d5-94fd-4909-ba95-40cc1635cf4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:08.996419 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8fd0d5-94fd-4909-ba95-40cc1635cf4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:08.998870 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8fd0d5-94fd-4909-ba95-40cc1635cf4e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:09.005559 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c95118-6bed-4074-9819-c774fbc9b151 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:09.011472 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fbc6a-6a20-471b-b1d8-9325d70f3c21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7ebf43f36c4862a3c527941e033666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:09.012081 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fbc6a-6a20-471b-b1d8-9325d70f3c21 service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:09.012361 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fbc6a-6a20-471b-b1d8-9325d70f3c21 service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:09.012631 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fbc6a-6a20-471b-b1d8-9325d70f3c21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:09.022869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9fbc6a-6a20-471b-b1d8-9325d70f3c21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:09.024552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9fbc6a-6a20-471b-b1d8-9325d70f3c21 service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:09.030657 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1381/2714] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:33:08 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:33:09.033759 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1334/2715] 10.222.0.94 () {60 vars in 1384 bytes} [Thu Sep 1 17:33:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 17:33:09.039021 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fd0d5-94fd-4909-ba95-40cc1635cf4e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:09.076587 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:09.131955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fd0d5-94fd-4909-ba95-40cc1635cf4e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:09.140708 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3901f-c622-4b27-a06a-7707bb569fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:09.141439 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3901f-c622-4b27-a06a-7707bb569fcc admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:09.141827 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3901f-c622-4b27-a06a-7707bb569fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:09.142273 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3901f-c622-4b27-a06a-7707bb569fcc admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:09.143027 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3901f-c622-4b27-a06a-7707bb569fcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:09.145771 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3901f-c622-4b27-a06a-7707bb569fcc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:09.175044 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1382/2716] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:33:09 2022] POST /identity/v3/users => generated 297 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:33:09.180928 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fbc6a-6a20-471b-b1d8-9325d70f3c21 service swift] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:09.200827 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fbc6a-6a20-471b-b1d8-9325d70f3c21 service swift] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:09.213139 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d0af0-c8b0-4689-8f9a-dd630e74b635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:09.213828 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d0af0-c8b0-4689-8f9a-dd630e74b635 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:09.214101 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d0af0-c8b0-4689-8f9a-dd630e74b635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:09.214371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d0af0-c8b0-4689-8f9a-dd630e74b635 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:09.215150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d0af0-c8b0-4689-8f9a-dd630e74b635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:09.218058 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d0af0-c8b0-4689-8f9a-dd630e74b635 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:09.247104 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1335/2717] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:33:09.249804 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3901f-c622-4b27-a06a-7707bb569fcc admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:09.265281 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3901f-c622-4b27-a06a-7707bb569fcc admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:09.278049 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40207e-b286-4219-ba11-4addba5e7690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:09.279101 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40207e-b286-4219-ba11-4addba5e7690 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:09.279583 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40207e-b286-4219-ba11-4addba5e7690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:09.279881 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40207e-b286-4219-ba11-4addba5e7690 admin admin] PATH_INFO: `/v3/projects/4d411463ae2144269d48f4f87939628b/users/a0afb1be308a43b7a86216629403468a/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:09.326480 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40207e-b286-4219-ba11-4addba5e7690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d411463ae2144269d48f4f87939628b, user_id=a0afb1be308a43b7a86216629403468a, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:09.330148 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40207e-b286-4219-ba11-4addba5e7690 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:09.379776 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1383/2718] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:33:09 2022] PUT /identity/v3/projects/4d411463ae2144269d48f4f87939628b/users/a0afb1be308a43b7a86216629403468a/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:33:09.386392 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d0af0-c8b0-4689-8f9a-dd630e74b635 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:09.415665 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d0af0-c8b0-4689-8f9a-dd630e74b635 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:09.577432 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce8721-a7a1-46ed-b2a7-3c41cff7f0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:09.577432 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce8721-a7a1-46ed-b2a7-3c41cff7f0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:09.577432 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce8721-a7a1-46ed-b2a7-3c41cff7f0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:09.577432 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce8721-a7a1-46ed-b2a7-3c41cff7f0f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:09.578447 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce8721-a7a1-46ed-b2a7-3c41cff7f0f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:09.578447 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce8721-a7a1-46ed-b2a7-3c41cff7f0f3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:09.586966 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1336/2719] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:33:09.592402 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40207e-b286-4219-ba11-4addba5e7690 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:09.614482 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40207e-b286-4219-ba11-4addba5e7690 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:09.624620 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e745b-6ab0-4701-ab32-c44d7dc798cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:09.625804 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e745b-6ab0-4701-ab32-c44d7dc798cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:09.626342 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e745b-6ab0-4701-ab32-c44d7dc798cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:09.626846 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e745b-6ab0-4701-ab32-c44d7dc798cf admin admin] PATH_INFO: `/v3/projects/4d411463ae2144269d48f4f87939628b/users/a0afb1be308a43b7a86216629403468a/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:09.629947 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e745b-6ab0-4701-ab32-c44d7dc798cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d411463ae2144269d48f4f87939628b, user_id=a0afb1be308a43b7a86216629403468a, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:09.634099 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e745b-6ab0-4701-ab32-c44d7dc798cf admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:09.660520 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1384/2720] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:33:09 2022] PUT /identity/v3/projects/4d411463ae2144269d48f4f87939628b/users/a0afb1be308a43b7a86216629403468a/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:33:09.666023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664403a-adc5-4bfc-9bc0-087991e28087 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:09.666928 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664403a-adc5-4bfc-9bc0-087991e28087 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:09.668156 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664403a-adc5-4bfc-9bc0-087991e28087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:09.701622 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e664403a-adc5-4bfc-9bc0-087991e28087 None None] MFA Rules not processed for user `a0afb1be308a43b7a86216629403468a`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:09.703139 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e664403a-adc5-4bfc-9bc0-087991e28087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:09.829219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1337/2721] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:33:09 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:33:09.848918 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e745b-6ab0-4701-ab32-c44d7dc798cf admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:09.852939 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ea7e745b-6ab0-4701-ab32-c44d7dc798cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:09.964539 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e745b-6ab0-4701-ab32-c44d7dc798cf admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:09.970599 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ecdfcb-55b4-40a9-b65f-68cf7acc512b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:09.971542 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecdfcb-55b4-40a9-b65f-68cf7acc512b service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:09.971963 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecdfcb-55b4-40a9-b65f-68cf7acc512b service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:09.972245 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecdfcb-55b4-40a9-b65f-68cf7acc512b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:09.993390 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ecdfcb-55b4-40a9-b65f-68cf7acc512b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:09.994920 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ecdfcb-55b4-40a9-b65f-68cf7acc512b service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:10.016876 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1385/2722] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:33:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:33:10.486000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664403a-adc5-4bfc-9bc0-087991e28087 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:10.554042 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:10.620389 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664403a-adc5-4bfc-9bc0-087991e28087 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:10.625459 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717eed2-aef1-4cd9-82bb-1b505c2c92a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:10.626242 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717eed2-aef1-4cd9-82bb-1b505c2c92a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:10.626679 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717eed2-aef1-4cd9-82bb-1b505c2c92a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:10.627041 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717eed2-aef1-4cd9-82bb-1b505c2c92a0 admin admin] PATH_INFO: `/v3/users/e6034a122b714868bf4027560513cc3e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:10.628267 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717eed2-aef1-4cd9-82bb-1b505c2c92a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6034a122b714868bf4027560513cc3e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:10.630330 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717eed2-aef1-4cd9-82bb-1b505c2c92a0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:10.727352 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8717eed2-aef1-4cd9-82bb-1b505c2c92a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6034a122b714868bf4027560513cc3e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:10.728080 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8717eed2-aef1-4cd9-82bb-1b505c2c92a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6034a122b714868bf4027560513cc3e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:10.746366 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8717eed2-aef1-4cd9-82bb-1b505c2c92a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6034a122b714868bf4027560513cc3e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:10.746836 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8717eed2-aef1-4cd9-82bb-1b505c2c92a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6034a122b714868bf4027560513cc3e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:10.758758 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8717eed2-aef1-4cd9-82bb-1b505c2c92a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6034a122b714868bf4027560513cc3e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:10.791157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1338/2723] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:33:10 2022] DELETE /identity/v3/users/e6034a122b714868bf4027560513cc3e => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:33:10.794184 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0ad90-a30a-4ff4-b634-c4b94c2569a1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:10.794470 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0ad90-a30a-4ff4-b634-c4b94c2569a1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:10.795497 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0ad90-a30a-4ff4-b634-c4b94c2569a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:10.832992 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-30d0ad90-a30a-4ff4-b634-c4b94c2569a1 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:10.834310 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-30d0ad90-a30a-4ff4-b634-c4b94c2569a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:10.920070 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1386/2724] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:33:10.930687 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717eed2-aef1-4cd9-82bb-1b505c2c92a0 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:10.932146 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8717eed2-aef1-4cd9-82bb-1b505c2c92a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:10.989297 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717eed2-aef1-4cd9-82bb-1b505c2c92a0 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:10.999314 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11de9e-3b73-4239-98cc-4a891defb0e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:11.000002 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11de9e-3b73-4239-98cc-4a891defb0e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:11.000312 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11de9e-3b73-4239-98cc-4a891defb0e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:11.000585 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11de9e-3b73-4239-98cc-4a891defb0e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:11.016401 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11de9e-3b73-4239-98cc-4a891defb0e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:11.019293 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11de9e-3b73-4239-98cc-4a891defb0e6 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:11.034884 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1339/2725] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:33:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:33:11.344395 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0ad90-a30a-4ff4-b634-c4b94c2569a1 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:11.345970 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-30d0ad90-a30a-4ff4-b634-c4b94c2569a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:11.360802 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0ad90-a30a-4ff4-b634-c4b94c2569a1 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:11.366761 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0032a-842a-47e9-a5d0-da74e75587ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:11.368063 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0032a-842a-47e9-a5d0-da74e75587ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:11.368351 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0032a-842a-47e9-a5d0-da74e75587ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:11.368663 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0032a-842a-47e9-a5d0-da74e75587ef admin admin] PATH_INFO: `/v3/projects/9d78567724404af18ad7ec631a910cb9` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:11.374416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0032a-842a-47e9-a5d0-da74e75587ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d78567724404af18ad7ec631a910cb9)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:11.377706 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0032a-842a-47e9-a5d0-da74e75587ef admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:11.410625 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:11.439052 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d4d0032a-842a-47e9-a5d0-da74e75587ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d78567724404af18ad7ec631a910cb9', 'request_id': 'req-d4d0032a-842a-47e9-a5d0-da74e75587ef'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:11.444437 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d4d0032a-842a-47e9-a5d0-da74e75587ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d78567724404af18ad7ec631a910cb9', 'request_id': 'req-d4d0032a-842a-47e9-a5d0-da74e75587ef'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:11.450764 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d4d0032a-842a-47e9-a5d0-da74e75587ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d78567724404af18ad7ec631a910cb9', 'request_id': 'req-d4d0032a-842a-47e9-a5d0-da74e75587ef'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:11.470241 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d4d0032a-842a-47e9-a5d0-da74e75587ef admin admin] The token cache is being invalidate because project 9d78567724404af18ad7ec631a910cb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:33:11.470529 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d4d0032a-842a-47e9-a5d0-da74e75587ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:11.471187 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d4d0032a-842a-47e9-a5d0-da74e75587ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:11.472980 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1387/2726] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:33:11 2022] DELETE /identity/v3/projects/9d78567724404af18ad7ec631a910cb9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:33:11.477292 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11de9e-3b73-4239-98cc-4a891defb0e6 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:11.487904 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11de9e-3b73-4239-98cc-4a891defb0e6 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:11.564651 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:11.580018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0e142-a173-4fe8-8154-c36916d89d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:11.580755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0e142-a173-4fe8-8154-c36916d89d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:11.581101 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0e142-a173-4fe8-8154-c36916d89d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:11.581506 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0e142-a173-4fe8-8154-c36916d89d15 admin admin] PATH_INFO: `/v3/users/a0afb1be308a43b7a86216629403468a` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:11.583522 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0e142-a173-4fe8-8154-c36916d89d15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0afb1be308a43b7a86216629403468a)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:11.586492 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0e142-a173-4fe8-8154-c36916d89d15 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:11.654570 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d3b0e142-a173-4fe8-8154-c36916d89d15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0afb1be308a43b7a86216629403468a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:11.655364 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d3b0e142-a173-4fe8-8154-c36916d89d15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0afb1be308a43b7a86216629403468a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:11.674634 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d3b0e142-a173-4fe8-8154-c36916d89d15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0afb1be308a43b7a86216629403468a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:11.675443 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d3b0e142-a173-4fe8-8154-c36916d89d15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0afb1be308a43b7a86216629403468a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:11.686739 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d3b0e142-a173-4fe8-8154-c36916d89d15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0afb1be308a43b7a86216629403468a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:11.717061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1340/2727] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:33:11 2022] DELETE /identity/v3/users/a0afb1be308a43b7a86216629403468a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:33:12.140041 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0032a-842a-47e9-a5d0-da74e75587ef admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:12.141990 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d4d0032a-842a-47e9-a5d0-da74e75587ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:12.179331 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0032a-842a-47e9-a5d0-da74e75587ef admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:12.262438 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119d017-9fa4-45bf-968a-b544876ed006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:12.263133 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119d017-9fa4-45bf-968a-b544876ed006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:12.263416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119d017-9fa4-45bf-968a-b544876ed006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:12.263693 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119d017-9fa4-45bf-968a-b544876ed006 admin admin] PATH_INFO: `/v3/projects/4d411463ae2144269d48f4f87939628b` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:12.264864 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119d017-9fa4-45bf-968a-b544876ed006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d411463ae2144269d48f4f87939628b)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:12.266834 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119d017-9fa4-45bf-968a-b544876ed006 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:12.313589 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5119d017-9fa4-45bf-968a-b544876ed006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d411463ae2144269d48f4f87939628b', 'request_id': 'req-5119d017-9fa4-45bf-968a-b544876ed006'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:12.319714 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5119d017-9fa4-45bf-968a-b544876ed006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d411463ae2144269d48f4f87939628b', 'request_id': 'req-5119d017-9fa4-45bf-968a-b544876ed006'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:12.326253 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5119d017-9fa4-45bf-968a-b544876ed006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d411463ae2144269d48f4f87939628b', 'request_id': 'req-5119d017-9fa4-45bf-968a-b544876ed006'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:12.340952 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5119d017-9fa4-45bf-968a-b544876ed006 admin admin] The token cache is being invalidate because project 4d411463ae2144269d48f4f87939628b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:33:12.341314 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5119d017-9fa4-45bf-968a-b544876ed006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:12.341959 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5119d017-9fa4-45bf-968a-b544876ed006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:12.347375 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1388/2728] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:33:12 2022] DELETE /identity/v3/projects/4d411463ae2144269d48f4f87939628b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:33:12.349894 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473f507-ccce-4263-8b97-8646e0accf4a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:12.350392 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473f507-ccce-4263-8b97-8646e0accf4a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:12.350805 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473f507-ccce-4263-8b97-8646e0accf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:12.378021 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-4473f507-ccce-4263-8b97-8646e0accf4a None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:12.379266 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4473f507-ccce-4263-8b97-8646e0accf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:12.454707 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1341/2729] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:33:12.463320 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6f1c2-da48-4db2-a29d-64e7690649a9 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:12.463593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6f1c2-da48-4db2-a29d-64e7690649a9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:12.463862 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6f1c2-da48-4db2-a29d-64e7690649a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:12.486845 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-7da6f1c2-da48-4db2-a29d-64e7690649a9 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:12.488089 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7da6f1c2-da48-4db2-a29d-64e7690649a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:12.496105 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1389/2730] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:33:12.500519 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473f507-ccce-4263-8b97-8646e0accf4a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:12.510391 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473f507-ccce-4263-8b97-8646e0accf4a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:12.514925 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d19817-5db2-44a0-893b-8eafdc0c64db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:12.515524 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d19817-5db2-44a0-893b-8eafdc0c64db admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:12.515803 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d19817-5db2-44a0-893b-8eafdc0c64db admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:12.516080 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d19817-5db2-44a0-893b-8eafdc0c64db admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:12.516724 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d19817-5db2-44a0-893b-8eafdc0c64db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:33:12.517035 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d19817-5db2-44a0-893b-8eafdc0c64db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:12.518670 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d19817-5db2-44a0-893b-8eafdc0c64db admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:12.531775 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1342/2731] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:33:12.535103 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6f1c2-da48-4db2-a29d-64e7690649a9 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:12.544937 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6f1c2-da48-4db2-a29d-64e7690649a9 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:12.549606 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45b6c2-8a00-49d4-bcc2-07e57ade2829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:12.550201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45b6c2-8a00-49d4-bcc2-07e57ade2829 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:12.550489 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45b6c2-8a00-49d4-bcc2-07e57ade2829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:12.550760 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45b6c2-8a00-49d4-bcc2-07e57ade2829 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:12.551400 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45b6c2-8a00-49d4-bcc2-07e57ade2829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:12.553654 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45b6c2-8a00-49d4-bcc2-07e57ade2829 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:12.588088 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1390/2732] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:33:12 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:33:12.589338 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d19817-5db2-44a0-893b-8eafdc0c64db admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:12.599541 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d19817-5db2-44a0-893b-8eafdc0c64db admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:12.673836 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37316d4-c268-4bbf-8ed8-8a6fa774b064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:12.674495 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37316d4-c268-4bbf-8ed8-8a6fa774b064 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:12.675075 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37316d4-c268-4bbf-8ed8-8a6fa774b064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:12.675075 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37316d4-c268-4bbf-8ed8-8a6fa774b064 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:12.675624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37316d4-c268-4bbf-8ed8-8a6fa774b064 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:12.678205 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37316d4-c268-4bbf-8ed8-8a6fa774b064 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:12.687459 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:12.718543 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1343/2733] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:33:12 2022] POST /identity/v3/users => generated 291 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:33:12.719226 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45b6c2-8a00-49d4-bcc2-07e57ade2829 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:12.733530 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45b6c2-8a00-49d4-bcc2-07e57ade2829 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:12.738284 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935da31-4136-49d1-9557-33269dd056b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:12.739242 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935da31-4136-49d1-9557-33269dd056b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:12.739525 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935da31-4136-49d1-9557-33269dd056b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:12.739830 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935da31-4136-49d1-9557-33269dd056b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:12.740524 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935da31-4136-49d1-9557-33269dd056b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:12.742553 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935da31-4136-49d1-9557-33269dd056b5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:12.745310 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:12.770078 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37316d4-c268-4bbf-8ed8-8a6fa774b064 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:12.770446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1391/2734] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:33:12.781884 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37316d4-c268-4bbf-8ed8-8a6fa774b064 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:12.786685 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5464f5-466e-4a88-8e3c-724402a82044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:12.787460 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5464f5-466e-4a88-8e3c-724402a82044 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:12.787808 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5464f5-466e-4a88-8e3c-724402a82044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:12.788152 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5464f5-466e-4a88-8e3c-724402a82044 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:12.788912 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5464f5-466e-4a88-8e3c-724402a82044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:12.790663 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5464f5-466e-4a88-8e3c-724402a82044 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:12.804582 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1344/2735] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:33:12.805757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935da31-4136-49d1-9557-33269dd056b5 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:12.816032 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935da31-4136-49d1-9557-33269dd056b5 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:12.821643 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b803d2-909f-440e-9a06-a000ab083159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:12.822325 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b803d2-909f-440e-9a06-a000ab083159 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:12.822608 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b803d2-909f-440e-9a06-a000ab083159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:12.822878 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b803d2-909f-440e-9a06-a000ab083159 admin admin] PATH_INFO: `/v3/projects/5c63692c197f4fba96a19a3fbf36dac1/users/3b22d7afbd9a4babac259dc9ab9297ff/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:12.860596 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b803d2-909f-440e-9a06-a000ab083159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c63692c197f4fba96a19a3fbf36dac1, user_id=3b22d7afbd9a4babac259dc9ab9297ff, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:12.863607 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b803d2-909f-440e-9a06-a000ab083159 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:12.881984 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1392/2736] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:33:12 2022] PUT /identity/v3/projects/5c63692c197f4fba96a19a3fbf36dac1/users/3b22d7afbd9a4babac259dc9ab9297ff/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:33:12.887252 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34bdf5-e154-4d41-bbe8-d612412167fd None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:12.887547 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34bdf5-e154-4d41-bbe8-d612412167fd None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:12.887873 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34bdf5-e154-4d41-bbe8-d612412167fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:12.914284 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ec34bdf5-e154-4d41-bbe8-d612412167fd None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:12.915526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ec34bdf5-e154-4d41-bbe8-d612412167fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:12.980378 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1345/2737] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:33:12.990548 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b803d2-909f-440e-9a06-a000ab083159 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:12.992261 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c6b803d2-909f-440e-9a06-a000ab083159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:13.181395 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b803d2-909f-440e-9a06-a000ab083159 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:13.184960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eca491-0e06-4bd1-bf54-bd519b819509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:13.185597 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eca491-0e06-4bd1-bf54-bd519b819509 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:13.185872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eca491-0e06-4bd1-bf54-bd519b819509 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:13.186140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eca491-0e06-4bd1-bf54-bd519b819509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:13.196871 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eca491-0e06-4bd1-bf54-bd519b819509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:13.198438 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eca491-0e06-4bd1-bf54-bd519b819509 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:13.209777 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1393/2738] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:33:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:33:14.036976 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1b898-4111-47a0-97f7-3bfa27d3e53e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:14.037546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1b898-4111-47a0-97f7-3bfa27d3e53e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:14.037648 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1b898-4111-47a0-97f7-3bfa27d3e53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:14.075100 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-64a1b898-4111-47a0-97f7-3bfa27d3e53e None None] MFA Rules not processed for user `3b22d7afbd9a4babac259dc9ab9297ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:14.076604 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-64a1b898-4111-47a0-97f7-3bfa27d3e53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:14.181870 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1346/2739] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:33:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:33:14.195637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eca491-0e06-4bd1-bf54-bd519b819509 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:14.197743 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-11eca491-0e06-4bd1-bf54-bd519b819509 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:14.264348 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eca491-0e06-4bd1-bf54-bd519b819509 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:14.268508 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943a1fd-81c4-4525-9d53-d6168c4b10a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:14.270852 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943a1fd-81c4-4525-9d53-d6168c4b10a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:14.270852 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943a1fd-81c4-4525-9d53-d6168c4b10a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:14.270852 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943a1fd-81c4-4525-9d53-d6168c4b10a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:14.282512 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943a1fd-81c4-4525-9d53-d6168c4b10a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:14.284955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943a1fd-81c4-4525-9d53-d6168c4b10a1 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:14.299977 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1394/2740] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:33:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:33:15.771023 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2423c8-e87f-4335-919c-39098e10004e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:15.771517 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2423c8-e87f-4335-919c-39098e10004e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:15.771623 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2423c8-e87f-4335-919c-39098e10004e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:15.791219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2f2423c8-e87f-4335-919c-39098e10004e None None] MFA Rules not processed for user `3b22d7afbd9a4babac259dc9ab9297ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:15.792354 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2f2423c8-e87f-4335-919c-39098e10004e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:15.799755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1347/2741] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:33:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:33:24.294050 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=63,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:24.724033 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afc825-e62a-4741-aabe-679485155b15 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:24.724033 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afc825-e62a-4741-aabe-679485155b15 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:24.724353 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afc825-e62a-4741-aabe-679485155b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:24.743738 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-92afc825-e62a-4741-aabe-679485155b15 None None] MFA Rules not processed for user `9e7444bc40314e73b282217bbb94798d`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:24.745550 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-92afc825-e62a-4741-aabe-679485155b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:24.797498 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2423c8-e87f-4335-919c-39098e10004e None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:24.798889 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2f2423c8-e87f-4335-919c-39098e10004e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:24.803064 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1395/2742] 10.222.0.94 () {58 vars in 967 bytes} [Thu Sep 1 17:33:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:33:24.813383 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2423c8-e87f-4335-919c-39098e10004e None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:24.816321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afc825-e62a-4741-aabe-679485155b15 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:24.817720 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-92afc825-e62a-4741-aabe-679485155b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:24.818152 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691aa34-6055-4106-88b7-b9a29c674dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:24.818779 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691aa34-6055-4106-88b7-b9a29c674dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:24.819056 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691aa34-6055-4106-88b7-b9a29c674dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:24.819327 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691aa34-6055-4106-88b7-b9a29c674dcd admin admin] PATH_INFO: `/v3/users/a5fde76de29b443faebaa573f2bfcc62` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:24.820688 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691aa34-6055-4106-88b7-b9a29c674dcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5fde76de29b443faebaa573f2bfcc62)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:24.822870 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691aa34-6055-4106-88b7-b9a29c674dcd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:24.869661 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8691aa34-6055-4106-88b7-b9a29c674dcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5fde76de29b443faebaa573f2bfcc62'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:24.870308 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8691aa34-6055-4106-88b7-b9a29c674dcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5fde76de29b443faebaa573f2bfcc62'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:24.878052 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8691aa34-6055-4106-88b7-b9a29c674dcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5fde76de29b443faebaa573f2bfcc62'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:24.878702 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8691aa34-6055-4106-88b7-b9a29c674dcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5fde76de29b443faebaa573f2bfcc62'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:24.880759 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:INSERT=4,keystone:SELECT=88,keystone:DELETE=8 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:24.890296 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afc825-e62a-4741-aabe-679485155b15 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:24.893219 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8691aa34-6055-4106-88b7-b9a29c674dcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5fde76de29b443faebaa573f2bfcc62'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:24.895642 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acc569-c68d-4f3f-b8d9-e17e99824e51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7ebf43f36c4862a3c527941e033666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:24.896311 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acc569-c68d-4f3f-b8d9-e17e99824e51 service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:24.896519 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acc569-c68d-4f3f-b8d9-e17e99824e51 service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:24.896789 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acc569-c68d-4f3f-b8d9-e17e99824e51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:24.898614 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-71acc569-c68d-4f3f-b8d9-e17e99824e51 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:24.910123 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71acc569-c68d-4f3f-b8d9-e17e99824e51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:24.912224 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71acc569-c68d-4f3f-b8d9-e17e99824e51 service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:24.913386 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1348/2743] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:33:24 2022] DELETE /identity/v3/users/a5fde76de29b443faebaa573f2bfcc62 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:33:24.918855 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc98de-728d-4c73-a805-b1342911e6a1 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:24.921469 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc98de-728d-4c73-a805-b1342911e6a1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:24.921768 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc98de-728d-4c73-a805-b1342911e6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:24.922109 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1396/2744] 10.222.0.94 () {60 vars in 1384 bytes} [Thu Sep 1 17:33:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 17:33:24.943847 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-eecc98de-728d-4c73-a805-b1342911e6a1 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:24.945087 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-eecc98de-728d-4c73-a805-b1342911e6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:25.026464 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1349/2745] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:33:25.037611 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acc569-c68d-4f3f-b8d9-e17e99824e51 service swift] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:25.039867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-71acc569-c68d-4f3f-b8d9-e17e99824e51 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:25.052914 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acc569-c68d-4f3f-b8d9-e17e99824e51 service swift] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:25.110059 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00068e-3ddf-426e-b057-21fdf5ff7e5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:25.110667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00068e-3ddf-426e-b057-21fdf5ff7e5e service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:25.110943 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00068e-3ddf-426e-b057-21fdf5ff7e5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:25.111209 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00068e-3ddf-426e-b057-21fdf5ff7e5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:25.120904 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00068e-3ddf-426e-b057-21fdf5ff7e5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:25.122373 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00068e-3ddf-426e-b057-21fdf5ff7e5e service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:25.132079 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1397/2746] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:33:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:33:25.616396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc98de-728d-4c73-a805-b1342911e6a1 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:25.618030 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-eecc98de-728d-4c73-a805-b1342911e6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:25.632517 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc98de-728d-4c73-a805-b1342911e6a1 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:25.639291 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1db31-9b13-4cfc-8c88-f97e62e37a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:25.640012 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1db31-9b13-4cfc-8c88-f97e62e37a44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:25.640378 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1db31-9b13-4cfc-8c88-f97e62e37a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:25.640736 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1db31-9b13-4cfc-8c88-f97e62e37a44 admin admin] PATH_INFO: `/v3/projects/10b21d1729a44b08a4e532bed7b26976` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:25.642015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1db31-9b13-4cfc-8c88-f97e62e37a44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10b21d1729a44b08a4e532bed7b26976)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:25.645071 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1db31-9b13-4cfc-8c88-f97e62e37a44 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:25.701510 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3fd1db31-9b13-4cfc-8c88-f97e62e37a44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10b21d1729a44b08a4e532bed7b26976', 'request_id': 'req-3fd1db31-9b13-4cfc-8c88-f97e62e37a44'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:25.706975 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3fd1db31-9b13-4cfc-8c88-f97e62e37a44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10b21d1729a44b08a4e532bed7b26976', 'request_id': 'req-3fd1db31-9b13-4cfc-8c88-f97e62e37a44'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:25.713986 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3fd1db31-9b13-4cfc-8c88-f97e62e37a44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10b21d1729a44b08a4e532bed7b26976', 'request_id': 'req-3fd1db31-9b13-4cfc-8c88-f97e62e37a44'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:25.726443 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3fd1db31-9b13-4cfc-8c88-f97e62e37a44 admin admin] The token cache is being invalidate because project 10b21d1729a44b08a4e532bed7b26976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:33:25.726726 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3fd1db31-9b13-4cfc-8c88-f97e62e37a44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:25.727336 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3fd1db31-9b13-4cfc-8c88-f97e62e37a44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:25.728849 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1350/2747] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:33:25 2022] DELETE /identity/v3/projects/10b21d1729a44b08a4e532bed7b26976 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:33:25.735248 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbcf3d-0d77-4952-8a49-36c1d672d9e2 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:25.735753 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbcf3d-0d77-4952-8a49-36c1d672d9e2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:25.735887 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbcf3d-0d77-4952-8a49-36c1d672d9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:25.756173 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-97bbcf3d-0d77-4952-8a49-36c1d672d9e2 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:25.757367 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-97bbcf3d-0d77-4952-8a49-36c1d672d9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:25.789744 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:25.816799 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1398/2748] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:33:25.825594 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc8375-fb5e-4073-ad31-7f52b8afa0b5 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:25.826080 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc8375-fb5e-4073-ad31-7f52b8afa0b5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:25.826201 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc8375-fb5e-4073-ad31-7f52b8afa0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:25.845327 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-fadc8375-fb5e-4073-ad31-7f52b8afa0b5 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:25.846590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fadc8375-fb5e-4073-ad31-7f52b8afa0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:25.854540 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1351/2749] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:33:25.858753 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbcf3d-0d77-4952-8a49-36c1d672d9e2 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:25.869008 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbcf3d-0d77-4952-8a49-36c1d672d9e2 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:25.873826 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a3791-dda6-439b-99e9-be2a76949fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:25.874438 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a3791-dda6-439b-99e9-be2a76949fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:25.874713 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a3791-dda6-439b-99e9-be2a76949fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:25.874980 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a3791-dda6-439b-99e9-be2a76949fd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:25.875655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a3791-dda6-439b-99e9-be2a76949fd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:33:25.875954 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a3791-dda6-439b-99e9-be2a76949fd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:25.877606 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a3791-dda6-439b-99e9-be2a76949fd0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:25.889734 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1399/2750] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:33:25.893968 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc8375-fb5e-4073-ad31-7f52b8afa0b5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:25.903361 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc8375-fb5e-4073-ad31-7f52b8afa0b5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:25.908019 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061eeee-b10e-4e16-adbe-ca0c4bd9f55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:25.908609 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061eeee-b10e-4e16-adbe-ca0c4bd9f55c admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:25.908888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061eeee-b10e-4e16-adbe-ca0c4bd9f55c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:25.909160 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061eeee-b10e-4e16-adbe-ca0c4bd9f55c admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:25.909831 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061eeee-b10e-4e16-adbe-ca0c4bd9f55c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:25.911729 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061eeee-b10e-4e16-adbe-ca0c4bd9f55c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:25.944665 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1352/2751] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:33:25 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:33:25.950011 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a3791-dda6-439b-99e9-be2a76949fd0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:25.960163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a3791-dda6-439b-99e9-be2a76949fd0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:26.016503 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de57a8-6ba1-47f9-a39a-700db4be0052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:26.017119 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de57a8-6ba1-47f9-a39a-700db4be0052 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:26.017388 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de57a8-6ba1-47f9-a39a-700db4be0052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:26.017679 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de57a8-6ba1-47f9-a39a-700db4be0052 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:26.018293 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de57a8-6ba1-47f9-a39a-700db4be0052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:26.020184 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de57a8-6ba1-47f9-a39a-700db4be0052 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:26.041028 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1400/2752] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:33:25 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:33:26.045058 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061eeee-b10e-4e16-adbe-ca0c4bd9f55c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:26.055870 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061eeee-b10e-4e16-adbe-ca0c4bd9f55c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:26.060368 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e45cc-f4cb-46cf-9653-91118343fbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:26.060952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e45cc-f4cb-46cf-9653-91118343fbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:26.061224 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e45cc-f4cb-46cf-9653-91118343fbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:26.061520 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e45cc-f4cb-46cf-9653-91118343fbe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:26.062150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e45cc-f4cb-46cf-9653-91118343fbe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:26.063732 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e45cc-f4cb-46cf-9653-91118343fbe3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:26.074006 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1353/2753] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:33:26.077933 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de57a8-6ba1-47f9-a39a-700db4be0052 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:26.087908 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de57a8-6ba1-47f9-a39a-700db4be0052 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:26.092649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10b548-0c8e-4c92-8669-1fd0f8fc9fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:26.093217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10b548-0c8e-4c92-8669-1fd0f8fc9fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:26.093529 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10b548-0c8e-4c92-8669-1fd0f8fc9fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:26.093797 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10b548-0c8e-4c92-8669-1fd0f8fc9fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:26.094426 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10b548-0c8e-4c92-8669-1fd0f8fc9fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:26.095999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10b548-0c8e-4c92-8669-1fd0f8fc9fa2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:26.106710 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1401/2754] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:33:26.110606 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e45cc-f4cb-46cf-9653-91118343fbe3 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:26.122926 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e45cc-f4cb-46cf-9653-91118343fbe3 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:26.128837 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bfabe2-3f84-4911-a2f3-c63ee373353e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:26.129715 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfabe2-3f84-4911-a2f3-c63ee373353e admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:26.130022 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfabe2-3f84-4911-a2f3-c63ee373353e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:26.130351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfabe2-3f84-4911-a2f3-c63ee373353e admin admin] PATH_INFO: `/v3/projects/acea8f3d059343f7bfcecf7300282d6c/users/7b88d406d2c3455295717cccfa8aa900/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:26.145838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bfabe2-3f84-4911-a2f3-c63ee373353e admin admin] RBAC: Authorizing `identity:create_grant(project_id=acea8f3d059343f7bfcecf7300282d6c, user_id=7b88d406d2c3455295717cccfa8aa900, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:26.148514 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bfabe2-3f84-4911-a2f3-c63ee373353e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:26.150806 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:26.163985 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1354/2755] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:33:26 2022] PUT /identity/v3/projects/acea8f3d059343f7bfcecf7300282d6c/users/7b88d406d2c3455295717cccfa8aa900/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:33:26.174197 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df374546-cedd-4157-a709-8948ffb9dd72 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:26.174493 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df374546-cedd-4157-a709-8948ffb9dd72 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:26.174764 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df374546-cedd-4157-a709-8948ffb9dd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:26.203156 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-df374546-cedd-4157-a709-8948ffb9dd72 None None] MFA Rules not processed for user `7b88d406d2c3455295717cccfa8aa900`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:26.204374 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-df374546-cedd-4157-a709-8948ffb9dd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:26.272170 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1402/2756] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:33:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:33:26.282749 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bfabe2-3f84-4911-a2f3-c63ee373353e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:26.284464 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c9bfabe2-3f84-4911-a2f3-c63ee373353e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:26.344558 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bfabe2-3f84-4911-a2f3-c63ee373353e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:26.349024 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e34b5b-ee82-4079-b078-8ab9b91cdcf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:26.349780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e34b5b-ee82-4079-b078-8ab9b91cdcf9 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:26.350053 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e34b5b-ee82-4079-b078-8ab9b91cdcf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:26.350316 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e34b5b-ee82-4079-b078-8ab9b91cdcf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:26.359983 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e34b5b-ee82-4079-b078-8ab9b91cdcf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:26.361676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e34b5b-ee82-4079-b078-8ab9b91cdcf9 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:26.373445 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1355/2757] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:33:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:33:36.252443 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df374546-cedd-4157-a709-8948ffb9dd72 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:36.286343 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:36.315724 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df374546-cedd-4157-a709-8948ffb9dd72 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:36.320813 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0bf897-7a6e-47fc-9e74-7c51baca3eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:36.321519 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bf897-7a6e-47fc-9e74-7c51baca3eaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:36.321795 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bf897-7a6e-47fc-9e74-7c51baca3eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:36.322063 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bf897-7a6e-47fc-9e74-7c51baca3eaa admin admin] PATH_INFO: `/v3/users/7b88d406d2c3455295717cccfa8aa900` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:36.323158 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0bf897-7a6e-47fc-9e74-7c51baca3eaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b88d406d2c3455295717cccfa8aa900)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:36.325046 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0bf897-7a6e-47fc-9e74-7c51baca3eaa admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:36.367425 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:INSERT=1,keystone:SELECT=28 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:36.373551 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1c0bf897-7a6e-47fc-9e74-7c51baca3eaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b88d406d2c3455295717cccfa8aa900'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:36.374256 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1c0bf897-7a6e-47fc-9e74-7c51baca3eaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b88d406d2c3455295717cccfa8aa900'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:36.386795 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1c0bf897-7a6e-47fc-9e74-7c51baca3eaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b88d406d2c3455295717cccfa8aa900'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:36.393528 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1c0bf897-7a6e-47fc-9e74-7c51baca3eaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b88d406d2c3455295717cccfa8aa900'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:36.401862 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1c0bf897-7a6e-47fc-9e74-7c51baca3eaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b88d406d2c3455295717cccfa8aa900'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:36.408849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1403/2758] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:33:36 2022] DELETE /identity/v3/users/7b88d406d2c3455295717cccfa8aa900 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:33:36.413348 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8a5c6-0553-4c55-b559-90b1f64927b0 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:36.413673 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8a5c6-0553-4c55-b559-90b1f64927b0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:36.413967 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8a5c6-0553-4c55-b559-90b1f64927b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:36.434000 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-02a8a5c6-0553-4c55-b559-90b1f64927b0 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:36.435224 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-02a8a5c6-0553-4c55-b559-90b1f64927b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:36.491610 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1356/2759] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:33:36.502152 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0bf897-7a6e-47fc-9e74-7c51baca3eaa admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:36.503562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1c0bf897-7a6e-47fc-9e74-7c51baca3eaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:36.560175 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0bf897-7a6e-47fc-9e74-7c51baca3eaa admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:36.563757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c207da7-933b-4f19-9895-d28122303422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:36.564352 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c207da7-933b-4f19-9895-d28122303422 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:36.564630 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c207da7-933b-4f19-9895-d28122303422 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:36.564897 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c207da7-933b-4f19-9895-d28122303422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:36.574420 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c207da7-933b-4f19-9895-d28122303422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:36.575834 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c207da7-933b-4f19-9895-d28122303422 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:36.585596 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1404/2760] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:33:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:33:36.853843 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8a5c6-0553-4c55-b559-90b1f64927b0 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:36.855390 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-02a8a5c6-0553-4c55-b559-90b1f64927b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:36.869360 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8a5c6-0553-4c55-b559-90b1f64927b0 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:36.873971 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c90d6a-158f-4ebf-b61c-5a901a3c3b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:36.874596 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c90d6a-158f-4ebf-b61c-5a901a3c3b9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:36.874869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c90d6a-158f-4ebf-b61c-5a901a3c3b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:36.875140 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c90d6a-158f-4ebf-b61c-5a901a3c3b9d admin admin] PATH_INFO: `/v3/projects/acea8f3d059343f7bfcecf7300282d6c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:36.878299 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c90d6a-158f-4ebf-b61c-5a901a3c3b9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=acea8f3d059343f7bfcecf7300282d6c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:36.880889 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c90d6a-158f-4ebf-b61c-5a901a3c3b9d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:36.930198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b8c90d6a-158f-4ebf-b61c-5a901a3c3b9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acea8f3d059343f7bfcecf7300282d6c', 'request_id': 'req-b8c90d6a-158f-4ebf-b61c-5a901a3c3b9d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:36.935618 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b8c90d6a-158f-4ebf-b61c-5a901a3c3b9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acea8f3d059343f7bfcecf7300282d6c', 'request_id': 'req-b8c90d6a-158f-4ebf-b61c-5a901a3c3b9d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:36.942007 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b8c90d6a-158f-4ebf-b61c-5a901a3c3b9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acea8f3d059343f7bfcecf7300282d6c', 'request_id': 'req-b8c90d6a-158f-4ebf-b61c-5a901a3c3b9d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:36.954823 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b8c90d6a-158f-4ebf-b61c-5a901a3c3b9d admin admin] The token cache is being invalidate because project acea8f3d059343f7bfcecf7300282d6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:33:36.955113 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b8c90d6a-158f-4ebf-b61c-5a901a3c3b9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:36.955757 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b8c90d6a-158f-4ebf-b61c-5a901a3c3b9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:33:36.957783 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1357/2761] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:33:36 2022] DELETE /identity/v3/projects/acea8f3d059343f7bfcecf7300282d6c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:33:46.580835 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=64,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:46.951686 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:47.051585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc778f-1fbf-4270-93a7-46df21df67bc None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:47.052120 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc778f-1fbf-4270-93a7-46df21df67bc None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:47.052391 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc778f-1fbf-4270-93a7-46df21df67bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:47.072487 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-efcc778f-1fbf-4270-93a7-46df21df67bc None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:47.073718 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-efcc778f-1fbf-4270-93a7-46df21df67bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:47.129302 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1405/2762] 10.222.0.91 () {58 vars in 1016 bytes} [Thu Sep 1 17:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:33:47.147953 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c90d6a-158f-4ebf-b61c-5a901a3c3b9d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:47.149578 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b8c90d6a-158f-4ebf-b61c-5a901a3c3b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:47.221629 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c90d6a-158f-4ebf-b61c-5a901a3c3b9d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:47.227131 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335cc17a-2911-44ea-9e33-506c35e17ced service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:47.227783 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335cc17a-2911-44ea-9e33-506c35e17ced service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:47.228064 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335cc17a-2911-44ea-9e33-506c35e17ced service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:47.228337 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335cc17a-2911-44ea-9e33-506c35e17ced service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:47.236361 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335cc17a-2911-44ea-9e33-506c35e17ced service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:47.238033 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335cc17a-2911-44ea-9e33-506c35e17ced service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:47.247963 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1358/2763] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:33:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:33:50.051820 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164b61f-8795-471b-9bce-87f2d730b629 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:50.052452 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164b61f-8795-471b-9bce-87f2d730b629 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:50.052452 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164b61f-8795-471b-9bce-87f2d730b629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:50.071339 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-7164b61f-8795-471b-9bce-87f2d730b629 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:50.072526 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7164b61f-8795-471b-9bce-87f2d730b629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:50.080305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1406/2764] 10.222.0.91 () {58 vars in 1016 bytes} [Thu Sep 1 17:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:33:50.095810 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335cc17a-2911-44ea-9e33-506c35e17ced service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:50.097177 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-335cc17a-2911-44ea-9e33-506c35e17ced service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:50.112138 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335cc17a-2911-44ea-9e33-506c35e17ced service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:50.117594 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707b3dc-9f83-4152-bb69-490881692429 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:50.118180 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707b3dc-9f83-4152-bb69-490881692429 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:50.118454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707b3dc-9f83-4152-bb69-490881692429 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:50.118722 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707b3dc-9f83-4152-bb69-490881692429 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:50.126808 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707b3dc-9f83-4152-bb69-490881692429 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:50.128358 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707b3dc-9f83-4152-bb69-490881692429 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:50.137569 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1359/2765] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:33:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:33:53.303606 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537fbcf7-763d-4cbd-a293-335356cad6fd None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:53.304202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537fbcf7-763d-4cbd-a293-335356cad6fd None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:53.304202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537fbcf7-763d-4cbd-a293-335356cad6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:53.323410 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-537fbcf7-763d-4cbd-a293-335356cad6fd None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:53.324621 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-537fbcf7-763d-4cbd-a293-335356cad6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:53.332245 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1407/2766] 10.222.0.91 () {58 vars in 1016 bytes} [Thu Sep 1 17:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:33:53.348919 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707b3dc-9f83-4152-bb69-490881692429 service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:53.361243 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707b3dc-9f83-4152-bb69-490881692429 service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:53.366867 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf5d9d-0b02-4bd6-81e5-860c52020c9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:53.367493 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf5d9d-0b02-4bd6-81e5-860c52020c9b service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:53.367774 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf5d9d-0b02-4bd6-81e5-860c52020c9b service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:53.368046 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf5d9d-0b02-4bd6-81e5-860c52020c9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:53.377069 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf5d9d-0b02-4bd6-81e5-860c52020c9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:53.378726 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf5d9d-0b02-4bd6-81e5-860c52020c9b service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:53.388598 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1360/2767] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:33:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:33:56.372060 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288486d-9cf2-4719-98af-ef2b928d68e5 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:56.372545 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288486d-9cf2-4719-98af-ef2b928d68e5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:56.372666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288486d-9cf2-4719-98af-ef2b928d68e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:56.392862 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0288486d-9cf2-4719-98af-ef2b928d68e5 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:56.394012 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0288486d-9cf2-4719-98af-ef2b928d68e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:56.401865 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1408/2768] 10.222.0.91 () {58 vars in 1016 bytes} [Thu Sep 1 17:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:33:56.417072 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf5d9d-0b02-4bd6-81e5-860c52020c9b service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:56.428935 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf5d9d-0b02-4bd6-81e5-860c52020c9b service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:56.435039 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b39eb-1415-4d6a-9c83-9c128a266ddb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:56.435626 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b39eb-1415-4d6a-9c83-9c128a266ddb service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:56.435911 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b39eb-1415-4d6a-9c83-9c128a266ddb service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:56.436189 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b39eb-1415-4d6a-9c83-9c128a266ddb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:56.444178 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b39eb-1415-4d6a-9c83-9c128a266ddb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:56.445799 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b39eb-1415-4d6a-9c83-9c128a266ddb service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:56.456008 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1361/2769] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:33:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:33:59.539446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6d8a9-2128-49e4-8f0e-bbb5242233d4 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:59.539895 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6d8a9-2128-49e4-8f0e-bbb5242233d4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:59.540009 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6d8a9-2128-49e4-8f0e-bbb5242233d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:59.559970 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-cbc6d8a9-2128-49e4-8f0e-bbb5242233d4 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:33:59.561163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cbc6d8a9-2128-49e4-8f0e-bbb5242233d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:33:59.569002 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1409/2770] 10.222.0.91 () {58 vars in 1016 bytes} [Thu Sep 1 17:33:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:33:59.585551 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b39eb-1415-4d6a-9c83-9c128a266ddb service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:33:59.597173 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b39eb-1415-4d6a-9c83-9c128a266ddb service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:33:59.602690 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52088cd8-bd01-41b5-940b-2b1406b3fbbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:33:59.603327 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52088cd8-bd01-41b5-940b-2b1406b3fbbb service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:33:59.603601 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52088cd8-bd01-41b5-940b-2b1406b3fbbb service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:33:59.603871 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52088cd8-bd01-41b5-940b-2b1406b3fbbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:33:59.611849 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52088cd8-bd01-41b5-940b-2b1406b3fbbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:33:59.613483 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52088cd8-bd01-41b5-940b-2b1406b3fbbb service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:33:59.624118 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1362/2771] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:33:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:34:02.696113 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad2369-9565-4c99-a2d1-938439234b4c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:34:02.696615 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad2369-9565-4c99-a2d1-938439234b4c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:34:02.696734 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad2369-9565-4c99-a2d1-938439234b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:34:02.715855 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d5ad2369-9565-4c99-a2d1-938439234b4c None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:34:02.717027 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d5ad2369-9565-4c99-a2d1-938439234b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:34:02.724582 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1410/2772] 10.222.0.91 () {58 vars in 1016 bytes} [Thu Sep 1 17:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:34:02.740358 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52088cd8-bd01-41b5-940b-2b1406b3fbbb service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:34:02.751870 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52088cd8-bd01-41b5-940b-2b1406b3fbbb service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:34:02.757312 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360f1db-1379-4fab-aa6a-9c08482863a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:34:02.757945 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360f1db-1379-4fab-aa6a-9c08482863a8 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:34:02.758245 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360f1db-1379-4fab-aa6a-9c08482863a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:34:02.758513 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360f1db-1379-4fab-aa6a-9c08482863a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:34:02.767372 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360f1db-1379-4fab-aa6a-9c08482863a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:34:02.769001 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360f1db-1379-4fab-aa6a-9c08482863a8 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:34:02.778765 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1363/2773] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:34:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:34:12.710731 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=42 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:34:12.774085 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=64 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:34:17.839476 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb2736-f67b-45bd-b34e-7d794a4c5a3e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:34:17.839975 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb2736-f67b-45bd-b34e-7d794a4c5a3e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:34:17.840085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb2736-f67b-45bd-b34e-7d794a4c5a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:34:17.861745 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-87cb2736-f67b-45bd-b34e-7d794a4c5a3e None None] MFA Rules not processed for user `56157c6686714d9c976e3890f2055038`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:34:17.862954 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-87cb2736-f67b-45bd-b34e-7d794a4c5a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:34:17.919271 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1411/2774] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:34:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:34:19.239694 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693004fb-272a-40e4-a23b-77a9855d8700 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:34:19.240186 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693004fb-272a-40e4-a23b-77a9855d8700 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:34:19.240282 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693004fb-272a-40e4-a23b-77a9855d8700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:34:19.259980 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-693004fb-272a-40e4-a23b-77a9855d8700 None None] MFA Rules not processed for user `3b22d7afbd9a4babac259dc9ab9297ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:34:19.261188 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-693004fb-272a-40e4-a23b-77a9855d8700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:34:19.320746 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1364/2775] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:34:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:34:27.912181 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=25 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:34:28.204082 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb2736-f67b-45bd-b34e-7d794a4c5a3e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:34:28.230899 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb2736-f67b-45bd-b34e-7d794a4c5a3e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:34:28.236544 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046de666-c990-45de-905d-9e7b7353abe2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:34:28.237156 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046de666-c990-45de-905d-9e7b7353abe2 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:34:28.237455 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046de666-c990-45de-905d-9e7b7353abe2 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:34:28.237726 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046de666-c990-45de-905d-9e7b7353abe2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:34:28.239470 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-046de666-c990-45de-905d-9e7b7353abe2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:34:28.251982 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046de666-c990-45de-905d-9e7b7353abe2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:34:28.253631 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046de666-c990-45de-905d-9e7b7353abe2 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:34:28.264621 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1412/2776] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:34:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:34:29.314015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=25 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:34:32.372278 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ace380-be2c-49b3-943a-af6eb78a2495 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:34:32.372963 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ace380-be2c-49b3-943a-af6eb78a2495 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:34:32.372963 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ace380-be2c-49b3-943a-af6eb78a2495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:34:32.392032 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-61ace380-be2c-49b3-943a-af6eb78a2495 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:34:32.393232 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-61ace380-be2c-49b3-943a-af6eb78a2495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:34:32.401169 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1365/2777] 10.222.0.91 () {58 vars in 1016 bytes} [Thu Sep 1 17:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:34:32.414131 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046de666-c990-45de-905d-9e7b7353abe2 service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:34:32.425790 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046de666-c990-45de-905d-9e7b7353abe2 service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:34:32.431088 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa693bd9-76c0-4709-95a4-6b4d562e98e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:34:32.431698 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa693bd9-76c0-4709-95a4-6b4d562e98e9 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:34:32.431972 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa693bd9-76c0-4709-95a4-6b4d562e98e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:34:32.432237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa693bd9-76c0-4709-95a4-6b4d562e98e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:34:32.440866 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa693bd9-76c0-4709-95a4-6b4d562e98e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:34:32.442439 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa693bd9-76c0-4709-95a4-6b4d562e98e9 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:34:32.451383 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1413/2778] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:34:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:34:35.632534 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47455536-9490-41e9-82e6-07f10aba4091 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:34:35.633053 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47455536-9490-41e9-82e6-07f10aba4091 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:34:35.633053 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47455536-9490-41e9-82e6-07f10aba4091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:34:35.711384 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-47455536-9490-41e9-82e6-07f10aba4091 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:34:35.712586 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-47455536-9490-41e9-82e6-07f10aba4091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:34:35.760540 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1366/2779] 10.222.0.91 () {58 vars in 1016 bytes} [Thu Sep 1 17:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:34:35.778649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa693bd9-76c0-4709-95a4-6b4d562e98e9 service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:34:35.842208 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa693bd9-76c0-4709-95a4-6b4d562e98e9 service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:34:35.847639 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af0cc9-6fa8-4bc3-b348-3fe84f57f0bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:34:35.848227 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af0cc9-6fa8-4bc3-b348-3fe84f57f0bc service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:34:35.848500 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af0cc9-6fa8-4bc3-b348-3fe84f57f0bc service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:34:35.848765 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af0cc9-6fa8-4bc3-b348-3fe84f57f0bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:34:35.856926 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af0cc9-6fa8-4bc3-b348-3fe84f57f0bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:34:35.858531 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af0cc9-6fa8-4bc3-b348-3fe84f57f0bc service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:34:35.867809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1414/2780] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:34:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:34:38.757440 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848f3bd-2006-4b6d-abb7-22c3bd476b09 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:34:38.757973 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848f3bd-2006-4b6d-abb7-22c3bd476b09 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:34:38.757973 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848f3bd-2006-4b6d-abb7-22c3bd476b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:34:38.778794 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8848f3bd-2006-4b6d-abb7-22c3bd476b09 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:34:38.779983 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8848f3bd-2006-4b6d-abb7-22c3bd476b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:34:38.787819 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1367/2781] 10.222.0.91 () {58 vars in 1016 bytes} [Thu Sep 1 17:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:34:38.802891 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af0cc9-6fa8-4bc3-b348-3fe84f57f0bc service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:34:38.814485 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af0cc9-6fa8-4bc3-b348-3fe84f57f0bc service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:34:38.819752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da94f8-f1d1-457b-b6e2-a2a58df24e52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:34:38.820329 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da94f8-f1d1-457b-b6e2-a2a58df24e52 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:34:38.820602 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da94f8-f1d1-457b-b6e2-a2a58df24e52 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:34:38.820867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da94f8-f1d1-457b-b6e2-a2a58df24e52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:34:38.829364 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da94f8-f1d1-457b-b6e2-a2a58df24e52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:34:38.830931 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da94f8-f1d1-457b-b6e2-a2a58df24e52 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:34:38.840566 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1415/2782] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:34:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:34:41.883691 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a9299-acf2-4161-b500-6e11611cfc4f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:34:41.884191 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a9299-acf2-4161-b500-6e11611cfc4f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:34:41.884311 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a9299-acf2-4161-b500-6e11611cfc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:34:41.904500 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d73a9299-acf2-4161-b500-6e11611cfc4f None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:34:41.905742 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d73a9299-acf2-4161-b500-6e11611cfc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:34:41.913607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1368/2783] 10.222.0.91 () {58 vars in 1016 bytes} [Thu Sep 1 17:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:34:41.934785 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da94f8-f1d1-457b-b6e2-a2a58df24e52 service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:34:41.946310 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da94f8-f1d1-457b-b6e2-a2a58df24e52 service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:34:41.952872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e8e3f-f4ed-4656-8ad8-e129ef8a915a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:34:41.953697 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e8e3f-f4ed-4656-8ad8-e129ef8a915a service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:34:41.954140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e8e3f-f4ed-4656-8ad8-e129ef8a915a service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:34:41.954579 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e8e3f-f4ed-4656-8ad8-e129ef8a915a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:34:41.963669 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e8e3f-f4ed-4656-8ad8-e129ef8a915a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:34:41.965318 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e8e3f-f4ed-4656-8ad8-e129ef8a915a service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:34:41.974836 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1416/2784] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:34:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:34:45.045608 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c365bb7-951b-4ee6-8030-9188174e7093 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:34:45.046068 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c365bb7-951b-4ee6-8030-9188174e7093 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:34:45.046179 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c365bb7-951b-4ee6-8030-9188174e7093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:34:45.065855 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5c365bb7-951b-4ee6-8030-9188174e7093 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:34:45.067037 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5c365bb7-951b-4ee6-8030-9188174e7093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:34:45.074830 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1369/2785] 10.222.0.91 () {58 vars in 1016 bytes} [Thu Sep 1 17:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:34:45.098503 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e8e3f-f4ed-4656-8ad8-e129ef8a915a service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:34:45.110847 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e8e3f-f4ed-4656-8ad8-e129ef8a915a service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:34:45.116186 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e2188-59a7-486c-9923-8c441e750082 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:34:45.116764 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e2188-59a7-486c-9923-8c441e750082 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:34:45.117035 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e2188-59a7-486c-9923-8c441e750082 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:34:45.117297 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e2188-59a7-486c-9923-8c441e750082 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:34:45.126058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e2188-59a7-486c-9923-8c441e750082 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:34:45.127609 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e2188-59a7-486c-9923-8c441e750082 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:34:45.136619 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1417/2786] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:34:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:34:54.663094 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c365bb7-951b-4ee6-8030-9188174e7093 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:34:54.664580 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5c365bb7-951b-4ee6-8030-9188174e7093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:34:54.754758 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c365bb7-951b-4ee6-8030-9188174e7093 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:34:54.759862 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230f870-4572-46f2-b0a8-53d17053cd71 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3622621761f4f18ae3e9dfb5ba99bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:34:54.761128 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230f870-4572-46f2-b0a8-53d17053cd71 service placement] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:34:54.761419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230f870-4572-46f2-b0a8-53d17053cd71 service placement] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:34:54.761739 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230f870-4572-46f2-b0a8-53d17053cd71 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:34:54.763429 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0230f870-4572-46f2-b0a8-53d17053cd71 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:34:54.774648 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230f870-4572-46f2-b0a8-53d17053cd71 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:34:54.776299 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230f870-4572-46f2-b0a8-53d17053cd71 service placement] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:34:54.786603 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1370/2787] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:34:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:34:55.132677 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=60 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:35:04.782297 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:35:12.996571 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e2188-59a7-486c-9923-8c441e750082 service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:35:13.000419 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4f3e2188-59a7-486c-9923-8c441e750082 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:35:13.037684 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e2188-59a7-486c-9923-8c441e750082 service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:35:13.045966 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157abaf6-9c74-4cbf-909a-ea8afd7a6ac7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3622621761f4f18ae3e9dfb5ba99bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:35:13.047032 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157abaf6-9c74-4cbf-909a-ea8afd7a6ac7 service placement] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:13.047658 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157abaf6-9c74-4cbf-909a-ea8afd7a6ac7 service placement] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:13.048552 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157abaf6-9c74-4cbf-909a-ea8afd7a6ac7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:13.057064 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-157abaf6-9c74-4cbf-909a-ea8afd7a6ac7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:35:13.074232 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230f870-4572-46f2-b0a8-53d17053cd71 service placement] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:35:13.075849 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0230f870-4572-46f2-b0a8-53d17053cd71 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:35:13.077448 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157abaf6-9c74-4cbf-909a-ea8afd7a6ac7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:35:13.079652 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157abaf6-9c74-4cbf-909a-ea8afd7a6ac7 service placement] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:35:13.091770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230f870-4572-46f2-b0a8-53d17053cd71 service placement] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:35:13.095612 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1418/2788] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:35:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:35:13.097056 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db137169-c6a0-4b47-9023-d9465f6128d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:35:13.097717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db137169-c6a0-4b47-9023-d9465f6128d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:13.097996 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db137169-c6a0-4b47-9023-d9465f6128d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:13.098267 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db137169-c6a0-4b47-9023-d9465f6128d2 admin admin] PATH_INFO: `/v3/users/3b22d7afbd9a4babac259dc9ab9297ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:13.099380 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db137169-c6a0-4b47-9023-d9465f6128d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b22d7afbd9a4babac259dc9ab9297ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:35:13.101320 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db137169-c6a0-4b47-9023-d9465f6128d2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:35:13.155317 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-db137169-c6a0-4b47-9023-d9465f6128d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b22d7afbd9a4babac259dc9ab9297ff'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:35:13.155963 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-db137169-c6a0-4b47-9023-d9465f6128d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b22d7afbd9a4babac259dc9ab9297ff'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:35:13.163817 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-db137169-c6a0-4b47-9023-d9465f6128d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b22d7afbd9a4babac259dc9ab9297ff'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:35:13.164511 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-db137169-c6a0-4b47-9023-d9465f6128d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b22d7afbd9a4babac259dc9ab9297ff'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:35:13.172487 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-db137169-c6a0-4b47-9023-d9465f6128d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b22d7afbd9a4babac259dc9ab9297ff'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:35:13.190976 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1371/2789] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:35:13 2022] DELETE /identity/v3/users/3b22d7afbd9a4babac259dc9ab9297ff => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:35:13.394441 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157abaf6-9c74-4cbf-909a-ea8afd7a6ac7 service placement] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:35:13.405191 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157abaf6-9c74-4cbf-909a-ea8afd7a6ac7 service placement] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:35:13.469952 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc172857-aecc-404e-a897-377da64c49c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:35:13.470586 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc172857-aecc-404e-a897-377da64c49c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:13.470864 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc172857-aecc-404e-a897-377da64c49c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:13.471161 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc172857-aecc-404e-a897-377da64c49c0 admin admin] PATH_INFO: `/v3/projects/5c63692c197f4fba96a19a3fbf36dac1` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:13.472284 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc172857-aecc-404e-a897-377da64c49c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c63692c197f4fba96a19a3fbf36dac1)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:35:13.474251 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc172857-aecc-404e-a897-377da64c49c0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:35:13.518717 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cc172857-aecc-404e-a897-377da64c49c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c63692c197f4fba96a19a3fbf36dac1', 'request_id': 'req-cc172857-aecc-404e-a897-377da64c49c0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:35:13.524333 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cc172857-aecc-404e-a897-377da64c49c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c63692c197f4fba96a19a3fbf36dac1', 'request_id': 'req-cc172857-aecc-404e-a897-377da64c49c0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:35:13.531157 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cc172857-aecc-404e-a897-377da64c49c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c63692c197f4fba96a19a3fbf36dac1', 'request_id': 'req-cc172857-aecc-404e-a897-377da64c49c0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:35:13.545327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cc172857-aecc-404e-a897-377da64c49c0 admin admin] The token cache is being invalidate because project 5c63692c197f4fba96a19a3fbf36dac1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:35:13.545753 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cc172857-aecc-404e-a897-377da64c49c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:35:13.546367 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cc172857-aecc-404e-a897-377da64c49c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:35:13.547829 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1419/2790] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:35:13 2022] DELETE /identity/v3/projects/5c63692c197f4fba96a19a3fbf36dac1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:35:13.552874 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab91f7-c958-4e4e-8836-d49724637d0e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:13.553192 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab91f7-c958-4e4e-8836-d49724637d0e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:13.553491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab91f7-c958-4e4e-8836-d49724637d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:13.572856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e2ab91f7-c958-4e4e-8836-d49724637d0e None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:35:13.574134 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e2ab91f7-c958-4e4e-8836-d49724637d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:35:13.636282 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1372/2791] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:35:13.644159 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea663bee-dcc2-4f59-bc82-741e83661ddf None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:13.644457 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea663bee-dcc2-4f59-bc82-741e83661ddf None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:13.644764 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea663bee-dcc2-4f59-bc82-741e83661ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:13.664605 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ea663bee-dcc2-4f59-bc82-741e83661ddf None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:35:13.665843 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ea663bee-dcc2-4f59-bc82-741e83661ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:35:13.674668 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1420/2792] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:35:13.678782 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab91f7-c958-4e4e-8836-d49724637d0e None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:35:13.688535 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab91f7-c958-4e4e-8836-d49724637d0e None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:35:13.693155 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf484b-95ae-4d9a-bce6-a86a60ee6f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:35:13.693819 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf484b-95ae-4d9a-bce6-a86a60ee6f67 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:13.694125 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf484b-95ae-4d9a-bce6-a86a60ee6f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:13.694395 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf484b-95ae-4d9a-bce6-a86a60ee6f67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:13.695046 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf484b-95ae-4d9a-bce6-a86a60ee6f67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:35:13.695348 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf484b-95ae-4d9a-bce6-a86a60ee6f67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:35:13.696934 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf484b-95ae-4d9a-bce6-a86a60ee6f67 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:35:13.708445 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1373/2793] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:35:13.712955 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea663bee-dcc2-4f59-bc82-741e83661ddf None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:35:13.722668 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea663bee-dcc2-4f59-bc82-741e83661ddf None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:35:13.727368 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f30624-49ea-4381-a095-7aac06343e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:35:13.727961 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f30624-49ea-4381-a095-7aac06343e0e admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:13.728241 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f30624-49ea-4381-a095-7aac06343e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:13.728509 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f30624-49ea-4381-a095-7aac06343e0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:13.729134 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f30624-49ea-4381-a095-7aac06343e0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:35:13.731679 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f30624-49ea-4381-a095-7aac06343e0e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:35:13.760067 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1421/2794] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:35:13 2022] POST /identity/v3/projects => generated 399 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:35:13.764177 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf484b-95ae-4d9a-bce6-a86a60ee6f67 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:35:13.773971 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf484b-95ae-4d9a-bce6-a86a60ee6f67 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:35:13.829737 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b13a7-b592-4060-bae4-2f076018d8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:35:13.830266 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b13a7-b592-4060-bae4-2f076018d8a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:13.830540 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b13a7-b592-4060-bae4-2f076018d8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:13.830805 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b13a7-b592-4060-bae4-2f076018d8a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:13.831432 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b13a7-b592-4060-bae4-2f076018d8a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:35:13.833454 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b13a7-b592-4060-bae4-2f076018d8a2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:35:13.842055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:35:13.856818 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1374/2795] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:35:13 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:35:13.860994 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f30624-49ea-4381-a095-7aac06343e0e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:35:13.871235 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f30624-49ea-4381-a095-7aac06343e0e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:35:13.876196 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2dfd2-e0b1-4c9c-b31e-1949c7694f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:35:13.876785 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2dfd2-e0b1-4c9c-b31e-1949c7694f95 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:13.877061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2dfd2-e0b1-4c9c-b31e-1949c7694f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:13.877328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2dfd2-e0b1-4c9c-b31e-1949c7694f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:13.877991 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2dfd2-e0b1-4c9c-b31e-1949c7694f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:35:13.879584 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2dfd2-e0b1-4c9c-b31e-1949c7694f95 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:35:13.889809 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1422/2796] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:35:13.893642 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b13a7-b592-4060-bae4-2f076018d8a2 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:35:13.904132 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b13a7-b592-4060-bae4-2f076018d8a2 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:35:13.908715 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf784646-f004-4769-a57e-303a416801ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:35:13.909298 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf784646-f004-4769-a57e-303a416801ee admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:13.909609 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf784646-f004-4769-a57e-303a416801ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:13.909879 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf784646-f004-4769-a57e-303a416801ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:13.910514 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf784646-f004-4769-a57e-303a416801ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:35:13.912086 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf784646-f004-4769-a57e-303a416801ee admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:35:13.922602 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1375/2797] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:35:13.926627 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2dfd2-e0b1-4c9c-b31e-1949c7694f95 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:35:13.937060 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2dfd2-e0b1-4c9c-b31e-1949c7694f95 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:35:13.941972 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550ad4c-f427-4c8c-85b2-ea857c63d066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:35:13.942648 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550ad4c-f427-4c8c-85b2-ea857c63d066 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:13.942927 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550ad4c-f427-4c8c-85b2-ea857c63d066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:13.943201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550ad4c-f427-4c8c-85b2-ea857c63d066 admin admin] PATH_INFO: `/v3/projects/aeb70c7e5c334832949b1c3b7f9cf231/users/90df37655dba474c808bf4ffeedb6547/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:13.957806 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0550ad4c-f427-4c8c-85b2-ea857c63d066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeb70c7e5c334832949b1c3b7f9cf231, user_id=90df37655dba474c808bf4ffeedb6547, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:35:13.960445 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0550ad4c-f427-4c8c-85b2-ea857c63d066 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:35:13.973720 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1423/2798] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:35:13 2022] PUT /identity/v3/projects/aeb70c7e5c334832949b1c3b7f9cf231/users/90df37655dba474c808bf4ffeedb6547/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:35:13.985050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c686959-c766-4f54-89f6-b9b56337d98d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:13.985338 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c686959-c766-4f54-89f6-b9b56337d98d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:13.985659 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c686959-c766-4f54-89f6-b9b56337d98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:14.013146 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-4c686959-c766-4f54-89f6-b9b56337d98d None None] MFA Rules not processed for user `90df37655dba474c808bf4ffeedb6547`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:35:14.014390 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4c686959-c766-4f54-89f6-b9b56337d98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:35:14.082047 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1376/2799] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:35:13 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:35:14.093282 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550ad4c-f427-4c8c-85b2-ea857c63d066 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:35:14.095189 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0550ad4c-f427-4c8c-85b2-ea857c63d066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:35:14.113460 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:35:14.186825 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550ad4c-f427-4c8c-85b2-ea857c63d066 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:35:14.191926 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f4ff4-b371-480d-900b-9b234b7f95cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:35:14.192552 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f4ff4-b371-480d-900b-9b234b7f95cf service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:14.192831 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f4ff4-b371-480d-900b-9b234b7f95cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:14.193108 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f4ff4-b371-480d-900b-9b234b7f95cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:14.202932 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f4ff4-b371-480d-900b-9b234b7f95cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:35:14.204387 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f4ff4-b371-480d-900b-9b234b7f95cf service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:35:14.214204 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1424/2800] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:35:14 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:35:19.288395 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c686959-c766-4f54-89f6-b9b56337d98d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:35:19.351763 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c686959-c766-4f54-89f6-b9b56337d98d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:35:19.356302 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9150753-3e7d-4db2-a2b9-07a9994cf9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:35:19.356924 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9150753-3e7d-4db2-a2b9-07a9994cf9e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:19.357201 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9150753-3e7d-4db2-a2b9-07a9994cf9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:19.357500 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9150753-3e7d-4db2-a2b9-07a9994cf9e8 admin admin] PATH_INFO: `/v3/users/90df37655dba474c808bf4ffeedb6547` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:19.358610 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9150753-3e7d-4db2-a2b9-07a9994cf9e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90df37655dba474c808bf4ffeedb6547)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:35:19.360512 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9150753-3e7d-4db2-a2b9-07a9994cf9e8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:35:19.405381 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f9150753-3e7d-4db2-a2b9-07a9994cf9e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90df37655dba474c808bf4ffeedb6547'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:35:19.406054 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f9150753-3e7d-4db2-a2b9-07a9994cf9e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90df37655dba474c808bf4ffeedb6547'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:35:19.413351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f9150753-3e7d-4db2-a2b9-07a9994cf9e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90df37655dba474c808bf4ffeedb6547'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:35:19.414020 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f9150753-3e7d-4db2-a2b9-07a9994cf9e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90df37655dba474c808bf4ffeedb6547'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:35:19.422402 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f9150753-3e7d-4db2-a2b9-07a9994cf9e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90df37655dba474c808bf4ffeedb6547'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:35:19.428150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:35:19.443909 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1377/2801] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:35:19 2022] DELETE /identity/v3/users/90df37655dba474c808bf4ffeedb6547 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:35:19.448902 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3d2be-eab7-4273-8c3a-9d66674a785a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:19.449377 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3d2be-eab7-4273-8c3a-9d66674a785a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:19.449525 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3d2be-eab7-4273-8c3a-9d66674a785a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:19.468559 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-17b3d2be-eab7-4273-8c3a-9d66674a785a None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:35:19.469773 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-17b3d2be-eab7-4273-8c3a-9d66674a785a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:35:19.537050 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1425/2802] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:35:19.546963 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9150753-3e7d-4db2-a2b9-07a9994cf9e8 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:35:19.548683 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f9150753-3e7d-4db2-a2b9-07a9994cf9e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:35:19.629817 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9150753-3e7d-4db2-a2b9-07a9994cf9e8 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:35:19.633959 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf098530-bb2e-4c29-b089-42b68576bc70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:35:19.634577 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf098530-bb2e-4c29-b089-42b68576bc70 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:19.634854 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf098530-bb2e-4c29-b089-42b68576bc70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:19.635125 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf098530-bb2e-4c29-b089-42b68576bc70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:19.645128 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf098530-bb2e-4c29-b089-42b68576bc70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:35:19.646592 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf098530-bb2e-4c29-b089-42b68576bc70 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:35:19.656371 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1378/2803] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:35:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:35:19.740355 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c5220-82aa-41d5-945e-90d922c1f453 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:19.740641 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c5220-82aa-41d5-945e-90d922c1f453 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:19.740943 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c5220-82aa-41d5-945e-90d922c1f453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:19.771095 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-695c5220-82aa-41d5-945e-90d922c1f453 None None] MFA Rules not processed for user `9e7444bc40314e73b282217bbb94798d`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:35:19.772298 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-695c5220-82aa-41d5-945e-90d922c1f453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:35:19.839534 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1426/2804] 10.222.0.94 () {58 vars in 1009 bytes} [Thu Sep 1 17:35:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:35:19.887568 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf098530-bb2e-4c29-b089-42b68576bc70 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:35:19.889016 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cf098530-bb2e-4c29-b089-42b68576bc70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:35:19.945323 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c5220-82aa-41d5-945e-90d922c1f453 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:35:19.946999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-695c5220-82aa-41d5-945e-90d922c1f453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:35:19.962075 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf098530-bb2e-4c29-b089-42b68576bc70 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:35:19.963630 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c5220-82aa-41d5-945e-90d922c1f453 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:35:19.967402 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef1c64-9126-420f-9021-5207be0b6f75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7ebf43f36c4862a3c527941e033666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:35:19.968575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef1c64-9126-420f-9021-5207be0b6f75 service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:19.968575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef1c64-9126-420f-9021-5207be0b6f75 service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:19.968575 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef1c64-9126-420f-9021-5207be0b6f75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:19.969697 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ada4ec-64bd-47b8-bbe5-a6d4377d9485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:35:19.970332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ada4ec-64bd-47b8-bbe5-a6d4377d9485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:19.970612 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ada4ec-64bd-47b8-bbe5-a6d4377d9485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:19.970886 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ada4ec-64bd-47b8-bbe5-a6d4377d9485 admin admin] PATH_INFO: `/v3/projects/aeb70c7e5c334832949b1c3b7f9cf231` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:19.972031 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ada4ec-64bd-47b8-bbe5-a6d4377d9485 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeb70c7e5c334832949b1c3b7f9cf231)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:35:19.974316 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ada4ec-64bd-47b8-bbe5-a6d4377d9485 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:35:19.978119 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef1c64-9126-420f-9021-5207be0b6f75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:35:19.980277 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef1c64-9126-420f-9021-5207be0b6f75 service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:35:19.989028 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1379/2805] 10.222.0.94 () {60 vars in 1384 bytes} [Thu Sep 1 17:35:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 17:35:20.013814 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:35:20.044593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b7ada4ec-64bd-47b8-bbe5-a6d4377d9485 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeb70c7e5c334832949b1c3b7f9cf231', 'request_id': 'req-b7ada4ec-64bd-47b8-bbe5-a6d4377d9485'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:35:20.055195 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b7ada4ec-64bd-47b8-bbe5-a6d4377d9485 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeb70c7e5c334832949b1c3b7f9cf231', 'request_id': 'req-b7ada4ec-64bd-47b8-bbe5-a6d4377d9485'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:35:20.062719 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b7ada4ec-64bd-47b8-bbe5-a6d4377d9485 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeb70c7e5c334832949b1c3b7f9cf231', 'request_id': 'req-b7ada4ec-64bd-47b8-bbe5-a6d4377d9485'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:35:20.083243 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b7ada4ec-64bd-47b8-bbe5-a6d4377d9485 admin admin] The token cache is being invalidate because project aeb70c7e5c334832949b1c3b7f9cf231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:35:20.083594 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b7ada4ec-64bd-47b8-bbe5-a6d4377d9485 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:35:20.084184 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b7ada4ec-64bd-47b8-bbe5-a6d4377d9485 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:35:20.088033 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1427/2806] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:35:19 2022] DELETE /identity/v3/projects/aeb70c7e5c334832949b1c3b7f9cf231 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:35:29.985374 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=72,keystone:DELETE=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:35:30.079724 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=14,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:35:33.274042 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d56e73-5bbd-4a6a-89e8-5eee1487d352 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:33.274620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d56e73-5bbd-4a6a-89e8-5eee1487d352 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:33.274620 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d56e73-5bbd-4a6a-89e8-5eee1487d352 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:33.276044 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1380/2807] 10.222.0.94 () {54 vars in 921 bytes} [Thu Sep 1 17:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:35:33.284593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825daf0-0a3e-4c20-af17-b4ecda5d31c1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:33.285133 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825daf0-0a3e-4c20-af17-b4ecda5d31c1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:33.285133 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825daf0-0a3e-4c20-af17-b4ecda5d31c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:33.316638 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f825daf0-0a3e-4c20-af17-b4ecda5d31c1 None None] MFA Rules not processed for user `8b7fa3c4c5d94b3c9b7f17dde35d39a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:35:33.317884 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f825daf0-0a3e-4c20-af17-b4ecda5d31c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:35:33.384606 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1428/2808] 10.222.0.94 () {58 vars in 1018 bytes} [Thu Sep 1 17:35:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:35:33.396289 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d56e73-5bbd-4a6a-89e8-5eee1487d352 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:35:33.398128 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a7d56e73-5bbd-4a6a-89e8-5eee1487d352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:35:33.457106 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d56e73-5bbd-4a6a-89e8-5eee1487d352 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:35:33.460610 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d852ec-843f-4fca-bb5a-13babb536f42 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74c6647f3aa54dc68e888b3adb8c28b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:35:33.461207 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d852ec-843f-4fca-bb5a-13babb536f42 service glance] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:33.461518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d852ec-843f-4fca-bb5a-13babb536f42 service glance] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:33.461793 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d852ec-843f-4fca-bb5a-13babb536f42 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:33.472343 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d852ec-843f-4fca-bb5a-13babb536f42 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:35:33.473856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d852ec-843f-4fca-bb5a-13babb536f42 service glance] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:35:33.484402 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1381/2809] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:35:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:35:33.552708 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dd097-14b1-472c-969b-5fec044e0acc None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:33.552989 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dd097-14b1-472c-969b-5fec044e0acc None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:33.553257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dd097-14b1-472c-969b-5fec044e0acc None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:33.554757 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1429/2810] 10.222.0.94 () {54 vars in 921 bytes} [Thu Sep 1 17:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:35:33.559772 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e6b92-2343-4e9a-9fbc-00a55e7aa7f3 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:33.560058 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e6b92-2343-4e9a-9fbc-00a55e7aa7f3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:33.560330 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e6b92-2343-4e9a-9fbc-00a55e7aa7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:33.580225 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-707e6b92-2343-4e9a-9fbc-00a55e7aa7f3 None None] MFA Rules not processed for user `92edc2953b8e4e42aa64569335acfc9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:35:33.581443 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-707e6b92-2343-4e9a-9fbc-00a55e7aa7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:35:33.630519 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1382/2811] 10.222.0.94 () {58 vars in 1018 bytes} [Thu Sep 1 17:35:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:35:33.642660 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dd097-14b1-472c-969b-5fec044e0acc None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:35:33.644389 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a33dd097-14b1-472c-969b-5fec044e0acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:35:33.657903 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dd097-14b1-472c-969b-5fec044e0acc None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:35:33.661360 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea88e0-8d5d-4edc-92e8-d5db67d4e85f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:35:33.661972 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea88e0-8d5d-4edc-92e8-d5db67d4e85f service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:33.662251 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea88e0-8d5d-4edc-92e8-d5db67d4e85f service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:33.662520 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea88e0-8d5d-4edc-92e8-d5db67d4e85f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:33.669349 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea88e0-8d5d-4edc-92e8-d5db67d4e85f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:35:33.670782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea88e0-8d5d-4edc-92e8-d5db67d4e85f service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:35:33.678685 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1430/2812] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:35:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:35:33.761341 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262dcbd-a2ff-4417-9061-dbdb086c7a53 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:33.761621 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262dcbd-a2ff-4417-9061-dbdb086c7a53 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:33.761898 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262dcbd-a2ff-4417-9061-dbdb086c7a53 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:33.763265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1383/2813] 10.222.0.94 () {54 vars in 921 bytes} [Thu Sep 1 17:35:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 17:35:33.768478 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e72b8a-cd4c-45d1-a7b7-f149d2fc19ee None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:33.768764 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e72b8a-cd4c-45d1-a7b7-f149d2fc19ee None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:33.769038 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e72b8a-cd4c-45d1-a7b7-f149d2fc19ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:33.788601 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-06e72b8a-cd4c-45d1-a7b7-f149d2fc19ee None None] MFA Rules not processed for user `8b7fa3c4c5d94b3c9b7f17dde35d39a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:35:33.789838 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-06e72b8a-cd4c-45d1-a7b7-f149d2fc19ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:35:33.799347 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1431/2814] 10.222.0.94 () {58 vars in 1018 bytes} [Thu Sep 1 17:35:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:35:33.810406 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262dcbd-a2ff-4417-9061-dbdb086c7a53 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:35:33.821335 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262dcbd-a2ff-4417-9061-dbdb086c7a53 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:35:33.826568 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0400d60-2744-41df-b9a9-d689d224a5b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:35:33.827172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0400d60-2744-41df-b9a9-d689d224a5b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:33.827450 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0400d60-2744-41df-b9a9-d689d224a5b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:33.827723 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0400d60-2744-41df-b9a9-d689d224a5b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:33.839538 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0400d60-2744-41df-b9a9-d689d224a5b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:35:33.841171 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0400d60-2744-41df-b9a9-d689d224a5b5 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:35:33.852397 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1384/2815] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:35:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:35:35.814151 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0fb9a-f57e-4e0c-b33f-051cb17b6d24 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:35.814661 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0fb9a-f57e-4e0c-b33f-051cb17b6d24 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:35.814771 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0fb9a-f57e-4e0c-b33f-051cb17b6d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:35.833004 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-dfc0fb9a-f57e-4e0c-b33f-051cb17b6d24 None None] MFA Rules not processed for user `9e7444bc40314e73b282217bbb94798d`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:35:35.834208 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-dfc0fb9a-f57e-4e0c-b33f-051cb17b6d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:35:35.888235 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1432/2816] 10.222.0.94 () {58 vars in 1009 bytes} [Thu Sep 1 17:35:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:35:35.900138 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0400d60-2744-41df-b9a9-d689d224a5b5 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:35:35.902077 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f0400d60-2744-41df-b9a9-d689d224a5b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:35:35.969815 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0400d60-2744-41df-b9a9-d689d224a5b5 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:35:35.975012 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9c294-fb6d-46c5-a58b-e0727f47bc07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7ebf43f36c4862a3c527941e033666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:35:35.975623 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9c294-fb6d-46c5-a58b-e0727f47bc07 service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:35.975901 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9c294-fb6d-46c5-a58b-e0727f47bc07 service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:35.976198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9c294-fb6d-46c5-a58b-e0727f47bc07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:35.985060 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9c294-fb6d-46c5-a58b-e0727f47bc07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:35:35.986693 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9c294-fb6d-46c5-a58b-e0727f47bc07 service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:35:35.994584 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1385/2817] 10.222.0.94 () {60 vars in 1384 bytes} [Thu Sep 1 17:35:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 17:35:45.881618 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=70 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:35:45.991320 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=87 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:35:53.090481 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de1b38-3403-498c-ace2-6e562bda9da2 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:53.090949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de1b38-3403-498c-ace2-6e562bda9da2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:53.091054 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de1b38-3403-498c-ace2-6e562bda9da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:53.110079 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e5de1b38-3403-498c-ace2-6e562bda9da2 None None] MFA Rules not processed for user `9e7444bc40314e73b282217bbb94798d`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:35:53.111271 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e5de1b38-3403-498c-ace2-6e562bda9da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:35:53.118970 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1433/2818] 10.222.0.94 () {58 vars in 967 bytes} [Thu Sep 1 17:35:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:35:53.130934 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9c294-fb6d-46c5-a58b-e0727f47bc07 service swift] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:35:53.141520 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9c294-fb6d-46c5-a58b-e0727f47bc07 service swift] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:35:53.146608 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352044d-9f24-425e-8ed8-71e8d34c9144 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7ebf43f36c4862a3c527941e033666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:35:53.147198 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352044d-9f24-425e-8ed8-71e8d34c9144 service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:35:53.147477 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352044d-9f24-425e-8ed8-71e8d34c9144 service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:35:53.147751 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352044d-9f24-425e-8ed8-71e8d34c9144 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:35:53.155742 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352044d-9f24-425e-8ed8-71e8d34c9144 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:35:53.157312 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352044d-9f24-425e-8ed8-71e8d34c9144 service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:35:53.165979 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1386/2819] 10.222.0.94 () {60 vars in 1384 bytes} [Thu Sep 1 17:35:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 17:36:03.104671 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:03.162730 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=6 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:32.092446 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de1b38-3403-498c-ace2-6e562bda9da2 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:32.101938 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de1b38-3403-498c-ace2-6e562bda9da2 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:32.105462 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be845a5-4fe4-46a4-b262-8b1df5dfcde3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:32.106057 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be845a5-4fe4-46a4-b262-8b1df5dfcde3 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:32.106332 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be845a5-4fe4-46a4-b262-8b1df5dfcde3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:32.106599 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be845a5-4fe4-46a4-b262-8b1df5dfcde3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:32.108292 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6be845a5-4fe4-46a4-b262-8b1df5dfcde3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:36:32.170403 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be845a5-4fe4-46a4-b262-8b1df5dfcde3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:32.170403 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be845a5-4fe4-46a4-b262-8b1df5dfcde3 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:32.180214 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1434/2820] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:36:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:36:35.105974 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352044d-9f24-425e-8ed8-71e8d34c9144 service swift] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:35.108353 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a352044d-9f24-425e-8ed8-71e8d34c9144 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:36:35.131003 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352044d-9f24-425e-8ed8-71e8d34c9144 service swift] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:35.135194 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe4dc8-e68b-4a8c-af51-9c353659eaa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:35.136873 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe4dc8-e68b-4a8c-af51-9c353659eaa4 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:35.137307 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe4dc8-e68b-4a8c-af51-9c353659eaa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:35.137756 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe4dc8-e68b-4a8c-af51-9c353659eaa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:35.139686 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1cbe4dc8-e68b-4a8c-af51-9c353659eaa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:36:35.155172 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe4dc8-e68b-4a8c-af51-9c353659eaa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:35.156857 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe4dc8-e68b-4a8c-af51-9c353659eaa4 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:35.181464 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1387/2821] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:36:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:36:35.573984 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be845a5-4fe4-46a4-b262-8b1df5dfcde3 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:35.576107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6be845a5-4fe4-46a4-b262-8b1df5dfcde3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:36:35.588310 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be845a5-4fe4-46a4-b262-8b1df5dfcde3 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:35.592881 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7863acb-3b57-4a7b-b984-f0f054a841a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:35.593603 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7863acb-3b57-4a7b-b984-f0f054a841a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:35.593948 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7863acb-3b57-4a7b-b984-f0f054a841a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:35.594304 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7863acb-3b57-4a7b-b984-f0f054a841a0 admin admin] PATH_INFO: `/v3/users/56157c6686714d9c976e3890f2055038` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:35.595485 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7863acb-3b57-4a7b-b984-f0f054a841a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56157c6686714d9c976e3890f2055038)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:35.597502 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7863acb-3b57-4a7b-b984-f0f054a841a0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:35.649657 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b7863acb-3b57-4a7b-b984-f0f054a841a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56157c6686714d9c976e3890f2055038'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:35.650252 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b7863acb-3b57-4a7b-b984-f0f054a841a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56157c6686714d9c976e3890f2055038'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:35.664385 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b7863acb-3b57-4a7b-b984-f0f054a841a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56157c6686714d9c976e3890f2055038'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:35.671850 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b7863acb-3b57-4a7b-b984-f0f054a841a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56157c6686714d9c976e3890f2055038'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:35.680240 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b7863acb-3b57-4a7b-b984-f0f054a841a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56157c6686714d9c976e3890f2055038'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:35.686589 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1435/2822] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:36:35 2022] DELETE /identity/v3/users/56157c6686714d9c976e3890f2055038 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:36:35.869012 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe4dc8-e68b-4a8c-af51-9c353659eaa4 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:35.880352 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe4dc8-e68b-4a8c-af51-9c353659eaa4 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:35.949298 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10234f9-f03a-46d2-ac05-b5929706a7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:35.949980 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10234f9-f03a-46d2-ac05-b5929706a7f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:35.950258 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10234f9-f03a-46d2-ac05-b5929706a7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:35.950558 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10234f9-f03a-46d2-ac05-b5929706a7f2 admin admin] PATH_INFO: `/v3/projects/fbf71d45b1ae42ef9fbac874d6dd430f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:35.951694 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10234f9-f03a-46d2-ac05-b5929706a7f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbf71d45b1ae42ef9fbac874d6dd430f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:35.954524 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10234f9-f03a-46d2-ac05-b5929706a7f2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:36.003256 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b10234f9-f03a-46d2-ac05-b5929706a7f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbf71d45b1ae42ef9fbac874d6dd430f', 'request_id': 'req-b10234f9-f03a-46d2-ac05-b5929706a7f2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:36.009872 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b10234f9-f03a-46d2-ac05-b5929706a7f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbf71d45b1ae42ef9fbac874d6dd430f', 'request_id': 'req-b10234f9-f03a-46d2-ac05-b5929706a7f2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:36.016869 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b10234f9-f03a-46d2-ac05-b5929706a7f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbf71d45b1ae42ef9fbac874d6dd430f', 'request_id': 'req-b10234f9-f03a-46d2-ac05-b5929706a7f2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:36.030389 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b10234f9-f03a-46d2-ac05-b5929706a7f2 admin admin] The token cache is being invalidate because project fbf71d45b1ae42ef9fbac874d6dd430f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:36:36.030929 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b10234f9-f03a-46d2-ac05-b5929706a7f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:36.031671 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b10234f9-f03a-46d2-ac05-b5929706a7f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:36.033255 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1388/2823] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:36:35 2022] DELETE /identity/v3/projects/fbf71d45b1ae42ef9fbac874d6dd430f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:36:36.038914 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec2cd4-0c1b-4909-bc1c-b4f523c8a56f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:36.039285 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec2cd4-0c1b-4909-bc1c-b4f523c8a56f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:36.039580 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec2cd4-0c1b-4909-bc1c-b4f523c8a56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:36.060241 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-14ec2cd4-0c1b-4909-bc1c-b4f523c8a56f None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:36:36.061503 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-14ec2cd4-0c1b-4909-bc1c-b4f523c8a56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:36:36.128119 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1436/2824] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:36:36.136569 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b308505-824e-4dec-b50f-ab84ce8f40f0 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:36.137055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b308505-824e-4dec-b50f-ab84ce8f40f0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:36.137152 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b308505-824e-4dec-b50f-ab84ce8f40f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:36.157995 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-1b308505-824e-4dec-b50f-ab84ce8f40f0 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:36:36.159214 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1b308505-824e-4dec-b50f-ab84ce8f40f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:36:36.167185 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1389/2825] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:36:36.171706 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec2cd4-0c1b-4909-bc1c-b4f523c8a56f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:36.181980 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec2cd4-0c1b-4909-bc1c-b4f523c8a56f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:36.186517 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85547c1-c126-4a5a-88a2-4d6485c9f742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:36.187109 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85547c1-c126-4a5a-88a2-4d6485c9f742 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:36.187389 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85547c1-c126-4a5a-88a2-4d6485c9f742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:36.187665 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85547c1-c126-4a5a-88a2-4d6485c9f742 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:36.188308 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85547c1-c126-4a5a-88a2-4d6485c9f742 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:36:36.188624 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85547c1-c126-4a5a-88a2-4d6485c9f742 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:36.190238 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85547c1-c126-4a5a-88a2-4d6485c9f742 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:36.192317 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:36.204627 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1437/2826] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:36:36.209013 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b308505-824e-4dec-b50f-ab84ce8f40f0 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:36.218192 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b308505-824e-4dec-b50f-ab84ce8f40f0 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:36.222806 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e0f29-b63f-46e4-8fca-59f6b29ef655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:36.223398 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e0f29-b63f-46e4-8fca-59f6b29ef655 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:36.223676 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e0f29-b63f-46e4-8fca-59f6b29ef655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:36.223947 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e0f29-b63f-46e4-8fca-59f6b29ef655 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:36.224577 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e0f29-b63f-46e4-8fca-59f6b29ef655 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:36.226515 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e0f29-b63f-46e4-8fca-59f6b29ef655 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:36.265842 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1390/2827] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:36:36 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:36:36.268751 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85547c1-c126-4a5a-88a2-4d6485c9f742 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:36.279194 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85547c1-c126-4a5a-88a2-4d6485c9f742 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:36.341666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a19fd-b6ff-4c18-90f1-42163db6e200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:36.342286 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a19fd-b6ff-4c18-90f1-42163db6e200 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:36.342565 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a19fd-b6ff-4c18-90f1-42163db6e200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:36.342836 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a19fd-b6ff-4c18-90f1-42163db6e200 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:36.343468 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a19fd-b6ff-4c18-90f1-42163db6e200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:36.345488 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a19fd-b6ff-4c18-90f1-42163db6e200 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:36.372372 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1438/2828] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:36:36 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:36:36.373369 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e0f29-b63f-46e4-8fca-59f6b29ef655 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:36.385489 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e0f29-b63f-46e4-8fca-59f6b29ef655 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:36.390301 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699332c-6748-44f4-a7e5-6e5f8e659bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:36.390917 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699332c-6748-44f4-a7e5-6e5f8e659bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:36.391192 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699332c-6748-44f4-a7e5-6e5f8e659bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:36.391480 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699332c-6748-44f4-a7e5-6e5f8e659bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:36.393061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699332c-6748-44f4-a7e5-6e5f8e659bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:36.395276 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699332c-6748-44f4-a7e5-6e5f8e659bd9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:36.406354 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1391/2829] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:36:36.410706 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a19fd-b6ff-4c18-90f1-42163db6e200 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:36.424402 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a19fd-b6ff-4c18-90f1-42163db6e200 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:36.429307 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06df369-c585-4593-848d-5b238d8a2568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:36.430067 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06df369-c585-4593-848d-5b238d8a2568 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:36.430347 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06df369-c585-4593-848d-5b238d8a2568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:36.430619 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06df369-c585-4593-848d-5b238d8a2568 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:36.431372 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06df369-c585-4593-848d-5b238d8a2568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:36.433237 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06df369-c585-4593-848d-5b238d8a2568 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:36.449984 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1439/2830] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:36:36.450419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699332c-6748-44f4-a7e5-6e5f8e659bd9 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:36.462721 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699332c-6748-44f4-a7e5-6e5f8e659bd9 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:36.468930 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c95b7a-0fc2-4abd-94e0-f8d9a0dd5c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:36.469628 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c95b7a-0fc2-4abd-94e0-f8d9a0dd5c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:36.469908 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c95b7a-0fc2-4abd-94e0-f8d9a0dd5c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:36.470179 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c95b7a-0fc2-4abd-94e0-f8d9a0dd5c5f admin admin] PATH_INFO: `/v3/projects/f0e95507ba6f4973a5b9695e45e8a4de/users/c1bf99cac1a94713a9b5b25bbde51eb9/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:36.487390 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c95b7a-0fc2-4abd-94e0-f8d9a0dd5c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e95507ba6f4973a5b9695e45e8a4de, user_id=c1bf99cac1a94713a9b5b25bbde51eb9, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:36.490150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c95b7a-0fc2-4abd-94e0-f8d9a0dd5c5f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:36.515526 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1392/2831] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:36:36 2022] PUT /identity/v3/projects/f0e95507ba6f4973a5b9695e45e8a4de/users/c1bf99cac1a94713a9b5b25bbde51eb9/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:36:36.522118 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cbd7c-cb1d-498d-837d-a927d7f59221 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:36.522847 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cbd7c-cb1d-498d-837d-a927d7f59221 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:36.523123 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cbd7c-cb1d-498d-837d-a927d7f59221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:36.556474 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3f9cbd7c-cb1d-498d-837d-a927d7f59221 None None] MFA Rules not processed for user `c1bf99cac1a94713a9b5b25bbde51eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:36:36.557717 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3f9cbd7c-cb1d-498d-837d-a927d7f59221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:36:36.631217 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1440/2832] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:36:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:36:36.642143 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c95b7a-0fc2-4abd-94e0-f8d9a0dd5c5f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:36.643858 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e5c95b7a-0fc2-4abd-94e0-f8d9a0dd5c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:36:36.650734 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:36.720675 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c95b7a-0fc2-4abd-94e0-f8d9a0dd5c5f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:36.726908 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f33f5-e50b-41b9-a16d-2903f0e6af5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7fa3c4c5d94b3c9b7f17dde35d39a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:36.727521 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f33f5-e50b-41b9-a16d-2903f0e6af5d service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:36.727797 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f33f5-e50b-41b9-a16d-2903f0e6af5d service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:36.728068 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f33f5-e50b-41b9-a16d-2903f0e6af5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:36.736211 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f33f5-e50b-41b9-a16d-2903f0e6af5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:36.737929 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f33f5-e50b-41b9-a16d-2903f0e6af5d service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:36.746864 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1393/2833] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:36:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:36:37.112368 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cbd7c-cb1d-498d-837d-a927d7f59221 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:37.114436 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3f9cbd7c-cb1d-498d-837d-a927d7f59221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:36:37.188583 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cbd7c-cb1d-498d-837d-a927d7f59221 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:37.192442 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3829638-532b-4a29-a02a-cf33aa7f1229 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:37.193323 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3829638-532b-4a29-a02a-cf33aa7f1229 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:37.193724 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3829638-532b-4a29-a02a-cf33aa7f1229 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:37.194068 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3829638-532b-4a29-a02a-cf33aa7f1229 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:37.196061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a3829638-532b-4a29-a02a-cf33aa7f1229 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:36:37.211373 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3829638-532b-4a29-a02a-cf33aa7f1229 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:37.213136 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3829638-532b-4a29-a02a-cf33aa7f1229 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:37.226421 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1441/2834] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:36:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:36:42.166729 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f33f5-e50b-41b9-a16d-2903f0e6af5d service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:42.234458 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f33f5-e50b-41b9-a16d-2903f0e6af5d service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:42.239528 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba0674-838b-441c-baec-92ce20d3c086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:42.240143 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba0674-838b-441c-baec-92ce20d3c086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:42.240419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba0674-838b-441c-baec-92ce20d3c086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:42.240686 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba0674-838b-441c-baec-92ce20d3c086 admin admin] PATH_INFO: `/v3/users/c1bf99cac1a94713a9b5b25bbde51eb9` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:42.241819 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba0674-838b-441c-baec-92ce20d3c086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1bf99cac1a94713a9b5b25bbde51eb9)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:42.243724 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba0674-838b-441c-baec-92ce20d3c086 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:42.291923 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b8ba0674-838b-441c-baec-92ce20d3c086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1bf99cac1a94713a9b5b25bbde51eb9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:42.292520 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b8ba0674-838b-441c-baec-92ce20d3c086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1bf99cac1a94713a9b5b25bbde51eb9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:42.302341 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b8ba0674-838b-441c-baec-92ce20d3c086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1bf99cac1a94713a9b5b25bbde51eb9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:42.303113 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b8ba0674-838b-441c-baec-92ce20d3c086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1bf99cac1a94713a9b5b25bbde51eb9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:42.310426 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b8ba0674-838b-441c-baec-92ce20d3c086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1bf99cac1a94713a9b5b25bbde51eb9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:42.328271 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1394/2835] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:36:42 2022] DELETE /identity/v3/users/c1bf99cac1a94713a9b5b25bbde51eb9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:36:42.332752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ac4fa-3668-4ad8-99de-6ade4b8827a1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:42.333255 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ac4fa-3668-4ad8-99de-6ade4b8827a1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:42.333375 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ac4fa-3668-4ad8-99de-6ade4b8827a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:42.341294 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:42.353593 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b86ac4fa-3668-4ad8-99de-6ade4b8827a1 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:36:42.354808 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b86ac4fa-3668-4ad8-99de-6ade4b8827a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:36:42.414106 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1442/2836] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:36:42.425888 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba0674-838b-441c-baec-92ce20d3c086 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:42.428590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b8ba0674-838b-441c-baec-92ce20d3c086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:36:42.440828 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:42.492578 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba0674-838b-441c-baec-92ce20d3c086 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:42.496313 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037b7e8-cd9e-4bb6-849c-e8500573074d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:42.496920 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037b7e8-cd9e-4bb6-849c-e8500573074d service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:42.497327 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037b7e8-cd9e-4bb6-849c-e8500573074d service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:42.497640 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037b7e8-cd9e-4bb6-849c-e8500573074d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:42.507469 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037b7e8-cd9e-4bb6-849c-e8500573074d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:42.508898 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037b7e8-cd9e-4bb6-849c-e8500573074d service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:42.518379 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1395/2837] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:36:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 17:36:42.943989 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ac4fa-3668-4ad8-99de-6ade4b8827a1 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:42.945637 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b86ac4fa-3668-4ad8-99de-6ade4b8827a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:36:42.958717 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ac4fa-3668-4ad8-99de-6ade4b8827a1 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:42.965655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7f3bf-3387-4d7c-974f-9bc27f302381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:42.966389 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7f3bf-3387-4d7c-974f-9bc27f302381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:42.966739 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7f3bf-3387-4d7c-974f-9bc27f302381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:42.967069 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7f3bf-3387-4d7c-974f-9bc27f302381 admin admin] PATH_INFO: `/v3/projects/f0e95507ba6f4973a5b9695e45e8a4de` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:42.968213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7f3bf-3387-4d7c-974f-9bc27f302381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0e95507ba6f4973a5b9695e45e8a4de)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:42.970179 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7f3bf-3387-4d7c-974f-9bc27f302381 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:43.022763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9bc7f3bf-3387-4d7c-974f-9bc27f302381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0e95507ba6f4973a5b9695e45e8a4de', 'request_id': 'req-9bc7f3bf-3387-4d7c-974f-9bc27f302381'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:43.032708 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9bc7f3bf-3387-4d7c-974f-9bc27f302381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0e95507ba6f4973a5b9695e45e8a4de', 'request_id': 'req-9bc7f3bf-3387-4d7c-974f-9bc27f302381'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:43.036895 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9bc7f3bf-3387-4d7c-974f-9bc27f302381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0e95507ba6f4973a5b9695e45e8a4de', 'request_id': 'req-9bc7f3bf-3387-4d7c-974f-9bc27f302381'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:43.052493 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9bc7f3bf-3387-4d7c-974f-9bc27f302381 admin admin] The token cache is being invalidate because project f0e95507ba6f4973a5b9695e45e8a4de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:36:43.054513 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9bc7f3bf-3387-4d7c-974f-9bc27f302381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:43.054974 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9bc7f3bf-3387-4d7c-974f-9bc27f302381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:43.057029 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1443/2838] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:36:42 2022] DELETE /identity/v3/projects/f0e95507ba6f4973a5b9695e45e8a4de => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:36:43.063931 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0c1fb-52db-452d-b6ce-2fb6a3a6e213 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:43.064326 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0c1fb-52db-452d-b6ce-2fb6a3a6e213 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:43.064703 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0c1fb-52db-452d-b6ce-2fb6a3a6e213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:43.089717 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e1b0c1fb-52db-452d-b6ce-2fb6a3a6e213 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:36:43.091878 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e1b0c1fb-52db-452d-b6ce-2fb6a3a6e213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:36:43.178223 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1396/2839] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:36:43.186804 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811d5c2-a895-4dbb-807c-c5cf023d46bb None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:43.187091 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811d5c2-a895-4dbb-807c-c5cf023d46bb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:43.187395 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811d5c2-a895-4dbb-807c-c5cf023d46bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:43.207914 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5811d5c2-a895-4dbb-807c-c5cf023d46bb None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:36:43.209185 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5811d5c2-a895-4dbb-807c-c5cf023d46bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:36:43.218787 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1444/2840] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:36:43.222953 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0c1fb-52db-452d-b6ce-2fb6a3a6e213 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:43.233804 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0c1fb-52db-452d-b6ce-2fb6a3a6e213 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:43.241746 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547835f-547d-4ca1-a9c6-d4c44f380764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:43.242493 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547835f-547d-4ca1-a9c6-d4c44f380764 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:43.242850 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547835f-547d-4ca1-a9c6-d4c44f380764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:43.243188 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547835f-547d-4ca1-a9c6-d4c44f380764 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:43.243909 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b547835f-547d-4ca1-a9c6-d4c44f380764 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:36:43.244278 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b547835f-547d-4ca1-a9c6-d4c44f380764 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:43.246710 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b547835f-547d-4ca1-a9c6-d4c44f380764 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:43.259733 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1397/2841] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:36:43.263808 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811d5c2-a895-4dbb-807c-c5cf023d46bb None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:43.273458 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811d5c2-a895-4dbb-807c-c5cf023d46bb None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:43.278305 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34590012-e587-4c33-ac2f-2faaf602d153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:43.278920 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34590012-e587-4c33-ac2f-2faaf602d153 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:43.279197 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34590012-e587-4c33-ac2f-2faaf602d153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:43.279465 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34590012-e587-4c33-ac2f-2faaf602d153 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:43.280138 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34590012-e587-4c33-ac2f-2faaf602d153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:43.282095 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34590012-e587-4c33-ac2f-2faaf602d153 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:43.312180 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1445/2842] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:36:43 2022] POST /identity/v3/projects => generated 355 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:36:43.316511 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547835f-547d-4ca1-a9c6-d4c44f380764 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:43.326773 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547835f-547d-4ca1-a9c6-d4c44f380764 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:43.384939 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b709f-afc3-4c47-94f3-4c40c1f4b5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:43.385449 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b709f-afc3-4c47-94f3-4c40c1f4b5d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:43.385727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b709f-afc3-4c47-94f3-4c40c1f4b5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:43.385996 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b709f-afc3-4c47-94f3-4c40c1f4b5d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:43.386626 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b709f-afc3-4c47-94f3-4c40c1f4b5d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:43.388523 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b709f-afc3-4c47-94f3-4c40c1f4b5d3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:43.416594 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1398/2843] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:36:43 2022] POST /identity/v3/users => generated 278 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:36:43.417960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34590012-e587-4c33-ac2f-2faaf602d153 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:43.430010 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34590012-e587-4c33-ac2f-2faaf602d153 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:43.434603 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95ef77-5b6c-44ea-a5be-fe541f56ba94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:43.435201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95ef77-5b6c-44ea-a5be-fe541f56ba94 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:43.435474 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95ef77-5b6c-44ea-a5be-fe541f56ba94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:43.436206 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95ef77-5b6c-44ea-a5be-fe541f56ba94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:43.436368 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95ef77-5b6c-44ea-a5be-fe541f56ba94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:43.438059 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95ef77-5b6c-44ea-a5be-fe541f56ba94 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:43.449790 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1446/2844] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:36:43.453812 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b709f-afc3-4c47-94f3-4c40c1f4b5d3 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:43.463876 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b709f-afc3-4c47-94f3-4c40c1f4b5d3 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:43.468595 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b173aa4-a2c1-445d-abb9-ec146992a14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:43.469193 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b173aa4-a2c1-445d-abb9-ec146992a14d admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:43.469505 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b173aa4-a2c1-445d-abb9-ec146992a14d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:43.469780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b173aa4-a2c1-445d-abb9-ec146992a14d admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:43.470417 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b173aa4-a2c1-445d-abb9-ec146992a14d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:43.472015 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b173aa4-a2c1-445d-abb9-ec146992a14d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:43.482019 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1399/2845] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:36:43.486133 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95ef77-5b6c-44ea-a5be-fe541f56ba94 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:43.496815 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95ef77-5b6c-44ea-a5be-fe541f56ba94 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:43.501649 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fd1db-1f7d-477c-9356-e36d24834708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:43.502306 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fd1db-1f7d-477c-9356-e36d24834708 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:43.502588 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fd1db-1f7d-477c-9356-e36d24834708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:43.502865 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fd1db-1f7d-477c-9356-e36d24834708 admin admin] PATH_INFO: `/v3/projects/4bed8f7a190c4cd3aaa07d891760bc04/users/45eb73d7e65e40e3a4a8c6177faeccef/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:43.519118 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fd1db-1f7d-477c-9356-e36d24834708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bed8f7a190c4cd3aaa07d891760bc04, user_id=45eb73d7e65e40e3a4a8c6177faeccef, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:43.522076 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fd1db-1f7d-477c-9356-e36d24834708 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:43.545256 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1447/2846] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:36:43 2022] PUT /identity/v3/projects/4bed8f7a190c4cd3aaa07d891760bc04/users/45eb73d7e65e40e3a4a8c6177faeccef/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:36:43.549095 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4704537-2ec1-491b-8352-1eb973ac265a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:43.549095 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4704537-2ec1-491b-8352-1eb973ac265a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:43.549311 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4704537-2ec1-491b-8352-1eb973ac265a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:43.579935 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d4704537-2ec1-491b-8352-1eb973ac265a None None] MFA Rules not processed for user `45eb73d7e65e40e3a4a8c6177faeccef`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:36:43.581162 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d4704537-2ec1-491b-8352-1eb973ac265a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:36:43.589019 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:43.659144 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1400/2847] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:36:43 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:36:43.664140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fd1db-1f7d-477c-9356-e36d24834708 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:43.695038 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:43.738482 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fd1db-1f7d-477c-9356-e36d24834708 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:43.748759 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75970300-cc69-4653-95d8-ad690210b698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:43.749678 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75970300-cc69-4653-95d8-ad690210b698 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:43.750136 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75970300-cc69-4653-95d8-ad690210b698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:43.750562 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75970300-cc69-4653-95d8-ad690210b698 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:43.751576 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75970300-cc69-4653-95d8-ad690210b698 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:43.753321 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75970300-cc69-4653-95d8-ad690210b698 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:43.784448 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1448/2848] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:36:43 2022] POST /identity/v3/projects => generated 357 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:36:43.789608 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4704537-2ec1-491b-8352-1eb973ac265a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:43.803341 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4704537-2ec1-491b-8352-1eb973ac265a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:43.876460 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683654b2-9dc6-4c49-b1e6-34d36c8dbcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:43.877084 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683654b2-9dc6-4c49-b1e6-34d36c8dbcdd admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:43.877360 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683654b2-9dc6-4c49-b1e6-34d36c8dbcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:43.877678 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683654b2-9dc6-4c49-b1e6-34d36c8dbcdd admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:43.878309 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683654b2-9dc6-4c49-b1e6-34d36c8dbcdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:43.880836 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683654b2-9dc6-4c49-b1e6-34d36c8dbcdd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:43.915438 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1401/2849] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:36:43 2022] POST /identity/v3/users => generated 285 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:36:43.916612 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75970300-cc69-4653-95d8-ad690210b698 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:43.930458 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75970300-cc69-4653-95d8-ad690210b698 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:43.937733 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b176f-9d82-431e-8bb6-67b0e1c8f490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:43.938389 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b176f-9d82-431e-8bb6-67b0e1c8f490 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:43.938789 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b176f-9d82-431e-8bb6-67b0e1c8f490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:43.939102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b176f-9d82-431e-8bb6-67b0e1c8f490 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:43.939908 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b176f-9d82-431e-8bb6-67b0e1c8f490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:43.943061 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b176f-9d82-431e-8bb6-67b0e1c8f490 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:43.962420 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1449/2850] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:36:43.963615 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683654b2-9dc6-4c49-b1e6-34d36c8dbcdd admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:43.975068 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683654b2-9dc6-4c49-b1e6-34d36c8dbcdd admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:43.981501 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88c8e4-fb73-4180-96ff-40259209293d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:43.982386 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88c8e4-fb73-4180-96ff-40259209293d admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:43.982760 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88c8e4-fb73-4180-96ff-40259209293d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:43.983197 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88c8e4-fb73-4180-96ff-40259209293d admin admin] PATH_INFO: `/v3/projects/e91c0dfc86f3485e96d49f71b58abfdb/users/b499694bda4d402aaf35302de28e3fb1/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:44.005102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88c8e4-fb73-4180-96ff-40259209293d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e91c0dfc86f3485e96d49f71b58abfdb, user_id=b499694bda4d402aaf35302de28e3fb1, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:44.008114 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88c8e4-fb73-4180-96ff-40259209293d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:44.030252 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1402/2851] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:36:43 2022] PUT /identity/v3/projects/e91c0dfc86f3485e96d49f71b58abfdb/users/b499694bda4d402aaf35302de28e3fb1/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:36:44.031832 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b176f-9d82-431e-8bb6-67b0e1c8f490 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:44.043667 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b176f-9d82-431e-8bb6-67b0e1c8f490 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:44.116925 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4e514-6c27-47b2-ac9f-3411ce3fab83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:44.118197 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4e514-6c27-47b2-ac9f-3411ce3fab83 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:44.118476 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4e514-6c27-47b2-ac9f-3411ce3fab83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:44.118749 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4e514-6c27-47b2-ac9f-3411ce3fab83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:44.119718 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4e514-6c27-47b2-ac9f-3411ce3fab83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:44.121480 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4e514-6c27-47b2-ac9f-3411ce3fab83 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:44.134607 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1450/2852] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:36:44.139149 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88c8e4-fb73-4180-96ff-40259209293d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:44.159157 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88c8e4-fb73-4180-96ff-40259209293d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:44.164655 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df7c91-91d0-4626-a068-0c473d5c7dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:44.165389 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df7c91-91d0-4626-a068-0c473d5c7dfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:44.165762 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df7c91-91d0-4626-a068-0c473d5c7dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:44.166126 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df7c91-91d0-4626-a068-0c473d5c7dfc admin admin] PATH_INFO: `/v3/projects/e91c0dfc86f3485e96d49f71b58abfdb/users/b499694bda4d402aaf35302de28e3fb1/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:44.168122 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df7c91-91d0-4626-a068-0c473d5c7dfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e91c0dfc86f3485e96d49f71b58abfdb, user_id=b499694bda4d402aaf35302de28e3fb1, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:44.172755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df7c91-91d0-4626-a068-0c473d5c7dfc admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:44.185291 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1403/2853] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:36:44 2022] PUT /identity/v3/projects/e91c0dfc86f3485e96d49f71b58abfdb/users/b499694bda4d402aaf35302de28e3fb1/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:36:44.195605 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bebae5-9cfa-4aab-b984-59a07ca2ea5f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:44.195884 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bebae5-9cfa-4aab-b984-59a07ca2ea5f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:44.196148 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bebae5-9cfa-4aab-b984-59a07ca2ea5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:44.224283 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-68bebae5-9cfa-4aab-b984-59a07ca2ea5f None None] MFA Rules not processed for user `b499694bda4d402aaf35302de28e3fb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:36:44.225522 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-68bebae5-9cfa-4aab-b984-59a07ca2ea5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:36:44.293107 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1451/2854] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:36:44 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:36:44.304697 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df7c91-91d0-4626-a068-0c473d5c7dfc admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:44.306429 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a2df7c91-91d0-4626-a068-0c473d5c7dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:36:44.365987 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df7c91-91d0-4626-a068-0c473d5c7dfc admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:44.373763 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff6230-558f-4b5e-a310-a36e3888837c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:44.374378 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff6230-558f-4b5e-a310-a36e3888837c service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:44.374656 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff6230-558f-4b5e-a310-a36e3888837c service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:44.374928 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff6230-558f-4b5e-a310-a36e3888837c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:44.385120 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff6230-558f-4b5e-a310-a36e3888837c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:44.386617 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff6230-558f-4b5e-a310-a36e3888837c service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:44.396515 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1404/2855] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:36:44 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:36:44.474295 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bebae5-9cfa-4aab-b984-59a07ca2ea5f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:44.484644 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bebae5-9cfa-4aab-b984-59a07ca2ea5f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:44.489432 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3e9be-5365-46d4-aa9f-6295bd1da82b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:44.489742 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3e9be-5365-46d4-aa9f-6295bd1da82b service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:44.490020 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3e9be-5365-46d4-aa9f-6295bd1da82b service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:44.490287 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3e9be-5365-46d4-aa9f-6295bd1da82b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:44.509478 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:44.565360 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3e9be-5365-46d4-aa9f-6295bd1da82b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:44.567025 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3e9be-5365-46d4-aa9f-6295bd1da82b service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:44.577674 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1452/2856] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:36:44 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:36:45.474986 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff6230-558f-4b5e-a310-a36e3888837c service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:45.476473 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b7ff6230-558f-4b5e-a310-a36e3888837c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:36:45.481915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:45.548860 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff6230-558f-4b5e-a310-a36e3888837c service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:45.556839 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42ae6a-ebda-4174-91d0-45e17163fa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:45.557677 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42ae6a-ebda-4174-91d0-45e17163fa09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:45.558009 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42ae6a-ebda-4174-91d0-45e17163fa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:45.558275 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42ae6a-ebda-4174-91d0-45e17163fa09 admin admin] PATH_INFO: `/v3/users/c40997cd216b4aa191e9c2b292677dbe` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:45.559398 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e42ae6a-ebda-4174-91d0-45e17163fa09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c40997cd216b4aa191e9c2b292677dbe)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:45.562038 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e42ae6a-ebda-4174-91d0-45e17163fa09 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:45.608100 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2e42ae6a-ebda-4174-91d0-45e17163fa09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c40997cd216b4aa191e9c2b292677dbe'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:45.608739 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2e42ae6a-ebda-4174-91d0-45e17163fa09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c40997cd216b4aa191e9c2b292677dbe'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:45.615658 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2e42ae6a-ebda-4174-91d0-45e17163fa09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c40997cd216b4aa191e9c2b292677dbe'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:45.616271 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2e42ae6a-ebda-4174-91d0-45e17163fa09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c40997cd216b4aa191e9c2b292677dbe'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:45.623597 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2e42ae6a-ebda-4174-91d0-45e17163fa09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c40997cd216b4aa191e9c2b292677dbe'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:45.640999 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1405/2857] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:36:45 2022] DELETE /identity/v3/users/c40997cd216b4aa191e9c2b292677dbe => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:36:45.821783 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3e9be-5365-46d4-aa9f-6295bd1da82b service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:45.836176 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3e9be-5365-46d4-aa9f-6295bd1da82b service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:45.917765 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb735a-7b1d-4e51-85ab-605ed56098f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:45.918404 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb735a-7b1d-4e51-85ab-605ed56098f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:45.918685 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb735a-7b1d-4e51-85ab-605ed56098f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:45.918957 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb735a-7b1d-4e51-85ab-605ed56098f4 admin admin] PATH_INFO: `/v3/projects/8c275a3570bf4b3ca85f81b03d23b529` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:45.920255 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb735a-7b1d-4e51-85ab-605ed56098f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c275a3570bf4b3ca85f81b03d23b529)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:45.923132 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb735a-7b1d-4e51-85ab-605ed56098f4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:45.974192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-50eb735a-7b1d-4e51-85ab-605ed56098f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c275a3570bf4b3ca85f81b03d23b529', 'request_id': 'req-50eb735a-7b1d-4e51-85ab-605ed56098f4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:45.979713 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-50eb735a-7b1d-4e51-85ab-605ed56098f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c275a3570bf4b3ca85f81b03d23b529', 'request_id': 'req-50eb735a-7b1d-4e51-85ab-605ed56098f4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:45.985823 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-50eb735a-7b1d-4e51-85ab-605ed56098f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c275a3570bf4b3ca85f81b03d23b529', 'request_id': 'req-50eb735a-7b1d-4e51-85ab-605ed56098f4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:45.997924 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-50eb735a-7b1d-4e51-85ab-605ed56098f4 admin admin] The token cache is being invalidate because project 8c275a3570bf4b3ca85f81b03d23b529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:36:45.998213 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-50eb735a-7b1d-4e51-85ab-605ed56098f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:45.998858 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-50eb735a-7b1d-4e51-85ab-605ed56098f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:46.000339 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1453/2858] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:36:45 2022] DELETE /identity/v3/projects/8c275a3570bf4b3ca85f81b03d23b529 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:36:46.004451 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42ae6a-ebda-4174-91d0-45e17163fa09 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:46.005887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2e42ae6a-ebda-4174-91d0-45e17163fa09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:36:46.018703 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42ae6a-ebda-4174-91d0-45e17163fa09 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:46.078567 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be90da2-cc06-4a20-9204-96e6fe7a6b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:46.079205 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be90da2-cc06-4a20-9204-96e6fe7a6b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:46.079480 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be90da2-cc06-4a20-9204-96e6fe7a6b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:46.079749 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be90da2-cc06-4a20-9204-96e6fe7a6b1e admin admin] PATH_INFO: `/v3/users/c9e93d2692fc4dae803f13c23dd13195` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:46.080877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be90da2-cc06-4a20-9204-96e6fe7a6b1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9e93d2692fc4dae803f13c23dd13195)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:46.083451 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be90da2-cc06-4a20-9204-96e6fe7a6b1e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:46.105079 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:46.130022 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5be90da2-cc06-4a20-9204-96e6fe7a6b1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9e93d2692fc4dae803f13c23dd13195'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:46.130666 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5be90da2-cc06-4a20-9204-96e6fe7a6b1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9e93d2692fc4dae803f13c23dd13195'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:46.137785 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5be90da2-cc06-4a20-9204-96e6fe7a6b1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9e93d2692fc4dae803f13c23dd13195'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:46.138392 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5be90da2-cc06-4a20-9204-96e6fe7a6b1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9e93d2692fc4dae803f13c23dd13195'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:46.145855 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5be90da2-cc06-4a20-9204-96e6fe7a6b1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9e93d2692fc4dae803f13c23dd13195'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:46.162838 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1406/2859] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:36:46 2022] DELETE /identity/v3/users/c9e93d2692fc4dae803f13c23dd13195 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:36:46.333931 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb735a-7b1d-4e51-85ab-605ed56098f4 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:46.335676 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-50eb735a-7b1d-4e51-85ab-605ed56098f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:36:46.351099 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb735a-7b1d-4e51-85ab-605ed56098f4 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:46.400099 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:46.413162 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90410d76-798c-463f-92bd-90f0b53018eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:46.413825 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90410d76-798c-463f-92bd-90f0b53018eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:46.414103 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90410d76-798c-463f-92bd-90f0b53018eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:46.414371 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90410d76-798c-463f-92bd-90f0b53018eb admin admin] PATH_INFO: `/v3/projects/2e59eec34af4431f81e19cb926c8b6d2` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:46.415477 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90410d76-798c-463f-92bd-90f0b53018eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e59eec34af4431f81e19cb926c8b6d2)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:46.417444 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90410d76-798c-463f-92bd-90f0b53018eb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:46.463191 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-90410d76-798c-463f-92bd-90f0b53018eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e59eec34af4431f81e19cb926c8b6d2', 'request_id': 'req-90410d76-798c-463f-92bd-90f0b53018eb'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:46.468536 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-90410d76-798c-463f-92bd-90f0b53018eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e59eec34af4431f81e19cb926c8b6d2', 'request_id': 'req-90410d76-798c-463f-92bd-90f0b53018eb'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:46.475059 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-90410d76-798c-463f-92bd-90f0b53018eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e59eec34af4431f81e19cb926c8b6d2', 'request_id': 'req-90410d76-798c-463f-92bd-90f0b53018eb'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:46.487910 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-90410d76-798c-463f-92bd-90f0b53018eb admin admin] The token cache is being invalidate because project 2e59eec34af4431f81e19cb926c8b6d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:36:46.488192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-90410d76-798c-463f-92bd-90f0b53018eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:46.488853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-90410d76-798c-463f-92bd-90f0b53018eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:46.490428 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1454/2860] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:36:46 2022] DELETE /identity/v3/projects/2e59eec34af4431f81e19cb926c8b6d2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:36:56.159373 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=20,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:56.484914 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=29,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:59.355799 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be90da2-cc06-4a20-9204-96e6fe7a6b1e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:59.357220 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5be90da2-cc06-4a20-9204-96e6fe7a6b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:36:59.369864 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be90da2-cc06-4a20-9204-96e6fe7a6b1e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:59.426953 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264fe5a-cede-4e8a-8b3b-136e35ab3714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:59.428130 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264fe5a-cede-4e8a-8b3b-136e35ab3714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:59.428444 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264fe5a-cede-4e8a-8b3b-136e35ab3714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:59.428719 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264fe5a-cede-4e8a-8b3b-136e35ab3714 admin admin] PATH_INFO: `/v3/users/45eb73d7e65e40e3a4a8c6177faeccef` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:59.429889 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264fe5a-cede-4e8a-8b3b-136e35ab3714 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45eb73d7e65e40e3a4a8c6177faeccef)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:59.431824 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264fe5a-cede-4e8a-8b3b-136e35ab3714 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:59.480963 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3264fe5a-cede-4e8a-8b3b-136e35ab3714 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45eb73d7e65e40e3a4a8c6177faeccef'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:59.481773 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3264fe5a-cede-4e8a-8b3b-136e35ab3714 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45eb73d7e65e40e3a4a8c6177faeccef'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:59.489996 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3264fe5a-cede-4e8a-8b3b-136e35ab3714 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45eb73d7e65e40e3a4a8c6177faeccef'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:59.491270 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3264fe5a-cede-4e8a-8b3b-136e35ab3714 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45eb73d7e65e40e3a4a8c6177faeccef'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:59.498140 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3264fe5a-cede-4e8a-8b3b-136e35ab3714 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45eb73d7e65e40e3a4a8c6177faeccef'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:36:59.515147 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1407/2861] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:36:59 2022] DELETE /identity/v3/users/45eb73d7e65e40e3a4a8c6177faeccef => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:36:59.519983 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f5a76-0345-4e72-9ce5-0c244d62b6fe None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:59.520617 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f5a76-0345-4e72-9ce5-0c244d62b6fe None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:59.520748 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f5a76-0345-4e72-9ce5-0c244d62b6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:59.541039 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-496f5a76-0345-4e72-9ce5-0c244d62b6fe None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:36:59.542309 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-496f5a76-0345-4e72-9ce5-0c244d62b6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:36:59.600134 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1455/2862] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:36:59.609783 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264fe5a-cede-4e8a-8b3b-136e35ab3714 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:59.611190 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3264fe5a-cede-4e8a-8b3b-136e35ab3714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:36:59.666445 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264fe5a-cede-4e8a-8b3b-136e35ab3714 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:59.670291 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb10c6-6492-42fb-9365-1c09642f5730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:59.670885 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb10c6-6492-42fb-9365-1c09642f5730 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:59.671155 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb10c6-6492-42fb-9365-1c09642f5730 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:59.671419 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb10c6-6492-42fb-9365-1c09642f5730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:59.680689 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb10c6-6492-42fb-9365-1c09642f5730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:59.682126 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb10c6-6492-42fb-9365-1c09642f5730 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:36:59.691323 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1408/2863] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:36:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:36:59.957127 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f5a76-0345-4e72-9ce5-0c244d62b6fe None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:36:59.958655 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-496f5a76-0345-4e72-9ce5-0c244d62b6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:36:59.973110 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f5a76-0345-4e72-9ce5-0c244d62b6fe None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:36:59.978417 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb65612-7209-42eb-818d-d6e7fe125685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:36:59.979194 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb65612-7209-42eb-818d-d6e7fe125685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:36:59.979576 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb65612-7209-42eb-818d-d6e7fe125685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:36:59.979915 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb65612-7209-42eb-818d-d6e7fe125685 admin admin] PATH_INFO: `/v3/projects/4bed8f7a190c4cd3aaa07d891760bc04` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:36:59.981101 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb65612-7209-42eb-818d-d6e7fe125685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bed8f7a190c4cd3aaa07d891760bc04)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:36:59.983616 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb65612-7209-42eb-818d-d6e7fe125685 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:00.033302 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fcb65612-7209-42eb-818d-d6e7fe125685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bed8f7a190c4cd3aaa07d891760bc04', 'request_id': 'req-fcb65612-7209-42eb-818d-d6e7fe125685'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:00.040583 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fcb65612-7209-42eb-818d-d6e7fe125685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bed8f7a190c4cd3aaa07d891760bc04', 'request_id': 'req-fcb65612-7209-42eb-818d-d6e7fe125685'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:00.047611 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fcb65612-7209-42eb-818d-d6e7fe125685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bed8f7a190c4cd3aaa07d891760bc04', 'request_id': 'req-fcb65612-7209-42eb-818d-d6e7fe125685'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:00.059668 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fcb65612-7209-42eb-818d-d6e7fe125685 admin admin] The token cache is being invalidate because project 4bed8f7a190c4cd3aaa07d891760bc04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:37:00.059954 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fcb65612-7209-42eb-818d-d6e7fe125685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:00.060561 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fcb65612-7209-42eb-818d-d6e7fe125685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:00.062110 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1456/2864] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:36:59 2022] DELETE /identity/v3/projects/4bed8f7a190c4cd3aaa07d891760bc04 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:37:00.066096 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb10c6-6492-42fb-9365-1c09642f5730 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:00.075758 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb10c6-6492-42fb-9365-1c09642f5730 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:00.094083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:00.134873 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf391e4c-467a-44ab-b76d-8d45350db403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:00.135528 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf391e4c-467a-44ab-b76d-8d45350db403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:00.135779 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf391e4c-467a-44ab-b76d-8d45350db403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:00.136050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf391e4c-467a-44ab-b76d-8d45350db403 admin admin] PATH_INFO: `/v3/users/b499694bda4d402aaf35302de28e3fb1` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:00.137160 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf391e4c-467a-44ab-b76d-8d45350db403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b499694bda4d402aaf35302de28e3fb1)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:00.139106 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf391e4c-467a-44ab-b76d-8d45350db403 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:00.184607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bf391e4c-467a-44ab-b76d-8d45350db403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b499694bda4d402aaf35302de28e3fb1'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:00.185359 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bf391e4c-467a-44ab-b76d-8d45350db403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b499694bda4d402aaf35302de28e3fb1'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:00.192669 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bf391e4c-467a-44ab-b76d-8d45350db403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b499694bda4d402aaf35302de28e3fb1'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:00.193828 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bf391e4c-467a-44ab-b76d-8d45350db403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b499694bda4d402aaf35302de28e3fb1'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:00.203866 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bf391e4c-467a-44ab-b76d-8d45350db403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b499694bda4d402aaf35302de28e3fb1'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:00.221906 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1409/2865] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:37:00 2022] DELETE /identity/v3/users/b499694bda4d402aaf35302de28e3fb1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 17:37:00.485130 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb65612-7209-42eb-818d-d6e7fe125685 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:00.486612 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fcb65612-7209-42eb-818d-d6e7fe125685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:00.502144 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb65612-7209-42eb-818d-d6e7fe125685 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:00.559804 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29cd7b-5939-4258-8f64-70b4342fff17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:00.560454 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29cd7b-5939-4258-8f64-70b4342fff17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:00.560688 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29cd7b-5939-4258-8f64-70b4342fff17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:00.560953 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29cd7b-5939-4258-8f64-70b4342fff17 admin admin] PATH_INFO: `/v3/projects/e91c0dfc86f3485e96d49f71b58abfdb` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:00.562064 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29cd7b-5939-4258-8f64-70b4342fff17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e91c0dfc86f3485e96d49f71b58abfdb)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:00.563939 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29cd7b-5939-4258-8f64-70b4342fff17 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:00.593440 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:00.611375 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1f29cd7b-5939-4258-8f64-70b4342fff17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e91c0dfc86f3485e96d49f71b58abfdb', 'request_id': 'req-1f29cd7b-5939-4258-8f64-70b4342fff17'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:00.616846 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1f29cd7b-5939-4258-8f64-70b4342fff17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e91c0dfc86f3485e96d49f71b58abfdb', 'request_id': 'req-1f29cd7b-5939-4258-8f64-70b4342fff17'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:00.622949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1f29cd7b-5939-4258-8f64-70b4342fff17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e91c0dfc86f3485e96d49f71b58abfdb', 'request_id': 'req-1f29cd7b-5939-4258-8f64-70b4342fff17'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:00.634781 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1f29cd7b-5939-4258-8f64-70b4342fff17 admin admin] The token cache is being invalidate because project e91c0dfc86f3485e96d49f71b58abfdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:37:00.635088 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1f29cd7b-5939-4258-8f64-70b4342fff17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:00.635697 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1f29cd7b-5939-4258-8f64-70b4342fff17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:00.637207 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1457/2866] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:37:00 2022] DELETE /identity/v3/projects/e91c0dfc86f3485e96d49f71b58abfdb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:37:00.642168 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ef770-0d65-461f-a801-30bb0eb2bd67 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:00.642645 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ef770-0d65-461f-a801-30bb0eb2bd67 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:00.642754 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ef770-0d65-461f-a801-30bb0eb2bd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:00.663070 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c55ef770-0d65-461f-a801-30bb0eb2bd67 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:37:00.664252 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c55ef770-0d65-461f-a801-30bb0eb2bd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:00.721009 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1410/2867] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:37:00.729454 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d15df-1674-4352-a8d0-9ec08d747ce9 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:00.729765 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d15df-1674-4352-a8d0-9ec08d747ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:00.730019 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d15df-1674-4352-a8d0-9ec08d747ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:00.749142 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-dd6d15df-1674-4352-a8d0-9ec08d747ce9 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:37:00.750393 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-dd6d15df-1674-4352-a8d0-9ec08d747ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:00.758206 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1458/2868] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:37:00.762234 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ef770-0d65-461f-a801-30bb0eb2bd67 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:00.772555 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ef770-0d65-461f-a801-30bb0eb2bd67 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:00.777103 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daddd94-d459-4a8c-af08-98538361a038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:00.777724 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daddd94-d459-4a8c-af08-98538361a038 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:00.777998 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daddd94-d459-4a8c-af08-98538361a038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:00.778265 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daddd94-d459-4a8c-af08-98538361a038 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:00.778902 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daddd94-d459-4a8c-af08-98538361a038 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:37:00.779200 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daddd94-d459-4a8c-af08-98538361a038 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:00.780770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daddd94-d459-4a8c-af08-98538361a038 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:00.792542 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1411/2869] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 17:37:00.797034 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d15df-1674-4352-a8d0-9ec08d747ce9 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:00.806356 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d15df-1674-4352-a8d0-9ec08d747ce9 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:00.810980 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40982ff-66b5-44c3-8605-abbb87a5b42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:00.811564 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40982ff-66b5-44c3-8605-abbb87a5b42f admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:00.811837 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40982ff-66b5-44c3-8605-abbb87a5b42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:00.812102 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40982ff-66b5-44c3-8605-abbb87a5b42f admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:00.812748 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40982ff-66b5-44c3-8605-abbb87a5b42f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:00.814653 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40982ff-66b5-44c3-8605-abbb87a5b42f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:00.840825 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1459/2870] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:37:00 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:37:00.845012 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daddd94-d459-4a8c-af08-98538361a038 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:00.854824 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daddd94-d459-4a8c-af08-98538361a038 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:00.881527 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:00.912770 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afed044-6dad-40e4-b923-3eae74866201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:00.913364 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afed044-6dad-40e4-b923-3eae74866201 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:00.913686 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afed044-6dad-40e4-b923-3eae74866201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:00.913977 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afed044-6dad-40e4-b923-3eae74866201 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:00.914607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afed044-6dad-40e4-b923-3eae74866201 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:00.916534 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afed044-6dad-40e4-b923-3eae74866201 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:00.937570 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1412/2871] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:37:00 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:37:00.941787 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40982ff-66b5-44c3-8605-abbb87a5b42f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:00.952387 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40982ff-66b5-44c3-8605-abbb87a5b42f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:00.956898 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454e52c-bbd4-4522-8fe9-c0a3409a136a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:00.957511 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454e52c-bbd4-4522-8fe9-c0a3409a136a admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:00.957783 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454e52c-bbd4-4522-8fe9-c0a3409a136a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:00.958049 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454e52c-bbd4-4522-8fe9-c0a3409a136a admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:00.958680 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454e52c-bbd4-4522-8fe9-c0a3409a136a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:00.960247 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454e52c-bbd4-4522-8fe9-c0a3409a136a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:00.969773 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1460/2872] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:37:00.973518 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afed044-6dad-40e4-b923-3eae74866201 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:00.983634 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afed044-6dad-40e4-b923-3eae74866201 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:00.988290 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c1267-f750-4614-8662-19b7030a28c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:00.988863 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c1267-f750-4614-8662-19b7030a28c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:00.989134 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c1267-f750-4614-8662-19b7030a28c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:00.989422 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c1267-f750-4614-8662-19b7030a28c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:00.990629 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c1267-f750-4614-8662-19b7030a28c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:00.992186 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c1267-f750-4614-8662-19b7030a28c0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:01.001723 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1413/2873] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:37:01.005662 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454e52c-bbd4-4522-8fe9-c0a3409a136a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:01.015507 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454e52c-bbd4-4522-8fe9-c0a3409a136a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:01.020130 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32e285-0646-41c7-bc35-50960888b508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:01.020769 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32e285-0646-41c7-bc35-50960888b508 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:01.021051 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32e285-0646-41c7-bc35-50960888b508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:01.021322 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32e285-0646-41c7-bc35-50960888b508 admin admin] PATH_INFO: `/v3/projects/16240fddbe4549f5a72d322a3332d57f/users/3d5468ec6e754b9e8aed876c3354a1cc/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:01.035374 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32e285-0646-41c7-bc35-50960888b508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16240fddbe4549f5a72d322a3332d57f, user_id=3d5468ec6e754b9e8aed876c3354a1cc, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:01.038641 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32e285-0646-41c7-bc35-50960888b508 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:01.053521 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1461/2874] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:37:01 2022] PUT /identity/v3/projects/16240fddbe4549f5a72d322a3332d57f/users/3d5468ec6e754b9e8aed876c3354a1cc/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:37:01.063711 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8058f3-b133-452c-86ae-531f34a09a12 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:01.063993 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8058f3-b133-452c-86ae-531f34a09a12 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:01.064261 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8058f3-b133-452c-86ae-531f34a09a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:01.091354 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5a8058f3-b133-452c-86ae-531f34a09a12 None None] MFA Rules not processed for user `3d5468ec6e754b9e8aed876c3354a1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:37:01.092628 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5a8058f3-b133-452c-86ae-531f34a09a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:01.156309 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1414/2875] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:37:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:37:01.160738 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32e285-0646-41c7-bc35-50960888b508 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:01.223425 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32e285-0646-41c7-bc35-50960888b508 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:01.228505 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517908f0-51ce-4110-a796-d3703e736fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:01.229097 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517908f0-51ce-4110-a796-d3703e736fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:01.229371 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517908f0-51ce-4110-a796-d3703e736fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:01.229679 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517908f0-51ce-4110-a796-d3703e736fb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:01.230294 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517908f0-51ce-4110-a796-d3703e736fb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:01.232171 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517908f0-51ce-4110-a796-d3703e736fb7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:01.259610 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1462/2876] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:37:01 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:37:01.263652 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8058f3-b133-452c-86ae-531f34a09a12 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:01.274295 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8058f3-b133-452c-86ae-531f34a09a12 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:01.330645 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8b588-4cdd-4161-911d-b1c00f012616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:01.331247 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8b588-4cdd-4161-911d-b1c00f012616 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:01.331578 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8b588-4cdd-4161-911d-b1c00f012616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:01.331848 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8b588-4cdd-4161-911d-b1c00f012616 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:01.332463 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8b588-4cdd-4161-911d-b1c00f012616 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:01.334435 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8b588-4cdd-4161-911d-b1c00f012616 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:01.355490 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1415/2877] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:37:01 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:37:01.359520 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517908f0-51ce-4110-a796-d3703e736fb7 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:01.370162 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517908f0-51ce-4110-a796-d3703e736fb7 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:01.374737 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbdc5c-a6c5-4045-9c74-831b2ae8eb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:01.375328 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbdc5c-a6c5-4045-9c74-831b2ae8eb7b admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:01.375607 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbdc5c-a6c5-4045-9c74-831b2ae8eb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:01.375876 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbdc5c-a6c5-4045-9c74-831b2ae8eb7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:01.376524 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbdc5c-a6c5-4045-9c74-831b2ae8eb7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:01.378133 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbdc5c-a6c5-4045-9c74-831b2ae8eb7b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:01.388320 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1463/2878] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:37:01.392189 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8b588-4cdd-4161-911d-b1c00f012616 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:01.402666 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8b588-4cdd-4161-911d-b1c00f012616 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:01.407347 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72366fff-2843-4ea1-b544-a2b8a318a4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:01.407923 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72366fff-2843-4ea1-b544-a2b8a318a4a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:01.408203 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72366fff-2843-4ea1-b544-a2b8a318a4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:01.408479 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72366fff-2843-4ea1-b544-a2b8a318a4a9 admin admin] PATH_INFO: `/v3/projects/24159d8f26d041c2b5812a812ca6db46/users/9a3e59033c084b06bb9a88a166a8d2da/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:01.423698 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72366fff-2843-4ea1-b544-a2b8a318a4a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24159d8f26d041c2b5812a812ca6db46, user_id=9a3e59033c084b06bb9a88a166a8d2da, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:01.426386 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72366fff-2843-4ea1-b544-a2b8a318a4a9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:01.438931 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1416/2879] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:37:01 2022] PUT /identity/v3/projects/24159d8f26d041c2b5812a812ca6db46/users/9a3e59033c084b06bb9a88a166a8d2da/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:37:01.442932 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbdc5c-a6c5-4045-9c74-831b2ae8eb7b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:01.452965 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbdc5c-a6c5-4045-9c74-831b2ae8eb7b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:01.473115 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:01.510375 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cb044-2456-48c1-a7f8-8c71cb392317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:01.510975 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cb044-2456-48c1-a7f8-8c71cb392317 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:01.511261 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cb044-2456-48c1-a7f8-8c71cb392317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:01.511535 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cb044-2456-48c1-a7f8-8c71cb392317 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:01.512167 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31cb044-2456-48c1-a7f8-8c71cb392317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:01.513796 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31cb044-2456-48c1-a7f8-8c71cb392317 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:01.523706 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1464/2880] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 17:37:01.527963 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72366fff-2843-4ea1-b544-a2b8a318a4a9 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:01.533952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:01.540859 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72366fff-2843-4ea1-b544-a2b8a318a4a9 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:01.546128 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc0297-8004-4cd8-abe0-c03ec1c556cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:01.546807 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc0297-8004-4cd8-abe0-c03ec1c556cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:01.547081 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc0297-8004-4cd8-abe0-c03ec1c556cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:01.547350 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc0297-8004-4cd8-abe0-c03ec1c556cd admin admin] PATH_INFO: `/v3/projects/24159d8f26d041c2b5812a812ca6db46/users/9a3e59033c084b06bb9a88a166a8d2da/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:01.549335 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc0297-8004-4cd8-abe0-c03ec1c556cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=24159d8f26d041c2b5812a812ca6db46, user_id=9a3e59033c084b06bb9a88a166a8d2da, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:01.551988 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc0297-8004-4cd8-abe0-c03ec1c556cd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:01.562439 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1417/2881] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:37:01 2022] PUT /identity/v3/projects/24159d8f26d041c2b5812a812ca6db46/users/9a3e59033c084b06bb9a88a166a8d2da/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:37:01.626310 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff330f-57e4-4cb6-bc79-039041eff021 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:01.626867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff330f-57e4-4cb6-bc79-039041eff021 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:01.626867 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff330f-57e4-4cb6-bc79-039041eff021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:01.654303 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b4ff330f-57e4-4cb6-bc79-039041eff021 None None] MFA Rules not processed for user `9a3e59033c084b06bb9a88a166a8d2da`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:37:01.655499 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b4ff330f-57e4-4cb6-bc79-039041eff021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:01.724022 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1465/2882] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:37:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:37:01.735740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc0297-8004-4cd8-abe0-c03ec1c556cd admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:01.737631 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f3cc0297-8004-4cd8-abe0-c03ec1c556cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:01.800146 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc0297-8004-4cd8-abe0-c03ec1c556cd admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:01.803924 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7efa12-a9f9-483f-b333-1043ac95ae1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:01.804541 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7efa12-a9f9-483f-b333-1043ac95ae1f service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:01.804818 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7efa12-a9f9-483f-b333-1043ac95ae1f service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:01.805242 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7efa12-a9f9-483f-b333-1043ac95ae1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:01.815193 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7efa12-a9f9-483f-b333-1043ac95ae1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:01.816758 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7efa12-a9f9-483f-b333-1043ac95ae1f service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:01.828391 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1418/2883] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:37:01 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:37:03.158687 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff330f-57e4-4cb6-bc79-039041eff021 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:03.218949 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff330f-57e4-4cb6-bc79-039041eff021 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:03.223472 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19810dfc-89b2-4b2f-9e4f-9a4726fc4414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:03.224086 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19810dfc-89b2-4b2f-9e4f-9a4726fc4414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:03.224923 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19810dfc-89b2-4b2f-9e4f-9a4726fc4414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:03.225196 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19810dfc-89b2-4b2f-9e4f-9a4726fc4414 admin admin] PATH_INFO: `/v3/users/3d5468ec6e754b9e8aed876c3354a1cc` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:03.226333 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19810dfc-89b2-4b2f-9e4f-9a4726fc4414 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d5468ec6e754b9e8aed876c3354a1cc)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:03.228232 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19810dfc-89b2-4b2f-9e4f-9a4726fc4414 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:03.274037 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-19810dfc-89b2-4b2f-9e4f-9a4726fc4414 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d5468ec6e754b9e8aed876c3354a1cc'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:03.274613 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-19810dfc-89b2-4b2f-9e4f-9a4726fc4414 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d5468ec6e754b9e8aed876c3354a1cc'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:03.275782 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:03.288169 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-19810dfc-89b2-4b2f-9e4f-9a4726fc4414 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d5468ec6e754b9e8aed876c3354a1cc'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:03.295236 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-19810dfc-89b2-4b2f-9e4f-9a4726fc4414 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d5468ec6e754b9e8aed876c3354a1cc'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:03.302202 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-19810dfc-89b2-4b2f-9e4f-9a4726fc4414 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d5468ec6e754b9e8aed876c3354a1cc'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:03.308070 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1466/2884] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:37:03 2022] DELETE /identity/v3/users/3d5468ec6e754b9e8aed876c3354a1cc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:37:03.312557 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890835b6-2d6e-4455-baf9-397f6afb761a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:03.313076 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890835b6-2d6e-4455-baf9-397f6afb761a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:03.313180 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890835b6-2d6e-4455-baf9-397f6afb761a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:03.332887 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-890835b6-2d6e-4455-baf9-397f6afb761a None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:37:03.334695 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-890835b6-2d6e-4455-baf9-397f6afb761a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:03.392284 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1419/2885] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:37:03.402410 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19810dfc-89b2-4b2f-9e4f-9a4726fc4414 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:03.403817 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-19810dfc-89b2-4b2f-9e4f-9a4726fc4414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:03.460932 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19810dfc-89b2-4b2f-9e4f-9a4726fc4414 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:03.464512 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d92c3-bd23-4ccb-8302-973ccbbef2a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:03.465105 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d92c3-bd23-4ccb-8302-973ccbbef2a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:03.465375 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d92c3-bd23-4ccb-8302-973ccbbef2a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:03.465671 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d92c3-bd23-4ccb-8302-973ccbbef2a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:03.474378 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d92c3-bd23-4ccb-8302-973ccbbef2a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:03.475788 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d92c3-bd23-4ccb-8302-973ccbbef2a0 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:03.484852 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1467/2886] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:37:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:37:03.749606 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890835b6-2d6e-4455-baf9-397f6afb761a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:03.750865 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-890835b6-2d6e-4455-baf9-397f6afb761a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:03.764632 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890835b6-2d6e-4455-baf9-397f6afb761a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:03.769355 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bcddf-bea3-4363-b065-8deb3b4a0665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:03.770032 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bcddf-bea3-4363-b065-8deb3b4a0665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:03.770313 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bcddf-bea3-4363-b065-8deb3b4a0665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:03.770583 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bcddf-bea3-4363-b065-8deb3b4a0665 admin admin] PATH_INFO: `/v3/projects/16240fddbe4549f5a72d322a3332d57f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:03.771780 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3bcddf-bea3-4363-b065-8deb3b4a0665 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16240fddbe4549f5a72d322a3332d57f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:03.773728 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3bcddf-bea3-4363-b065-8deb3b4a0665 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:03.820205 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0f3bcddf-bea3-4363-b065-8deb3b4a0665 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16240fddbe4549f5a72d322a3332d57f', 'request_id': 'req-0f3bcddf-bea3-4363-b065-8deb3b4a0665'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:03.825599 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0f3bcddf-bea3-4363-b065-8deb3b4a0665 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16240fddbe4549f5a72d322a3332d57f', 'request_id': 'req-0f3bcddf-bea3-4363-b065-8deb3b4a0665'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:03.831542 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0f3bcddf-bea3-4363-b065-8deb3b4a0665 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16240fddbe4549f5a72d322a3332d57f', 'request_id': 'req-0f3bcddf-bea3-4363-b065-8deb3b4a0665'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:03.843825 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0f3bcddf-bea3-4363-b065-8deb3b4a0665 admin admin] The token cache is being invalidate because project 16240fddbe4549f5a72d322a3332d57f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:37:03.844108 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0f3bcddf-bea3-4363-b065-8deb3b4a0665 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:03.844723 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0f3bcddf-bea3-4363-b065-8deb3b4a0665 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:03.846217 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1420/2887] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:37:03 2022] DELETE /identity/v3/projects/16240fddbe4549f5a72d322a3332d57f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:37:03.850250 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d92c3-bd23-4ccb-8302-973ccbbef2a0 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:03.859684 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d92c3-bd23-4ccb-8302-973ccbbef2a0 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:03.913697 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e2697-1c34-4896-b5b7-fced45d424bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:03.914322 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e2697-1c34-4896-b5b7-fced45d424bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:03.914600 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e2697-1c34-4896-b5b7-fced45d424bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:03.914872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e2697-1c34-4896-b5b7-fced45d424bc admin admin] PATH_INFO: `/v3/users/9a3e59033c084b06bb9a88a166a8d2da` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:03.915981 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e2697-1c34-4896-b5b7-fced45d424bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a3e59033c084b06bb9a88a166a8d2da)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:03.917934 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e2697-1c34-4896-b5b7-fced45d424bc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:03.963591 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-864e2697-1c34-4896-b5b7-fced45d424bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a3e59033c084b06bb9a88a166a8d2da'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:03.964235 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-864e2697-1c34-4896-b5b7-fced45d424bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a3e59033c084b06bb9a88a166a8d2da'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:03.976313 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-864e2697-1c34-4896-b5b7-fced45d424bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a3e59033c084b06bb9a88a166a8d2da'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:03.980621 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:03.983638 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-864e2697-1c34-4896-b5b7-fced45d424bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a3e59033c084b06bb9a88a166a8d2da'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:03.992479 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-864e2697-1c34-4896-b5b7-fced45d424bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a3e59033c084b06bb9a88a166a8d2da'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:03.998858 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1468/2888] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:37:03 2022] DELETE /identity/v3/users/9a3e59033c084b06bb9a88a166a8d2da => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:37:04.277232 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bcddf-bea3-4363-b065-8deb3b4a0665 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:04.278713 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0f3bcddf-bea3-4363-b065-8deb3b4a0665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:04.295749 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bcddf-bea3-4363-b065-8deb3b4a0665 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:04.308952 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:04.355708 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211af6e2-9a4c-4ebb-83ab-1175056096ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:04.356391 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211af6e2-9a4c-4ebb-83ab-1175056096ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:04.356513 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211af6e2-9a4c-4ebb-83ab-1175056096ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:04.356781 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211af6e2-9a4c-4ebb-83ab-1175056096ae admin admin] PATH_INFO: `/v3/projects/24159d8f26d041c2b5812a812ca6db46` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:04.357924 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211af6e2-9a4c-4ebb-83ab-1175056096ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=24159d8f26d041c2b5812a812ca6db46)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:04.359832 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211af6e2-9a4c-4ebb-83ab-1175056096ae admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:04.405149 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-211af6e2-9a4c-4ebb-83ab-1175056096ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24159d8f26d041c2b5812a812ca6db46', 'request_id': 'req-211af6e2-9a4c-4ebb-83ab-1175056096ae'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:04.410580 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-211af6e2-9a4c-4ebb-83ab-1175056096ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24159d8f26d041c2b5812a812ca6db46', 'request_id': 'req-211af6e2-9a4c-4ebb-83ab-1175056096ae'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:04.416537 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-211af6e2-9a4c-4ebb-83ab-1175056096ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24159d8f26d041c2b5812a812ca6db46', 'request_id': 'req-211af6e2-9a4c-4ebb-83ab-1175056096ae'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:04.429766 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-211af6e2-9a4c-4ebb-83ab-1175056096ae admin admin] The token cache is being invalidate because project 24159d8f26d041c2b5812a812ca6db46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:37:04.430059 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-211af6e2-9a4c-4ebb-83ab-1175056096ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:04.430680 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-211af6e2-9a4c-4ebb-83ab-1175056096ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:04.432168 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1421/2889] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:37:04 2022] DELETE /identity/v3/projects/24159d8f26d041c2b5812a812ca6db46 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:37:04.437038 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc27e13-d3ea-4882-b688-69d745ebb077 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:04.437543 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc27e13-d3ea-4882-b688-69d745ebb077 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:04.437732 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc27e13-d3ea-4882-b688-69d745ebb077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:04.457085 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6cc27e13-d3ea-4882-b688-69d745ebb077 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:37:04.458334 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6cc27e13-d3ea-4882-b688-69d745ebb077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:04.516385 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1469/2890] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:37:04.524476 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d075b0-d918-4444-a7ef-0aa776733773 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:04.524767 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d075b0-d918-4444-a7ef-0aa776733773 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:04.525044 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d075b0-d918-4444-a7ef-0aa776733773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:04.546084 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-22d075b0-d918-4444-a7ef-0aa776733773 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:37:04.547289 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-22d075b0-d918-4444-a7ef-0aa776733773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:04.555148 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1422/2891] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:37:04.559564 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc27e13-d3ea-4882-b688-69d745ebb077 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:04.569089 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc27e13-d3ea-4882-b688-69d745ebb077 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:04.573640 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94a64d-c350-4f5b-98f3-af51d046618f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:04.574231 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94a64d-c350-4f5b-98f3-af51d046618f admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:04.574507 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94a64d-c350-4f5b-98f3-af51d046618f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:04.574775 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94a64d-c350-4f5b-98f3-af51d046618f admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:04.575416 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94a64d-c350-4f5b-98f3-af51d046618f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:37:04.575744 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94a64d-c350-4f5b-98f3-af51d046618f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:04.577331 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94a64d-c350-4f5b-98f3-af51d046618f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:04.589092 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1470/2892] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:37:04.593389 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d075b0-d918-4444-a7ef-0aa776733773 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:04.603635 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d075b0-d918-4444-a7ef-0aa776733773 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:04.609817 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d8192-460a-4a1f-8ab8-a6750e8d2d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:04.610335 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d8192-460a-4a1f-8ab8-a6750e8d2d42 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:04.610608 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d8192-460a-4a1f-8ab8-a6750e8d2d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:04.610872 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d8192-460a-4a1f-8ab8-a6750e8d2d42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:04.611516 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d8192-460a-4a1f-8ab8-a6750e8d2d42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:04.614713 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d8192-460a-4a1f-8ab8-a6750e8d2d42 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:04.651922 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1423/2893] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:37:04 2022] POST /identity/v3/projects => generated 391 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:37:04.656184 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94a64d-c350-4f5b-98f3-af51d046618f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:04.666523 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94a64d-c350-4f5b-98f3-af51d046618f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:04.724691 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4174263-0058-4101-9797-bdbfc8954108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:04.725373 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4174263-0058-4101-9797-bdbfc8954108 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:04.725694 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4174263-0058-4101-9797-bdbfc8954108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:04.725974 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4174263-0058-4101-9797-bdbfc8954108 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:04.726626 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4174263-0058-4101-9797-bdbfc8954108 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:04.728583 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4174263-0058-4101-9797-bdbfc8954108 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:04.755161 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1471/2894] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:37:04 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:37:04.760037 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d8192-460a-4a1f-8ab8-a6750e8d2d42 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:04.770386 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d8192-460a-4a1f-8ab8-a6750e8d2d42 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:04.775597 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb6a16-5a07-4046-9a27-37843c899da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:04.776191 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb6a16-5a07-4046-9a27-37843c899da0 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:04.776468 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb6a16-5a07-4046-9a27-37843c899da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:04.776737 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb6a16-5a07-4046-9a27-37843c899da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:04.777439 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb6a16-5a07-4046-9a27-37843c899da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:04.779009 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb6a16-5a07-4046-9a27-37843c899da0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:04.788675 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1424/2895] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:37:04.792618 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4174263-0058-4101-9797-bdbfc8954108 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:04.802836 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4174263-0058-4101-9797-bdbfc8954108 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:04.807400 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e3920-7859-4b6f-9e26-40b09f36e190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:04.807986 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e3920-7859-4b6f-9e26-40b09f36e190 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:04.808266 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e3920-7859-4b6f-9e26-40b09f36e190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:04.808537 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e3920-7859-4b6f-9e26-40b09f36e190 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:04.809170 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e3920-7859-4b6f-9e26-40b09f36e190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:04.810794 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e3920-7859-4b6f-9e26-40b09f36e190 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:04.821628 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1472/2896] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:37:04.825597 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb6a16-5a07-4046-9a27-37843c899da0 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:04.836083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb6a16-5a07-4046-9a27-37843c899da0 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:04.840813 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bee71-f0a3-404a-80f6-068a121961bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:04.841549 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bee71-f0a3-404a-80f6-068a121961bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:04.841890 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bee71-f0a3-404a-80f6-068a121961bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:04.842167 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bee71-f0a3-404a-80f6-068a121961bf admin admin] PATH_INFO: `/v3/projects/16cc5a6514234cb285ed4cc8e80a2fc4/users/1cdab2dd813145648efa3ee91beb4e1c/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:04.856351 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4bee71-f0a3-404a-80f6-068a121961bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=16cc5a6514234cb285ed4cc8e80a2fc4, user_id=1cdab2dd813145648efa3ee91beb4e1c, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:04.859042 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4bee71-f0a3-404a-80f6-068a121961bf admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:04.871721 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1425/2897] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:37:04 2022] PUT /identity/v3/projects/16cc5a6514234cb285ed4cc8e80a2fc4/users/1cdab2dd813145648efa3ee91beb4e1c/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:37:04.883327 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d211ea-f6c0-4d3c-bc31-1569b92673dc None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:04.883611 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d211ea-f6c0-4d3c-bc31-1569b92673dc None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:04.883883 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d211ea-f6c0-4d3c-bc31-1569b92673dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:04.910603 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-01d211ea-f6c0-4d3c-bc31-1569b92673dc None None] MFA Rules not processed for user `1cdab2dd813145648efa3ee91beb4e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:37:04.912287 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-01d211ea-f6c0-4d3c-bc31-1569b92673dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:04.953024 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:04.976530 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1473/2898] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:37:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:37:04.980965 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bee71-f0a3-404a-80f6-068a121961bf admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:05.025383 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:05.044288 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bee71-f0a3-404a-80f6-068a121961bf admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:05.049429 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b1644-cfb7-4cb4-8925-3f8893c642f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:05.050031 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b1644-cfb7-4cb4-8925-3f8893c642f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:05.050311 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b1644-cfb7-4cb4-8925-3f8893c642f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:05.050586 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b1644-cfb7-4cb4-8925-3f8893c642f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:05.051221 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b1644-cfb7-4cb4-8925-3f8893c642f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:05.053764 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b1644-cfb7-4cb4-8925-3f8893c642f1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:05.079068 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1426/2899] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:37:04 2022] POST /identity/v3/projects => generated 393 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 17:37:05.083133 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d211ea-f6c0-4d3c-bc31-1569b92673dc None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:05.093607 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d211ea-f6c0-4d3c-bc31-1569b92673dc None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:05.149257 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693124d-f7c3-40ba-b073-fab2d1874192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:05.149881 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693124d-f7c3-40ba-b073-fab2d1874192 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:05.150163 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693124d-f7c3-40ba-b073-fab2d1874192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:05.150437 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693124d-f7c3-40ba-b073-fab2d1874192 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:05.151063 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693124d-f7c3-40ba-b073-fab2d1874192 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:05.153022 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693124d-f7c3-40ba-b073-fab2d1874192 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:05.173917 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1474/2900] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:37:05 2022] POST /identity/v3/users => generated 303 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:37:05.177871 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b1644-cfb7-4cb4-8925-3f8893c642f1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:05.187927 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b1644-cfb7-4cb4-8925-3f8893c642f1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:05.192798 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d16409-0d0f-4fb4-bcb9-ff39649fb5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:05.193396 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d16409-0d0f-4fb4-bcb9-ff39649fb5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:05.193723 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d16409-0d0f-4fb4-bcb9-ff39649fb5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:05.194001 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d16409-0d0f-4fb4-bcb9-ff39649fb5d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:05.194674 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d16409-0d0f-4fb4-bcb9-ff39649fb5d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:05.196267 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d16409-0d0f-4fb4-bcb9-ff39649fb5d2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:05.206702 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1427/2901] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:37:05.211436 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693124d-f7c3-40ba-b073-fab2d1874192 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:05.221417 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693124d-f7c3-40ba-b073-fab2d1874192 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:05.227003 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66734715-ae4b-48e1-97b1-b47dc9c784cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:05.227643 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66734715-ae4b-48e1-97b1-b47dc9c784cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:05.227924 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66734715-ae4b-48e1-97b1-b47dc9c784cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:05.228201 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66734715-ae4b-48e1-97b1-b47dc9c784cf admin admin] PATH_INFO: `/v3/projects/f87a90b967c9407ea5ff552661d435e6/users/ba5ea8e46b7d433789f49cc487b54854/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:05.244103 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66734715-ae4b-48e1-97b1-b47dc9c784cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f87a90b967c9407ea5ff552661d435e6, user_id=ba5ea8e46b7d433789f49cc487b54854, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:05.247082 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66734715-ae4b-48e1-97b1-b47dc9c784cf admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:05.259765 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1475/2902] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:37:05 2022] PUT /identity/v3/projects/f87a90b967c9407ea5ff552661d435e6/users/ba5ea8e46b7d433789f49cc487b54854/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:37:05.263704 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d16409-0d0f-4fb4-bcb9-ff39649fb5d2 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:05.274366 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d16409-0d0f-4fb4-bcb9-ff39649fb5d2 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:05.329147 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643ebc4-6c8e-4316-8b05-0c9c48fb9831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:05.329779 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643ebc4-6c8e-4316-8b05-0c9c48fb9831 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:05.330059 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643ebc4-6c8e-4316-8b05-0c9c48fb9831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:05.330335 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643ebc4-6c8e-4316-8b05-0c9c48fb9831 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:05.330973 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643ebc4-6c8e-4316-8b05-0c9c48fb9831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:05.332555 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643ebc4-6c8e-4316-8b05-0c9c48fb9831 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:05.342750 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1428/2903] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:37:05.346987 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66734715-ae4b-48e1-97b1-b47dc9c784cf admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:05.358048 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66734715-ae4b-48e1-97b1-b47dc9c784cf admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:05.362586 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d59cf9-5cf6-4bfe-969e-569334be4f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:05.363231 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d59cf9-5cf6-4bfe-969e-569334be4f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:05.363513 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d59cf9-5cf6-4bfe-969e-569334be4f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:05.363787 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d59cf9-5cf6-4bfe-969e-569334be4f62 admin admin] PATH_INFO: `/v3/projects/f87a90b967c9407ea5ff552661d435e6/users/ba5ea8e46b7d433789f49cc487b54854/roles/70f911a75b7b40a19f65857b9d19cfad` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:05.365710 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d59cf9-5cf6-4bfe-969e-569334be4f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f87a90b967c9407ea5ff552661d435e6, user_id=ba5ea8e46b7d433789f49cc487b54854, role_id=70f911a75b7b40a19f65857b9d19cfad)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:05.368353 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d59cf9-5cf6-4bfe-969e-569334be4f62 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:05.378731 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1476/2904] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:37:05 2022] PUT /identity/v3/projects/f87a90b967c9407ea5ff552661d435e6/users/ba5ea8e46b7d433789f49cc487b54854/roles/70f911a75b7b40a19f65857b9d19cfad => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:37:05.388939 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe66ca-12d8-4bd6-851c-1e9484e8e9fe None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:05.389460 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe66ca-12d8-4bd6-851c-1e9484e8e9fe None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:05.389593 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe66ca-12d8-4bd6-851c-1e9484e8e9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:05.417651 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9afe66ca-12d8-4bd6-851c-1e9484e8e9fe None None] MFA Rules not processed for user `ba5ea8e46b7d433789f49cc487b54854`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:37:05.418849 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9afe66ca-12d8-4bd6-851c-1e9484e8e9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:05.486937 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1429/2905] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:37:05 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:37:05.497695 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d59cf9-5cf6-4bfe-969e-569334be4f62 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:05.499381 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b9d59cf9-5cf6-4bfe-969e-569334be4f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:05.558211 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d59cf9-5cf6-4bfe-969e-569334be4f62 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:05.561850 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e66a48-1fcc-4982-8e9d-b1282fd96298 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:05.562448 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e66a48-1fcc-4982-8e9d-b1282fd96298 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:05.562726 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e66a48-1fcc-4982-8e9d-b1282fd96298 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:05.562996 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e66a48-1fcc-4982-8e9d-b1282fd96298 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:05.572208 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e66a48-1fcc-4982-8e9d-b1282fd96298 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:05.573661 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e66a48-1fcc-4982-8e9d-b1282fd96298 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:05.582825 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1477/2906] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:37:05 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:37:05.627742 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe66ca-12d8-4bd6-851c-1e9484e8e9fe None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:05.629125 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9afe66ca-12d8-4bd6-851c-1e9484e8e9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:05.641687 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe66ca-12d8-4bd6-851c-1e9484e8e9fe None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:05.645441 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6fd68-d6f4-43c7-92f9-5dff6783fb71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:05.646682 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6fd68-d6f4-43c7-92f9-5dff6783fb71 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:05.646963 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6fd68-d6f4-43c7-92f9-5dff6783fb71 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:05.647233 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6fd68-d6f4-43c7-92f9-5dff6783fb71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:05.680512 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:05.705017 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6fd68-d6f4-43c7-92f9-5dff6783fb71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:05.706486 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6fd68-d6f4-43c7-92f9-5dff6783fb71 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:05.716050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1430/2907] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:37:05 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:37:08.982474 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e66a48-1fcc-4982-8e9d-b1282fd96298 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:09.026846 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:09.051032 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e66a48-1fcc-4982-8e9d-b1282fd96298 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:09.056172 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97532fc7-66db-42a5-bb88-62f7be1fddcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:09.056736 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97532fc7-66db-42a5-bb88-62f7be1fddcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:09.057011 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97532fc7-66db-42a5-bb88-62f7be1fddcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:09.057283 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97532fc7-66db-42a5-bb88-62f7be1fddcc admin admin] PATH_INFO: `/v3/users/1cdab2dd813145648efa3ee91beb4e1c` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:09.058433 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97532fc7-66db-42a5-bb88-62f7be1fddcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cdab2dd813145648efa3ee91beb4e1c)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:09.060364 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97532fc7-66db-42a5-bb88-62f7be1fddcc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:09.107590 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-97532fc7-66db-42a5-bb88-62f7be1fddcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cdab2dd813145648efa3ee91beb4e1c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:09.108238 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-97532fc7-66db-42a5-bb88-62f7be1fddcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cdab2dd813145648efa3ee91beb4e1c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:09.120377 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-97532fc7-66db-42a5-bb88-62f7be1fddcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cdab2dd813145648efa3ee91beb4e1c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:09.127177 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-97532fc7-66db-42a5-bb88-62f7be1fddcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cdab2dd813145648efa3ee91beb4e1c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:09.134572 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-97532fc7-66db-42a5-bb88-62f7be1fddcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cdab2dd813145648efa3ee91beb4e1c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:09.140383 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1478/2908] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:37:08 2022] DELETE /identity/v3/users/1cdab2dd813145648efa3ee91beb4e1c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:37:09.144924 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a4986-018b-4983-9285-11f5b728e088 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:09.145435 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a4986-018b-4983-9285-11f5b728e088 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:09.145556 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a4986-018b-4983-9285-11f5b728e088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:09.167340 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b18a4986-018b-4983-9285-11f5b728e088 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:37:09.168546 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b18a4986-018b-4983-9285-11f5b728e088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:09.227785 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1431/2909] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:37:09.237460 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97532fc7-66db-42a5-bb88-62f7be1fddcc admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:09.238872 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-97532fc7-66db-42a5-bb88-62f7be1fddcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:09.303701 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97532fc7-66db-42a5-bb88-62f7be1fddcc admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:09.307455 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f3ed1-b100-46bf-8838-5f1992f50c44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:09.308012 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f3ed1-b100-46bf-8838-5f1992f50c44 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:09.308274 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f3ed1-b100-46bf-8838-5f1992f50c44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:09.308542 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f3ed1-b100-46bf-8838-5f1992f50c44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:09.317494 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f3ed1-b100-46bf-8838-5f1992f50c44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:09.319493 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f3ed1-b100-46bf-8838-5f1992f50c44 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:09.333198 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1479/2910] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:37:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:37:09.607969 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a4986-018b-4983-9285-11f5b728e088 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:09.609449 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b18a4986-018b-4983-9285-11f5b728e088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:09.622094 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a4986-018b-4983-9285-11f5b728e088 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:09.626747 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275a69d-c6f2-44bb-83a5-5aa04694017b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:09.627406 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275a69d-c6f2-44bb-83a5-5aa04694017b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:09.627700 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275a69d-c6f2-44bb-83a5-5aa04694017b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:09.627954 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275a69d-c6f2-44bb-83a5-5aa04694017b admin admin] PATH_INFO: `/v3/projects/16cc5a6514234cb285ed4cc8e80a2fc4` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:09.629082 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275a69d-c6f2-44bb-83a5-5aa04694017b admin admin] RBAC: Authorizing `identity:delete_project(project_id=16cc5a6514234cb285ed4cc8e80a2fc4)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:09.631692 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275a69d-c6f2-44bb-83a5-5aa04694017b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:09.678224 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7275a69d-c6f2-44bb-83a5-5aa04694017b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16cc5a6514234cb285ed4cc8e80a2fc4', 'request_id': 'req-7275a69d-c6f2-44bb-83a5-5aa04694017b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:09.683877 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7275a69d-c6f2-44bb-83a5-5aa04694017b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16cc5a6514234cb285ed4cc8e80a2fc4', 'request_id': 'req-7275a69d-c6f2-44bb-83a5-5aa04694017b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:09.690175 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7275a69d-c6f2-44bb-83a5-5aa04694017b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16cc5a6514234cb285ed4cc8e80a2fc4', 'request_id': 'req-7275a69d-c6f2-44bb-83a5-5aa04694017b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:09.703657 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7275a69d-c6f2-44bb-83a5-5aa04694017b admin admin] The token cache is being invalidate because project 16cc5a6514234cb285ed4cc8e80a2fc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:37:09.703945 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7275a69d-c6f2-44bb-83a5-5aa04694017b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:09.704572 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7275a69d-c6f2-44bb-83a5-5aa04694017b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:09.706127 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1432/2911] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:37:09 2022] DELETE /identity/v3/projects/16cc5a6514234cb285ed4cc8e80a2fc4 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:37:09.710086 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f3ed1-b100-46bf-8838-5f1992f50c44 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:09.719693 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f3ed1-b100-46bf-8838-5f1992f50c44 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:09.775440 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03acf916-452d-4243-b6fc-0dd5aabcb208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:09.776075 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acf916-452d-4243-b6fc-0dd5aabcb208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:09.776349 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acf916-452d-4243-b6fc-0dd5aabcb208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:09.776617 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acf916-452d-4243-b6fc-0dd5aabcb208 admin admin] PATH_INFO: `/v3/users/ba5ea8e46b7d433789f49cc487b54854` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:09.777767 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03acf916-452d-4243-b6fc-0dd5aabcb208 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba5ea8e46b7d433789f49cc487b54854)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:09.779800 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03acf916-452d-4243-b6fc-0dd5aabcb208 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:09.781521 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:09.828089 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-03acf916-452d-4243-b6fc-0dd5aabcb208 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba5ea8e46b7d433789f49cc487b54854'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:09.828740 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-03acf916-452d-4243-b6fc-0dd5aabcb208 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba5ea8e46b7d433789f49cc487b54854'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:09.840389 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-03acf916-452d-4243-b6fc-0dd5aabcb208 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba5ea8e46b7d433789f49cc487b54854'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:09.847299 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-03acf916-452d-4243-b6fc-0dd5aabcb208 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba5ea8e46b7d433789f49cc487b54854'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:09.853975 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-03acf916-452d-4243-b6fc-0dd5aabcb208 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba5ea8e46b7d433789f49cc487b54854'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:09.859861 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1480/2912] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:37:09 2022] DELETE /identity/v3/users/ba5ea8e46b7d433789f49cc487b54854 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:37:10.130772 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275a69d-c6f2-44bb-83a5-5aa04694017b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:10.132280 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7275a69d-c6f2-44bb-83a5-5aa04694017b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:10.145703 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275a69d-c6f2-44bb-83a5-5aa04694017b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:10.208194 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764dbdb-131e-4a07-bb2d-3c7d0229b89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:10.208848 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764dbdb-131e-4a07-bb2d-3c7d0229b89c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:10.209127 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764dbdb-131e-4a07-bb2d-3c7d0229b89c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:10.209424 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764dbdb-131e-4a07-bb2d-3c7d0229b89c admin admin] PATH_INFO: `/v3/projects/f87a90b967c9407ea5ff552661d435e6` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:10.210607 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764dbdb-131e-4a07-bb2d-3c7d0229b89c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f87a90b967c9407ea5ff552661d435e6)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:10.212534 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764dbdb-131e-4a07-bb2d-3c7d0229b89c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:10.214436 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:10.267727 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5764dbdb-131e-4a07-bb2d-3c7d0229b89c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f87a90b967c9407ea5ff552661d435e6', 'request_id': 'req-5764dbdb-131e-4a07-bb2d-3c7d0229b89c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:10.273629 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5764dbdb-131e-4a07-bb2d-3c7d0229b89c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f87a90b967c9407ea5ff552661d435e6', 'request_id': 'req-5764dbdb-131e-4a07-bb2d-3c7d0229b89c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:10.280407 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5764dbdb-131e-4a07-bb2d-3c7d0229b89c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f87a90b967c9407ea5ff552661d435e6', 'request_id': 'req-5764dbdb-131e-4a07-bb2d-3c7d0229b89c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:10.295562 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5764dbdb-131e-4a07-bb2d-3c7d0229b89c admin admin] The token cache is being invalidate because project f87a90b967c9407ea5ff552661d435e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:37:10.295845 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5764dbdb-131e-4a07-bb2d-3c7d0229b89c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:10.296473 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5764dbdb-131e-4a07-bb2d-3c7d0229b89c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:10.298008 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1433/2913] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:37:10 2022] DELETE /identity/v3/projects/f87a90b967c9407ea5ff552661d435e6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:37:10.305623 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e5b72-2ec0-4841-9051-03dd03e5c37a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:10.308414 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e5b72-2ec0-4841-9051-03dd03e5c37a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:10.308414 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e5b72-2ec0-4841-9051-03dd03e5c37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:10.326849 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-423e5b72-2ec0-4841-9051-03dd03e5c37a None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:37:10.328056 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-423e5b72-2ec0-4841-9051-03dd03e5c37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:10.386502 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1481/2914] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:37:10.394123 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb9c65-69a7-4596-af89-9332be10a532 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:10.394457 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb9c65-69a7-4596-af89-9332be10a532 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:10.394761 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb9c65-69a7-4596-af89-9332be10a532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:10.415532 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-bddb9c65-69a7-4596-af89-9332be10a532 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:37:10.416740 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bddb9c65-69a7-4596-af89-9332be10a532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:10.424880 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1434/2915] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:37:10.429021 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e5b72-2ec0-4841-9051-03dd03e5c37a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:10.438517 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e5b72-2ec0-4841-9051-03dd03e5c37a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:10.443291 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b86cd-51ae-4259-825d-01321281f6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:10.443915 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b86cd-51ae-4259-825d-01321281f6cd admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:10.444192 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b86cd-51ae-4259-825d-01321281f6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:10.444487 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b86cd-51ae-4259-825d-01321281f6cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:10.445135 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b86cd-51ae-4259-825d-01321281f6cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:37:10.445457 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b86cd-51ae-4259-825d-01321281f6cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:10.447044 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b86cd-51ae-4259-825d-01321281f6cd admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:10.459357 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1482/2916] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:37:10.463946 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb9c65-69a7-4596-af89-9332be10a532 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:10.473033 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb9c65-69a7-4596-af89-9332be10a532 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:10.478275 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919941a-25a2-421a-bd1c-999aebb39794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:10.478856 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919941a-25a2-421a-bd1c-999aebb39794 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:10.479129 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919941a-25a2-421a-bd1c-999aebb39794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:10.479395 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919941a-25a2-421a-bd1c-999aebb39794 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:10.480018 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919941a-25a2-421a-bd1c-999aebb39794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:10.481936 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919941a-25a2-421a-bd1c-999aebb39794 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:10.508007 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1435/2917] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:37:10 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:37:10.511992 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b86cd-51ae-4259-825d-01321281f6cd admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:10.522580 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b86cd-51ae-4259-825d-01321281f6cd admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:10.578635 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381e6f3-4d76-414a-b9fb-de931a1dd471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:10.579228 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381e6f3-4d76-414a-b9fb-de931a1dd471 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:10.579522 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381e6f3-4d76-414a-b9fb-de931a1dd471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:10.579769 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381e6f3-4d76-414a-b9fb-de931a1dd471 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:10.580394 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381e6f3-4d76-414a-b9fb-de931a1dd471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:10.582337 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381e6f3-4d76-414a-b9fb-de931a1dd471 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:10.593365 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:10.605701 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1483/2918] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:37:10 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:37:10.609557 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919941a-25a2-421a-bd1c-999aebb39794 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:10.619681 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919941a-25a2-421a-bd1c-999aebb39794 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:10.624337 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450e96e-d95a-4a1e-9810-a66077921718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:10.624929 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450e96e-d95a-4a1e-9810-a66077921718 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:10.625215 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450e96e-d95a-4a1e-9810-a66077921718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:10.625510 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450e96e-d95a-4a1e-9810-a66077921718 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:10.626154 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450e96e-d95a-4a1e-9810-a66077921718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:10.627738 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450e96e-d95a-4a1e-9810-a66077921718 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:10.637441 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1436/2919] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:37:10.641189 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381e6f3-4d76-414a-b9fb-de931a1dd471 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:10.651254 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381e6f3-4d76-414a-b9fb-de931a1dd471 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:10.655815 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdce5e8-53de-4699-8e4b-d56ed8389b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:10.656390 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdce5e8-53de-4699-8e4b-d56ed8389b3a admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:10.656666 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdce5e8-53de-4699-8e4b-d56ed8389b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:10.656934 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdce5e8-53de-4699-8e4b-d56ed8389b3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:10.657585 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdce5e8-53de-4699-8e4b-d56ed8389b3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:10.659158 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdce5e8-53de-4699-8e4b-d56ed8389b3a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:10.670162 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1484/2920] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:37:10.674063 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450e96e-d95a-4a1e-9810-a66077921718 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:10.683645 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450e96e-d95a-4a1e-9810-a66077921718 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:10.688181 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824b343-31bd-4d8e-90cc-41232cd28f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:10.688810 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824b343-31bd-4d8e-90cc-41232cd28f16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:10.689083 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824b343-31bd-4d8e-90cc-41232cd28f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:10.689378 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824b343-31bd-4d8e-90cc-41232cd28f16 admin admin] PATH_INFO: `/v3/projects/e6107694f4ec47e7b551546877e37e52/users/4b109109db1e40ff895e553f50d0f6c2/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:10.703307 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824b343-31bd-4d8e-90cc-41232cd28f16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6107694f4ec47e7b551546877e37e52, user_id=4b109109db1e40ff895e553f50d0f6c2, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:10.705966 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824b343-31bd-4d8e-90cc-41232cd28f16 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:10.719133 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1437/2921] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:37:10 2022] PUT /identity/v3/projects/e6107694f4ec47e7b551546877e37e52/users/4b109109db1e40ff895e553f50d0f6c2/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:37:10.730999 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6fc9f-432f-4e2e-88c6-958035aef642 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:10.731284 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6fc9f-432f-4e2e-88c6-958035aef642 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:10.731555 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6fc9f-432f-4e2e-88c6-958035aef642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:10.758797 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-aea6fc9f-432f-4e2e-88c6-958035aef642 None None] MFA Rules not processed for user `4b109109db1e40ff895e553f50d0f6c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:37:10.760027 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-aea6fc9f-432f-4e2e-88c6-958035aef642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:10.823144 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1485/2922] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:37:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:37:10.834561 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824b343-31bd-4d8e-90cc-41232cd28f16 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:10.836267 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8824b343-31bd-4d8e-90cc-41232cd28f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:10.891552 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824b343-31bd-4d8e-90cc-41232cd28f16 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:10.895155 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e0ad8-9633-45d4-b272-2cf934160239 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:10.896283 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e0ad8-9633-45d4-b272-2cf934160239 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:10.896561 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e0ad8-9633-45d4-b272-2cf934160239 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:10.896832 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e0ad8-9633-45d4-b272-2cf934160239 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:10.905042 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e0ad8-9633-45d4-b272-2cf934160239 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:10.906498 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e0ad8-9633-45d4-b272-2cf934160239 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:10.915111 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1438/2923] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:37:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:37:13.929334 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6fc9f-432f-4e2e-88c6-958035aef642 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:13.990058 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6fc9f-432f-4e2e-88c6-958035aef642 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:13.994522 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3bdb78-e1a9-4518-b935-22a50fdd2541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:13.995137 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bdb78-e1a9-4518-b935-22a50fdd2541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:13.995412 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bdb78-e1a9-4518-b935-22a50fdd2541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:13.995677 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bdb78-e1a9-4518-b935-22a50fdd2541 admin admin] PATH_INFO: `/v3/users/4b109109db1e40ff895e553f50d0f6c2` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:13.996798 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3bdb78-e1a9-4518-b935-22a50fdd2541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b109109db1e40ff895e553f50d0f6c2)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:13.998717 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3bdb78-e1a9-4518-b935-22a50fdd2541 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:14.045123 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8f3bdb78-e1a9-4518-b935-22a50fdd2541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b109109db1e40ff895e553f50d0f6c2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:14.045917 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8f3bdb78-e1a9-4518-b935-22a50fdd2541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b109109db1e40ff895e553f50d0f6c2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:14.058166 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8f3bdb78-e1a9-4518-b935-22a50fdd2541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b109109db1e40ff895e553f50d0f6c2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:14.064960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8f3bdb78-e1a9-4518-b935-22a50fdd2541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b109109db1e40ff895e553f50d0f6c2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:14.067434 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:14.073143 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8f3bdb78-e1a9-4518-b935-22a50fdd2541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b109109db1e40ff895e553f50d0f6c2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:14.080224 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1486/2924] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:37:13 2022] DELETE /identity/v3/users/4b109109db1e40ff895e553f50d0f6c2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:37:14.085384 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa4fb6-d8bc-40a2-84ad-165355a33b2a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:14.085895 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa4fb6-d8bc-40a2-84ad-165355a33b2a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:14.086004 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa4fb6-d8bc-40a2-84ad-165355a33b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:14.105590 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7cfa4fb6-d8bc-40a2-84ad-165355a33b2a None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:37:14.106788 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7cfa4fb6-d8bc-40a2-84ad-165355a33b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:14.130276 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:14.174684 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1439/2925] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:37:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:37:14.184952 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3bdb78-e1a9-4518-b935-22a50fdd2541 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:14.186421 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8f3bdb78-e1a9-4518-b935-22a50fdd2541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:14.242459 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3bdb78-e1a9-4518-b935-22a50fdd2541 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:14.246033 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569baad-8f6c-444e-b3ac-8bb67a12861a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:14.246653 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569baad-8f6c-444e-b3ac-8bb67a12861a service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:14.246928 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569baad-8f6c-444e-b3ac-8bb67a12861a service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:14.247193 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569baad-8f6c-444e-b3ac-8bb67a12861a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:14.255935 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569baad-8f6c-444e-b3ac-8bb67a12861a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:14.257960 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569baad-8f6c-444e-b3ac-8bb67a12861a service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:14.267122 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1487/2926] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:37:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:37:14.554105 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa4fb6-d8bc-40a2-84ad-165355a33b2a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:14.555636 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7cfa4fb6-d8bc-40a2-84ad-165355a33b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:14.567723 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa4fb6-d8bc-40a2-84ad-165355a33b2a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:14.572444 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba9240-ec0e-40b4-ab0d-231c44565833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:14.573170 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba9240-ec0e-40b4-ab0d-231c44565833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:14.573553 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba9240-ec0e-40b4-ab0d-231c44565833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:14.573840 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba9240-ec0e-40b4-ab0d-231c44565833 admin admin] PATH_INFO: `/v3/projects/e6107694f4ec47e7b551546877e37e52` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:14.575055 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba9240-ec0e-40b4-ab0d-231c44565833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6107694f4ec47e7b551546877e37e52)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:14.577181 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba9240-ec0e-40b4-ab0d-231c44565833 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:14.624061 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a5ba9240-ec0e-40b4-ab0d-231c44565833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6107694f4ec47e7b551546877e37e52', 'request_id': 'req-a5ba9240-ec0e-40b4-ab0d-231c44565833'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:14.629624 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a5ba9240-ec0e-40b4-ab0d-231c44565833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6107694f4ec47e7b551546877e37e52', 'request_id': 'req-a5ba9240-ec0e-40b4-ab0d-231c44565833'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:14.635769 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a5ba9240-ec0e-40b4-ab0d-231c44565833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6107694f4ec47e7b551546877e37e52', 'request_id': 'req-a5ba9240-ec0e-40b4-ab0d-231c44565833'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:14.647484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a5ba9240-ec0e-40b4-ab0d-231c44565833 admin admin] The token cache is being invalidate because project e6107694f4ec47e7b551546877e37e52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:37:14.647773 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a5ba9240-ec0e-40b4-ab0d-231c44565833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:14.648391 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a5ba9240-ec0e-40b4-ab0d-231c44565833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:14.649898 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1440/2927] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:37:14 2022] DELETE /identity/v3/projects/e6107694f4ec47e7b551546877e37e52 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:37:14.654696 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631ed2b-9499-40e2-a477-96265fb98eae None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:14.654982 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631ed2b-9499-40e2-a477-96265fb98eae None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:14.655255 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631ed2b-9499-40e2-a477-96265fb98eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:14.675134 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a631ed2b-9499-40e2-a477-96265fb98eae None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:37:14.676388 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a631ed2b-9499-40e2-a477-96265fb98eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:14.737893 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1488/2928] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:37:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:37:14.746158 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c0c70-3f93-45ef-8444-f343c5ea67db None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:14.746435 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c0c70-3f93-45ef-8444-f343c5ea67db None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:14.746748 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c0c70-3f93-45ef-8444-f343c5ea67db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:14.765918 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-259c0c70-3f93-45ef-8444-f343c5ea67db None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:37:14.767098 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-259c0c70-3f93-45ef-8444-f343c5ea67db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:14.775209 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1441/2929] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:37:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:37:14.779444 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631ed2b-9499-40e2-a477-96265fb98eae None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:14.789476 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631ed2b-9499-40e2-a477-96265fb98eae None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:14.794067 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad26ad5-44be-467d-ad2c-119aaf934670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:14.794937 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad26ad5-44be-467d-ad2c-119aaf934670 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:14.795221 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad26ad5-44be-467d-ad2c-119aaf934670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:14.795488 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad26ad5-44be-467d-ad2c-119aaf934670 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:14.796126 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad26ad5-44be-467d-ad2c-119aaf934670 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 17:37:14.796423 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad26ad5-44be-467d-ad2c-119aaf934670 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:14.798040 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad26ad5-44be-467d-ad2c-119aaf934670 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:14.809914 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1489/2930] 10.222.0.94 () {58 vars in 1153 bytes} [Thu Sep 1 17:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 17:37:14.814070 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c0c70-3f93-45ef-8444-f343c5ea67db None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:14.823102 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c0c70-3f93-45ef-8444-f343c5ea67db None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:14.827644 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83044f1-cf37-4e23-a604-10ab01d0b880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:14.828222 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83044f1-cf37-4e23-a604-10ab01d0b880 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:14.828491 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83044f1-cf37-4e23-a604-10ab01d0b880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:14.828755 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83044f1-cf37-4e23-a604-10ab01d0b880 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:14.829373 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83044f1-cf37-4e23-a604-10ab01d0b880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:14.831272 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83044f1-cf37-4e23-a604-10ab01d0b880 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:14.859032 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1442/2931] 10.222.0.94 () {60 vars in 1153 bytes} [Thu Sep 1 17:37:14 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:37:14.863277 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad26ad5-44be-467d-ad2c-119aaf934670 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:14.873232 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad26ad5-44be-467d-ad2c-119aaf934670 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:14.928296 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439ef18-6031-4265-9e8b-75b8e2b48af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:14.928823 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439ef18-6031-4265-9e8b-75b8e2b48af5 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:14.929101 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439ef18-6031-4265-9e8b-75b8e2b48af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:14.929373 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439ef18-6031-4265-9e8b-75b8e2b48af5 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:14.930040 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439ef18-6031-4265-9e8b-75b8e2b48af5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:14.932004 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439ef18-6031-4265-9e8b-75b8e2b48af5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:14.952605 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1490/2932] 10.222.0.94 () {60 vars in 1144 bytes} [Thu Sep 1 17:37:14 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 17:37:14.956889 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83044f1-cf37-4e23-a604-10ab01d0b880 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:14.967684 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83044f1-cf37-4e23-a604-10ab01d0b880 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:14.972320 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4d378-446f-4d49-8209-b997e94282fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:14.972915 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4d378-446f-4d49-8209-b997e94282fd admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:14.973193 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4d378-446f-4d49-8209-b997e94282fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:14.973509 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4d378-446f-4d49-8209-b997e94282fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:14.974150 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4d378-446f-4d49-8209-b997e94282fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:14.976345 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4d378-446f-4d49-8209-b997e94282fd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:14.986057 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1443/2933] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:37:14.990121 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439ef18-6031-4265-9e8b-75b8e2b48af5 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:15.000376 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439ef18-6031-4265-9e8b-75b8e2b48af5 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:15.005185 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f238c77-8d46-4653-bb52-a981f5d050c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:15.005835 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f238c77-8d46-4653-bb52-a981f5d050c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:15.006243 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f238c77-8d46-4653-bb52-a981f5d050c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:15.006937 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f238c77-8d46-4653-bb52-a981f5d050c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:15.007222 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f238c77-8d46-4653-bb52-a981f5d050c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:15.008863 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f238c77-8d46-4653-bb52-a981f5d050c9 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:15.020229 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1491/2934] 10.222.0.94 () {58 vars in 1122 bytes} [Thu Sep 1 17:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 17:37:15.025030 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4d378-446f-4d49-8209-b997e94282fd admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:15.035580 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4d378-446f-4d49-8209-b997e94282fd admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:15.041050 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02057bff-b08f-4f10-9fe4-8ff63f707ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:15.041753 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02057bff-b08f-4f10-9fe4-8ff63f707ee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:15.042033 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02057bff-b08f-4f10-9fe4-8ff63f707ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:15.042388 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02057bff-b08f-4f10-9fe4-8ff63f707ee1 admin admin] PATH_INFO: `/v3/projects/027252be53a6443984d9856a5e561839/users/bb833194bcf1407ab0154d2d913fe87b/roles/a78fbf73b27d4781ac14690bbcb1cd9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:15.059429 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02057bff-b08f-4f10-9fe4-8ff63f707ee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=027252be53a6443984d9856a5e561839, user_id=bb833194bcf1407ab0154d2d913fe87b, role_id=a78fbf73b27d4781ac14690bbcb1cd9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:15.062127 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02057bff-b08f-4f10-9fe4-8ff63f707ee1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:15.075622 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1444/2935] 10.222.0.94 () {60 vars in 1483 bytes} [Thu Sep 1 17:37:15 2022] PUT /identity/v3/projects/027252be53a6443984d9856a5e561839/users/bb833194bcf1407ab0154d2d913fe87b/roles/a78fbf73b27d4781ac14690bbcb1cd9f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:37:15.086373 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc68a65-4d1c-466a-832d-4636be951b5d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:15.087280 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc68a65-4d1c-466a-832d-4636be951b5d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:15.087567 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc68a65-4d1c-466a-832d-4636be951b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:15.094659 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:15.119056 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-fcc68a65-4d1c-466a-832d-4636be951b5d None None] MFA Rules not processed for user `bb833194bcf1407ab0154d2d913fe87b`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:37:15.120268 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fcc68a65-4d1c-466a-832d-4636be951b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:15.186865 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1492/2936] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:37:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 17:37:15.203764 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02057bff-b08f-4f10-9fe4-8ff63f707ee1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:15.205536 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-02057bff-b08f-4f10-9fe4-8ff63f707ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:15.262647 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:15.267075 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02057bff-b08f-4f10-9fe4-8ff63f707ee1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:15.272275 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f9dfb-2a7e-4b5e-9d7b-694649039719 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee371754d7d43b4987084db58f44957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:15.273209 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f9dfb-2a7e-4b5e-9d7b-694649039719 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:15.273610 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f9dfb-2a7e-4b5e-9d7b-694649039719 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:15.273934 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f9dfb-2a7e-4b5e-9d7b-694649039719 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:15.282812 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f9dfb-2a7e-4b5e-9d7b-694649039719 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:15.284229 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f9dfb-2a7e-4b5e-9d7b-694649039719 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:15.292947 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1445/2937] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:37:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:37:17.828572 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc68a65-4d1c-466a-832d-4636be951b5d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:17.891450 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc68a65-4d1c-466a-832d-4636be951b5d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:17.895939 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9725381-7c25-4a40-a25e-7806fe13bf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:17.896576 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9725381-7c25-4a40-a25e-7806fe13bf10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:17.896856 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9725381-7c25-4a40-a25e-7806fe13bf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:17.897129 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9725381-7c25-4a40-a25e-7806fe13bf10 admin admin] PATH_INFO: `/v3/users/bb833194bcf1407ab0154d2d913fe87b` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:17.898278 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9725381-7c25-4a40-a25e-7806fe13bf10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb833194bcf1407ab0154d2d913fe87b)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:17.900273 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9725381-7c25-4a40-a25e-7806fe13bf10 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:17.945675 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f9725381-7c25-4a40-a25e-7806fe13bf10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb833194bcf1407ab0154d2d913fe87b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:17.946311 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f9725381-7c25-4a40-a25e-7806fe13bf10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb833194bcf1407ab0154d2d913fe87b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:17.957833 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f9725381-7c25-4a40-a25e-7806fe13bf10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb833194bcf1407ab0154d2d913fe87b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:17.964752 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f9725381-7c25-4a40-a25e-7806fe13bf10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb833194bcf1407ab0154d2d913fe87b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:17.971947 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f9725381-7c25-4a40-a25e-7806fe13bf10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb833194bcf1407ab0154d2d913fe87b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:17.977643 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1493/2938] 10.222.0.94 () {58 vars in 1224 bytes} [Thu Sep 1 17:37:17 2022] DELETE /identity/v3/users/bb833194bcf1407ab0154d2d913fe87b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:37:17.982354 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508e946-db6a-45e9-b881-cc1e5056e682 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:17.982848 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508e946-db6a-45e9-b881-cc1e5056e682 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:17.982968 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508e946-db6a-45e9-b881-cc1e5056e682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:18.001917 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2508e946-db6a-45e9-b881-cc1e5056e682 None None] MFA Rules not processed for user `50b675acba8e48388c8e8252cc16a021`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 17:37:18.003120 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2508e946-db6a-45e9-b881-cc1e5056e682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:18.062111 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1446/2939] 10.222.0.94 () {58 vars in 958 bytes} [Thu Sep 1 17:37:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 17:37:18.072323 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9725381-7c25-4a40-a25e-7806fe13bf10 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:18.073740 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f9725381-7c25-4a40-a25e-7806fe13bf10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:18.086874 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:18.130140 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9725381-7c25-4a40-a25e-7806fe13bf10 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:18.134376 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763654b-db27-4284-8ae9-88361314904b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92edc2953b8e4e42aa64569335acfc9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:18.134968 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763654b-db27-4284-8ae9-88361314904b service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:18.135244 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763654b-db27-4284-8ae9-88361314904b service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:18.135512 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763654b-db27-4284-8ae9-88361314904b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:18.144161 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763654b-db27-4284-8ae9-88361314904b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:18.145594 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763654b-db27-4284-8ae9-88361314904b service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:18.154636 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1494/2940] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:37:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:37:18.422606 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508e946-db6a-45e9-b881-cc1e5056e682 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:37:18.424138 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2508e946-db6a-45e9-b881-cc1e5056e682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:37:18.436484 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508e946-db6a-45e9-b881-cc1e5056e682 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:37:18.441065 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3aa290-ebc5-4ee6-b976-c5f25181480d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b675acba8e48388c8e8252cc16a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf6314541ceb40a5aa90aa5d595b2262', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:37:18.441739 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3aa290-ebc5-4ee6-b976-c5f25181480d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:37:18.442013 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3aa290-ebc5-4ee6-b976-c5f25181480d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:37:18.442280 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3aa290-ebc5-4ee6-b976-c5f25181480d admin admin] PATH_INFO: `/v3/projects/027252be53a6443984d9856a5e561839` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:37:18.443400 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3aa290-ebc5-4ee6-b976-c5f25181480d admin admin] RBAC: Authorizing `identity:delete_project(project_id=027252be53a6443984d9856a5e561839)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:37:18.445303 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3aa290-ebc5-4ee6-b976-c5f25181480d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:37:18.492149 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ea3aa290-ebc5-4ee6-b976-c5f25181480d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '027252be53a6443984d9856a5e561839', 'request_id': 'req-ea3aa290-ebc5-4ee6-b976-c5f25181480d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:18.497801 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ea3aa290-ebc5-4ee6-b976-c5f25181480d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '027252be53a6443984d9856a5e561839', 'request_id': 'req-ea3aa290-ebc5-4ee6-b976-c5f25181480d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:18.503942 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ea3aa290-ebc5-4ee6-b976-c5f25181480d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '027252be53a6443984d9856a5e561839', 'request_id': 'req-ea3aa290-ebc5-4ee6-b976-c5f25181480d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:18.516039 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ea3aa290-ebc5-4ee6-b976-c5f25181480d admin admin] The token cache is being invalidate because project 027252be53a6443984d9856a5e561839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 17:37:18.516337 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ea3aa290-ebc5-4ee6-b976-c5f25181480d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:18.516973 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ea3aa290-ebc5-4ee6-b976-c5f25181480d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 17:37:18.518475 dv-cinder-852211-8-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1447/2941] 10.222.0.94 () {58 vars in 1233 bytes} [Thu Sep 1 17:37:18 2022] DELETE /identity/v3/projects/027252be53a6443984d9856a5e561839 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 17:37:28.150633 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=21 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:28.512966 dv-cinder-852211-8-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=58,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:48.854695 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763654b-db27-4284-8ae9-88361314904b service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 17:40:48.856096 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3763654b-db27-4284-8ae9-88361314904b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:40:48.928012 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763654b-db27-4284-8ae9-88361314904b service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 17:40:48.994218 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd360f-53a5-48e3-aef8-f8f718dc9933 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3622621761f4f18ae3e9dfb5ba99bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f9428f37354c82ac52b6b8eccc424a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 17:40:48.995002 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd360f-53a5-48e3-aef8-f8f718dc9933 service placement] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 17:40:48.995380 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd360f-53a5-48e3-aef8-f8f718dc9933 service placement] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 17:40:48.995763 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd360f-53a5-48e3-aef8-f8f718dc9933 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 17:40:48.998126 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-75cd360f-53a5-48e3-aef8-f8f718dc9933 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 17:40:49.011272 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd360f-53a5-48e3-aef8-f8f718dc9933 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 17:40:49.012853 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd360f-53a5-48e3-aef8-f8f718dc9933 service placement] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 17:40:49.022657 dv-cinder-852211-8-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1495/2942] 10.222.0.94 () {60 vars in 1365 bytes} [Thu Sep 1 17:40:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 17:40:59.018393 dv-cinder-852211-8-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=58 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}